2026-03-30 11:05:03 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 11:05:03 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 11:05:03 [auto1.es] INFO: Batch mode enabled: batch 2/2
2026-03-30 11:05:03 [auto1.es] INFO: Starting spider auto1.es
2026-03-30 11:05:03 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 11:05:03 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 11:05:03 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 11:05:03 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 11:05:03 [scrapy.extensions.telnet] INFO: Telnet Password: 905c17726d503f78
2026-03-30 11:05:03 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-30 11:05:03 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.es/task_22_2026-03-30T11_05_00.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-30 11:05:03 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 11:05:03 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 11:05:03 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 11:05:04 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-30 11:05:04 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 11:05:04 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2119
2026-03-30 11:05:04 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-30 11:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-30 11:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-30 11:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-30 11:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-30 11:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-30 11:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-30 11:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-30 11:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-30 11:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-30 11:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-30 11:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-30 11:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-30 11:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-30 11:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-30 11:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-30 11:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-30 11:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-30 11:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-30 11:05:04 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-30 11:05:04 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-30 11:05:04 [scrapy.core.engine] INFO: Spider opened
2026-03-30 11:05:04 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 11:05:04 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024
2026-03-30 11:05:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 141MiB
2026-03-30 11:05:04 [scrapy-playwright] INFO: Starting download handler
2026-03-30 11:05:04 [scrapy-playwright] INFO: Starting download handler
2026-03-30 11:05:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-30 11:05:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:06:04 [scrapy.extensions.logstats] INFO: Crawled 1 pages (at 1 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 11:06:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 150MiB
2026-03-30 11:07:04 [scrapy.extensions.logstats] INFO: Crawled 1 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 11:07:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 150MiB
2026-03-30 11:07:19 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.314(s), this was the 1st time calling it.
2026-03-30 11:07:19 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.285715779781587 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:07:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:08:04 [scrapy.extensions.logstats] INFO: Crawled 1 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 11:08:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 150MiB
2026-03-30 11:09:04 [scrapy.extensions.logstats] INFO: Crawled 1 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 11:09:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 150MiB
2026-03-30 11:09:37 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 266.533(s), this was the 2nd time calling it.
2026-03-30 11:09:37 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.134177083737426 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:09:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 11:10:04 [scrapy.extensions.logstats] INFO: Crawled 1 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 11:10:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 150MiB
2026-03-30 11:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-30 11:10:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:11:04 [scrapy.extensions.logstats] INFO: Crawled 2 pages (at 1 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 11:11:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 150MiB
2026-03-30 11:12:04 [scrapy.extensions.logstats] INFO: Crawled 2 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 11:12:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 150MiB
2026-03-30 11:12:27 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.303(s), this was the 1st time calling it.
2026-03-30 11:12:27 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.9144748057091183 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:12:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:12:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-30 11:12:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-30 11:12:35 [auto1.es] INFO: Channel: 24h | Page: 0 | totalHits: 2206 | hits on page: 40
2026-03-30 11:12:35 [auto1.es] INFO: Found listing with ID: TE76087
2026-03-30 11:12:35 [auto1.es] INFO: Found listing with ID: WG31603
2026-03-30 11:12:35 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxsourcingstorageprod.table.core.windows.net
2026-03-30 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WG31603%27 HTTP/1.1" 200 None
2026-03-30 11:12:35 [auto1.es] INFO: Scrape type for WG31603: 2
2026-03-30 11:12:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea9d5fa2-05c0-558e-af1d-27af7b15cd5d with identifier: WG31603
2026-03-30 11:12:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea9d5fa2-05c0-558e-af1d-27af7b15cd5d with scrape type 2
2026-03-30 11:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea9d5fa2-05c0-558e-af1d-27af7b15cd5d with scrape type 2
2026-03-30 11:12:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ea9d5fa2-05c0-558e-af1d-27af7b15cd5d, identifier: WG31603
2026-03-30 11:12:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ea9d5fa2-05c0-558e-af1d-27af7b15cd5d with identifier: WG31603
2026-03-30 11:12:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:12:35 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-30 11:12:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:12:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:12:35 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-30 11:12:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:12:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ea9d5fa2-05c0-558e-af1d-27af7b15cd5d with identifier: WG31603
2026-03-30 11:12:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ea9d5fa2-05c0-558e-af1d-27af7b15cd5d with identifier: WG31603 to the API
2026-03-30 11:12:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:29:00Z',
'fuel_type': 'petrol',
'id': 'ea9d5fa2-05c0-558e-af1d-27af7b15cd5d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG31603',
'listing': 'auction',
'make': 'Toyota',
'model': 'Corolla',
'odometer': 258946,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-05-20',
'seller_name': None,
'title': 'Toyota Corolla 1.6 Compact Sol',
'transmission': 'manual',
'trim': 'Compact Sol',
'year': 2003}
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WG31603%27 HTTP/1.1" 200 None
2026-03-30 11:12:36 [auto1.es] INFO: Saving data for WG31603: {'auction_closing_time': 1774970940.0, 'created_time': 1774091172.531837, 'last_price_update_time': 1774869156.078356}
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WG31603') HTTP/1.1" 204 0
2026-03-30 11:12:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:36 [auto1.es] INFO: Found listing with ID: HU24225
2026-03-30 11:12:36 [auto1.es] INFO: Found listing with ID: SN89364
2026-03-30 11:12:36 [auto1.es] INFO: Found listing with ID: HC40345
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HC40345%27 HTTP/1.1" 200 None
2026-03-30 11:12:36 [auto1.es] INFO: Scrape type for HC40345: 1
2026-03-30 11:12:36 [auto1.es] INFO: Found listing with ID: TR74605
2026-03-30 11:12:36 [auto1.es] INFO: Found listing with ID: JG33033
2026-03-30 11:12:36 [auto1.es] INFO: Found listing with ID: SK77432
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SK77432%27 HTTP/1.1" 200 None
2026-03-30 11:12:36 [auto1.es] INFO: Scrape type for SK77432: 1
2026-03-30 11:12:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:36 [auto1.es] INFO: Found listing with ID: MJ08668
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MJ08668%27 HTTP/1.1" 200 None
2026-03-30 11:12:36 [auto1.es] INFO: Scrape type for MJ08668: 1
2026-03-30 11:12:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:36 [auto1.es] INFO: Found listing with ID: UR19507
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UR19507%27 HTTP/1.1" 200 None
2026-03-30 11:12:36 [auto1.es] INFO: Scrape type for UR19507: 1
2026-03-30 11:12:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:36 [auto1.es] INFO: Found listing with ID: JU25572
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JU25572%27 HTTP/1.1" 200 None
2026-03-30 11:12:36 [auto1.es] INFO: Scrape type for JU25572: 1
2026-03-30 11:12:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:36 [auto1.es] INFO: Found listing with ID: AJ27440
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ27440%27 HTTP/1.1" 200 None
2026-03-30 11:12:36 [auto1.es] INFO: Scrape type for AJ27440: 1
2026-03-30 11:12:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:36 [auto1.es] INFO: Found listing with ID: XN62017
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XN62017%27 HTTP/1.1" 200 None
2026-03-30 11:12:36 [auto1.es] INFO: Scrape type for XN62017: 2
2026-03-30 11:12:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5106c185-d0ab-5f02-a364-52ecd539d1f1 with identifier: XN62017
2026-03-30 11:12:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5106c185-d0ab-5f02-a364-52ecd539d1f1 with scrape type 2
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5106c185-d0ab-5f02-a364-52ecd539d1f1 with scrape type 2
2026-03-30 11:12:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5106c185-d0ab-5f02-a364-52ecd539d1f1, identifier: XN62017
2026-03-30 11:12:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5106c185-d0ab-5f02-a364-52ecd539d1f1 with identifier: XN62017
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-30 11:12:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-30 11:12:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:12:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5106c185-d0ab-5f02-a364-52ecd539d1f1 with identifier: XN62017
2026-03-30 11:12:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5106c185-d0ab-5f02-a364-52ecd539d1f1 with identifier: XN62017 to the API
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-31T15:17:29Z',
'fuel_type': 'diesel',
'id': '5106c185-d0ab-5f02-a364-52ecd539d1f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN62017',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 186360,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-04',
'seller_name': None,
'title': 'Renault Megane 1.5 BLUE dCi Zen',
'transmission': 'manual',
'trim': 'Zen',
'year': 2019}
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XN62017%27 HTTP/1.1" 200 None
2026-03-30 11:12:36 [auto1.es] INFO: Saving data for XN62017: {'auction_closing_time': 1774970249.0, 'created_time': 1773691574.409674, 'last_price_update_time': 1774869156.994764}
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XN62017') HTTP/1.1" 204 0
2026-03-30 11:12:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:37 [auto1.es] INFO: Found listing with ID: ZG97055
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZG97055%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [auto1.es] INFO: Scrape type for ZG97055: 1
2026-03-30 11:12:37 [auto1.es] INFO: Found listing with ID: TU64699
2026-03-30 11:12:37 [auto1.es] INFO: Found listing with ID: KG31463
2026-03-30 11:12:37 [auto1.es] INFO: Found listing with ID: MX55257
2026-03-30 11:12:37 [auto1.es] INFO: Found listing with ID: YW75057
2026-03-30 11:12:37 [auto1.es] INFO: Found listing with ID: MP93470
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MP93470%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [auto1.es] INFO: Scrape type for MP93470: 2
2026-03-30 11:12:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5f51d8a-9b77-51e1-ae6c-26179949b5d4 with identifier: MP93470
2026-03-30 11:12:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5f51d8a-9b77-51e1-ae6c-26179949b5d4 with scrape type 2
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5f51d8a-9b77-51e1-ae6c-26179949b5d4 with scrape type 2
2026-03-30 11:12:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d5f51d8a-9b77-51e1-ae6c-26179949b5d4, identifier: MP93470
2026-03-30 11:12:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d5f51d8a-9b77-51e1-ae6c-26179949b5d4 with identifier: MP93470
2026-03-30 11:12:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d5f51d8a-9b77-51e1-ae6c-26179949b5d4 with identifier: MP93470
2026-03-30 11:12:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d5f51d8a-9b77-51e1-ae6c-26179949b5d4 with identifier: MP93470 to the API
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-31T15:41:55Z',
'fuel_type': 'diesel',
'id': 'd5f51d8a-9b77-51e1-ae6c-26179949b5d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP93470',
'listing': 'auction',
'make': 'Toyota',
'model': 'Verso',
'odometer': 245103,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-02-16',
'seller_name': None,
'title': 'Toyota Verso 2.0 D-4D Advance',
'transmission': 'manual',
'trim': 'Advance',
'year': 2011}
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MP93470%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [auto1.es] INFO: Saving data for MP93470: {'auction_closing_time': 1774971715.0, 'created_time': 1774274831.984703, 'last_price_update_time': 1774869157.584767}
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MP93470') HTTP/1.1" 204 0
2026-03-30 11:12:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:37 [auto1.es] INFO: Found listing with ID: NS19372
2026-03-30 11:12:37 [auto1.es] INFO: Found listing with ID: SU99027
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SU99027%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [auto1.es] INFO: Scrape type for SU99027: 1
2026-03-30 11:12:37 [auto1.es] INFO: Found listing with ID: TS87015
2026-03-30 11:12:37 [auto1.es] INFO: Found listing with ID: MP75885
2026-03-30 11:12:37 [auto1.es] INFO: Found listing with ID: UL16630
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UL16630%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [auto1.es] INFO: Scrape type for UL16630: 1
2026-03-30 11:12:37 [auto1.es] INFO: Found listing with ID: PG13200
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PG13200%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [auto1.es] INFO: Scrape type for PG13200: 1
2026-03-30 11:12:37 [auto1.es] INFO: Found listing with ID: DF86538
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DF86538%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [auto1.es] INFO: Scrape type for DF86538: 1
2026-03-30 11:12:37 [auto1.es] INFO: Found listing with ID: PH25180
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PH25180%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [auto1.es] INFO: Scrape type for PH25180: 1
2026-03-30 11:12:37 [auto1.es] INFO: Found listing with ID: GJ97724
2026-03-30 11:12:37 [auto1.es] INFO: Found listing with ID: NG43974
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NG43974%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [auto1.es] INFO: Scrape type for NG43974: 1
2026-03-30 11:12:37 [auto1.es] INFO: Found listing with ID: PR99923
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PR99923%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [auto1.es] INFO: Scrape type for PR99923: 1
2026-03-30 11:12:37 [auto1.es] INFO: Found listing with ID: PH51159
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PH51159%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [auto1.es] INFO: Scrape type for PH51159: 2
2026-03-30 11:12:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56c0b974-35b9-5e38-b9cc-181d9b465ae0 with identifier: PH51159
2026-03-30 11:12:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56c0b974-35b9-5e38-b9cc-181d9b465ae0 with scrape type 2
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56c0b974-35b9-5e38-b9cc-181d9b465ae0 with scrape type 2
2026-03-30 11:12:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 56c0b974-35b9-5e38-b9cc-181d9b465ae0, identifier: PH51159
2026-03-30 11:12:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 56c0b974-35b9-5e38-b9cc-181d9b465ae0 with identifier: PH51159
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-30 11:12:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:12:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 56c0b974-35b9-5e38-b9cc-181d9b465ae0 with identifier: PH51159
2026-03-30 11:12:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 56c0b974-35b9-5e38-b9cc-181d9b465ae0 with identifier: PH51159 to the API
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:36:56Z',
'fuel_type': 'diesel',
'id': '56c0b974-35b9-5e38-b9cc-181d9b465ae0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH51159',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 156675,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-08-04',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Style',
'transmission': 'automatic',
'trim': 'BlueEfficiency Style',
'year': 2014}
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PH51159%27 HTTP/1.1" 200 None
2026-03-30 11:12:38 [auto1.es] INFO: Saving data for PH51159: {'auction_closing_time': 1774971416.0, 'created_time': 1774296622.37008, 'last_price_update_time': 1774869158.378765}
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PH51159') HTTP/1.1" 204 0
2026-03-30 11:12:38 [auto1.es] INFO: Found listing with ID: MV24721
2026-03-30 11:12:38 [auto1.es] INFO: Found listing with ID: RL41759
2026-03-30 11:12:38 [auto1.es] INFO: Found listing with ID: PK44765
2026-03-30 11:12:38 [auto1.es] INFO: Found listing with ID: JN78830
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JN78830%27 HTTP/1.1" 200 None
2026-03-30 11:12:38 [auto1.es] INFO: Scrape type for JN78830: 1
2026-03-30 11:12:38 [auto1.es] INFO: Found listing with ID: NA33404
2026-03-30 11:12:38 [auto1.es] INFO: Found listing with ID: VG08794
2026-03-30 11:12:38 [auto1.es] INFO: Found listing with ID: EM34924
2026-03-30 11:12:38 [auto1.es] INFO: Found listing with ID: GT52927
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT52927%27 HTTP/1.1" 200 None
2026-03-30 11:12:38 [auto1.es] INFO: Scrape type for GT52927: 1
2026-03-30 11:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SK77432/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:38 [auto1.es] INFO: Found listing with ID: ZV81401
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZV81401%27 HTTP/1.1" 200 None
2026-03-30 11:12:38 [auto1.es] INFO: Scrape type for ZV81401: 1
2026-03-30 11:12:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZG97055/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:40 [auto1.es] INFO: Channel: 24h | Page: 1 | totalHits: 2206 | hits on page: 40
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: TE76087
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: WG31603
2026-03-30 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WG31603%27 HTTP/1.1" 200 None
2026-03-30 11:12:40 [auto1.es] INFO: Scrape type for WG31603: 0
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: HU24225
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: SN89364
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: HC40345
2026-03-30 11:12:40 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/HC40345/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: TR74605
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: JG33033
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: SK77432
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: MJ08668
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: UR19507
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: JU25572
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: AJ27440
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: XN62017
2026-03-30 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XN62017%27 HTTP/1.1" 200 None
2026-03-30 11:12:40 [auto1.es] INFO: Scrape type for XN62017: 0
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: ZG97055
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: TU64699
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: KG31463
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: MX55257
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: YW75057
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: MP93470
2026-03-30 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MP93470%27 HTTP/1.1" 200 None
2026-03-30 11:12:40 [auto1.es] INFO: Scrape type for MP93470: 0
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: NS19372
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: SU99027
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: TS87015
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: MP75885
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: UL16630
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: PG13200
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: DF86538
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: PH25180
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: GJ97724
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: NG43974
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: PR99923
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: PH51159
2026-03-30 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PH51159%27 HTTP/1.1" 200 None
2026-03-30 11:12:40 [auto1.es] INFO: Scrape type for PH51159: 0
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: MV24721
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: RL41759
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: PK44765
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: JN78830
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: NA33404
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: VG08794
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: EM34924
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: GT52927
2026-03-30 11:12:40 [auto1.es] INFO: Found listing with ID: ZV81401
2026-03-30 11:12:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SU99027/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DF86538/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PH25180/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PG13200/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UR19507/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JN78830/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:04 [scrapy.extensions.logstats] INFO: Crawled 13 pages (at 11 pages/min), scraped 4 items (at 4 items/min)
2026-03-30 11:13:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 154MiB
2026-03-30 11:13:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PR99923/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GT52927/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZG97055> (referer: https://www.auto1.com/v1/car-details-view/ZG97055/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88656335-1c97-5a20-bfd8-5797945bfc52 with identifier: ZG97055
2026-03-30 11:13:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88656335-1c97-5a20-bfd8-5797945bfc52 with scrape type 1
2026-03-30 11:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 88656335-1c97-5a20-bfd8-5797945bfc52
2026-03-30 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fd2%252F1ed20b323e5023a52d4979a6b24029e5%252Fpa%252FZG97055_c070f3e1182f9e5ad5fb6a7799ae702e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/d2/1ed20b323e5023a52d4979a6b24029e5/pa/ZG97055_c070f3e1182f9e5ad5fb6a7799ae702e.jpg already downloaded
2026-03-30 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fd2%252F1ed20b323e5023a52d4979a6b24029e5%252Fpa%252FZG97055_86478d2b60b6637ad65055ac0084b13c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/d2/1ed20b323e5023a52d4979a6b24029e5/pa/ZG97055_86478d2b60b6637ad65055ac0084b13c.jpg already downloaded
2026-03-30 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fd2%252F1ed20b323e5023a52d4979a6b24029e5%252Fpa%252FZG97055_da964cd0659d52f28c445586c8f49e63.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/d2/1ed20b323e5023a52d4979a6b24029e5/pa/ZG97055_da964cd0659d52f28c445586c8f49e63.jpg already downloaded
2026-03-30 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fd2%252F1ed20b323e5023a52d4979a6b24029e5%252Fpa%252FZG97055_789409d4d5fa24d5e6fe76ec5d96e7bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/d2/1ed20b323e5023a52d4979a6b24029e5/pa/ZG97055_789409d4d5fa24d5e6fe76ec5d96e7bc.jpg already downloaded
2026-03-30 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fd2%252F1ed20b323e5023a52d4979a6b24029e5%252Fpa%252FZG97055_4aa33e1a13cdbf2c71939a2f4ed2214f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/d2/1ed20b323e5023a52d4979a6b24029e5/pa/ZG97055_4aa33e1a13cdbf2c71939a2f4ed2214f.jpg already downloaded
2026-03-30 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fd2%252F1ed20b323e5023a52d4979a6b24029e5%252Fpa%252FZG97055_e6301566b57ef15d5150ae5565d56ed1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/d2/1ed20b323e5023a52d4979a6b24029e5/pa/ZG97055_e6301566b57ef15d5150ae5565d56ed1.jpg already downloaded
2026-03-30 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fd2%252F1ed20b323e5023a52d4979a6b24029e5%252Fpa%252FZG97055_b0b52eb189da725446ae7bfa0295337e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/d2/1ed20b323e5023a52d4979a6b24029e5/pa/ZG97055_b0b52eb189da725446ae7bfa0295337e.jpg already downloaded
2026-03-30 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fd2%252F1ed20b323e5023a52d4979a6b24029e5%252Fpa%252FZG97055_3f4f8bd09149499b70c62ba4e1576c08.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/d2/1ed20b323e5023a52d4979a6b24029e5/pa/ZG97055_3f4f8bd09149499b70c62ba4e1576c08.jpg already downloaded
2026-03-30 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fd2%252F1ed20b323e5023a52d4979a6b24029e5%252Fpa%252FZG97055_63dd87376dd7063f11668fbba6a3cda1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/d2/1ed20b323e5023a52d4979a6b24029e5/pa/ZG97055_63dd87376dd7063f11668fbba6a3cda1.jpg already downloaded
2026-03-30 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fd2%252F1ed20b323e5023a52d4979a6b24029e5%252Fpa%252FZG97055_0ce315810c09d53facfb4dc61cbda13a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/d2/1ed20b323e5023a52d4979a6b24029e5/pa/ZG97055_0ce315810c09d53facfb4dc61cbda13a.jpg already downloaded
2026-03-30 11:13:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 88656335-1c97-5a20-bfd8-5797945bfc52, identifier: ZG97055
2026-03-30 11:13:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 88656335-1c97-5a20-bfd8-5797945bfc52 with identifier: ZG97055
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-30 11:13:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:13:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 88656335-1c97-5a20-bfd8-5797945bfc52 with identifier: ZG97055
2026-03-30 11:13:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 88656335-1c97-5a20-bfd8-5797945bfc52 with identifier: ZG97055 to the API
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZG97055>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.7L',
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:09:00Z',
'fuel_type': 'diesel',
'id': '88656335-1c97-5a20-bfd8-5797945bfc52',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG97055',
'listing': 'auction',
'location': 'ES, La Roda de AndalucÃa',
'make': 'Kia',
'model': 'Sportage',
'odometer': 163117,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img1e/d2/1ed20b323e5023a52d4979a6b24029e5/pa/ZG97055_c070f3e1182f9e5ad5fb6a7799ae702e.jpg',
'https://img-pa.auto1.com/img1e/d2/1ed20b323e5023a52d4979a6b24029e5/pa/ZG97055_86478d2b60b6637ad65055ac0084b13c.jpg',
'https://img-pa.auto1.com/img1e/d2/1ed20b323e5023a52d4979a6b24029e5/pa/ZG97055_da964cd0659d52f28c445586c8f49e63.jpg',
'https://img-pa.auto1.com/img1e/d2/1ed20b323e5023a52d4979a6b24029e5/pa/ZG97055_789409d4d5fa24d5e6fe76ec5d96e7bc.jpg',
'https://img-pa.auto1.com/img1e/d2/1ed20b323e5023a52d4979a6b24029e5/pa/ZG97055_4aa33e1a13cdbf2c71939a2f4ed2214f.jpg',
'https://img-pa.auto1.com/img1e/d2/1ed20b323e5023a52d4979a6b24029e5/pa/ZG97055_e6301566b57ef15d5150ae5565d56ed1.jpg',
'https://img-pa.auto1.com/img1e/d2/1ed20b323e5023a52d4979a6b24029e5/pa/ZG97055_b0b52eb189da725446ae7bfa0295337e.jpg',
'https://img-pa.auto1.com/img1e/d2/1ed20b323e5023a52d4979a6b24029e5/pa/ZG97055_3f4f8bd09149499b70c62ba4e1576c08.jpg',
'https://img-pa.auto1.com/img1e/d2/1ed20b323e5023a52d4979a6b24029e5/pa/ZG97055_63dd87376dd7063f11668fbba6a3cda1.jpg',
'https://img-pa.auto1.com/img1e/d2/1ed20b323e5023a52d4979a6b24029e5/pa/ZG97055_0ce315810c09d53facfb4dc61cbda13a.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88656335-1c97-5a20-bfd8-5797945bfc52/88656335-1c97-5a20-bfd8-5797945bfc52_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69577,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/d2/1ed20b323e5023a52d4979a6b24029e5/pa/ZG97055_c070f3e1182f9e5ad5fb6a7799ae702e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88656335-1c97-5a20-bfd8-5797945bfc52/88656335-1c97-5a20-bfd8-5797945bfc52_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74541,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/d2/1ed20b323e5023a52d4979a6b24029e5/pa/ZG97055_86478d2b60b6637ad65055ac0084b13c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88656335-1c97-5a20-bfd8-5797945bfc52/88656335-1c97-5a20-bfd8-5797945bfc52_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71513,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/d2/1ed20b323e5023a52d4979a6b24029e5/pa/ZG97055_da964cd0659d52f28c445586c8f49e63.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88656335-1c97-5a20-bfd8-5797945bfc52/88656335-1c97-5a20-bfd8-5797945bfc52_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58959,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/d2/1ed20b323e5023a52d4979a6b24029e5/pa/ZG97055_789409d4d5fa24d5e6fe76ec5d96e7bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88656335-1c97-5a20-bfd8-5797945bfc52/88656335-1c97-5a20-bfd8-5797945bfc52_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72437,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/d2/1ed20b323e5023a52d4979a6b24029e5/pa/ZG97055_4aa33e1a13cdbf2c71939a2f4ed2214f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88656335-1c97-5a20-bfd8-5797945bfc52/88656335-1c97-5a20-bfd8-5797945bfc52_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73740,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/d2/1ed20b323e5023a52d4979a6b24029e5/pa/ZG97055_e6301566b57ef15d5150ae5565d56ed1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88656335-1c97-5a20-bfd8-5797945bfc52/88656335-1c97-5a20-bfd8-5797945bfc52_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54645,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/d2/1ed20b323e5023a52d4979a6b24029e5/pa/ZG97055_b0b52eb189da725446ae7bfa0295337e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88656335-1c97-5a20-bfd8-5797945bfc52/88656335-1c97-5a20-bfd8-5797945bfc52_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69927,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/d2/1ed20b323e5023a52d4979a6b24029e5/pa/ZG97055_3f4f8bd09149499b70c62ba4e1576c08.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88656335-1c97-5a20-bfd8-5797945bfc52/88656335-1c97-5a20-bfd8-5797945bfc52_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64249,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/d2/1ed20b323e5023a52d4979a6b24029e5/pa/ZG97055_63dd87376dd7063f11668fbba6a3cda1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88656335-1c97-5a20-bfd8-5797945bfc52/88656335-1c97-5a20-bfd8-5797945bfc52_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74768,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/d2/1ed20b323e5023a52d4979a6b24029e5/pa/ZG97055_0ce315810c09d53facfb4dc61cbda13a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-12-10',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Sportage 1.7 CRDi Drive 4x2',
'transmission': 'manual',
'trim': 'Drive 4x2',
'year': 2012}
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZG97055%27 HTTP/1.1" 200 None
2026-03-30 11:13:41 [auto1.es] INFO: Saving data for ZG97055: {'created_time': 1774869221.497364, 'last_price_update_time': 1774869221.497374, 'auction_closing_time': 1774969740.0}
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZG97055') HTTP/1.1" 204 0
2026-03-30 11:13:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:46 [auto1.es] INFO: Channel: 24h | Page: 2 | totalHits: 2207 | hits on page: 40
2026-03-30 11:13:46 [auto1.es] INFO: Found listing with ID: ZV81401
2026-03-30 11:13:46 [auto1.es] INFO: Found listing with ID: SJ57569
2026-03-30 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SJ57569%27 HTTP/1.1" 200 None
2026-03-30 11:13:46 [auto1.es] INFO: Scrape type for SJ57569: 2
2026-03-30 11:13:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdf964c6-44e4-5943-beb5-dd6f1dade521 with identifier: SJ57569
2026-03-30 11:13:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdf964c6-44e4-5943-beb5-dd6f1dade521 with scrape type 2
2026-03-30 11:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fdf964c6-44e4-5943-beb5-dd6f1dade521 with scrape type 2
2026-03-30 11:13:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fdf964c6-44e4-5943-beb5-dd6f1dade521, identifier: SJ57569
2026-03-30 11:13:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fdf964c6-44e4-5943-beb5-dd6f1dade521 with identifier: SJ57569
2026-03-30 11:13:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fdf964c6-44e4-5943-beb5-dd6f1dade521 with identifier: SJ57569
2026-03-30 11:13:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fdf964c6-44e4-5943-beb5-dd6f1dade521 with identifier: SJ57569 to the API
2026-03-30 11:13:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-31T15:36:53Z',
'fuel_type': 'diesel',
'id': 'fdf964c6-44e4-5943-beb5-dd6f1dade521',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ57569',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC90',
'odometer': 474797,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-06-23',
'seller_name': None,
'title': 'Volvo XC90 2.4 D5 Momentum',
'transmission': 'automatic',
'trim': 'Momentum',
'year': 2011}
2026-03-30 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SJ57569%27 HTTP/1.1" 200 None
2026-03-30 11:13:46 [auto1.es] INFO: Saving data for SJ57569: {'auction_closing_time': 1774971413.0, 'created_time': 1773777942.941094, 'last_price_update_time': 1774869226.75229}
2026-03-30 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SJ57569') HTTP/1.1" 204 0
2026-03-30 11:13:46 [auto1.es] INFO: Found listing with ID: PV91005
2026-03-30 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PV91005%27 HTTP/1.1" 200 None
2026-03-30 11:13:46 [auto1.es] INFO: Scrape type for PV91005: 1
2026-03-30 11:13:46 [auto1.es] INFO: Found listing with ID: KX70446
2026-03-30 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KX70446%27 HTTP/1.1" 200 None
2026-03-30 11:13:46 [auto1.es] INFO: Scrape type for KX70446: 2
2026-03-30 11:13:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1250e89-cb2a-5d8a-a2aa-96103eedeea6 with identifier: KX70446
2026-03-30 11:13:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1250e89-cb2a-5d8a-a2aa-96103eedeea6 with scrape type 2
2026-03-30 11:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1250e89-cb2a-5d8a-a2aa-96103eedeea6 with scrape type 2
2026-03-30 11:13:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f1250e89-cb2a-5d8a-a2aa-96103eedeea6, identifier: KX70446
2026-03-30 11:13:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f1250e89-cb2a-5d8a-a2aa-96103eedeea6 with identifier: KX70446
2026-03-30 11:13:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:13:46 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-30 11:13:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:13:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f1250e89-cb2a-5d8a-a2aa-96103eedeea6 with identifier: KX70446
2026-03-30 11:13:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f1250e89-cb2a-5d8a-a2aa-96103eedeea6 with identifier: KX70446 to the API
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:33:02Z',
'fuel_type': 'diesel',
'id': 'f1250e89-cb2a-5d8a-a2aa-96103eedeea6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX70446',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 80264,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-05',
'seller_name': None,
'title': 'Land Rover Evoque D150 Mild-Hybrid S',
'transmission': 'automatic',
'trim': 'S',
'year': 2019}
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KX70446%27 HTTP/1.1" 200 None
2026-03-30 11:13:47 [auto1.es] INFO: Saving data for KX70446: {'auction_closing_time': 1774971182.0, 'created_time': 1774274838.398904, 'last_price_update_time': 1774869227.334857}
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KX70446') HTTP/1.1" 204 0
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: JZ58453
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JZ58453%27 HTTP/1.1" 200 None
2026-03-30 11:13:47 [auto1.es] INFO: Scrape type for JZ58453: 1
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: HU27637
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HU27637%27 HTTP/1.1" 200 None
2026-03-30 11:13:47 [auto1.es] INFO: Scrape type for HU27637: 1
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: TP95319
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: TX75728
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: NL65956
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: FD15561
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FD15561%27 HTTP/1.1" 200 None
2026-03-30 11:13:47 [auto1.es] INFO: Scrape type for FD15561: 1
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: LH92168
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: YA78719
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YA78719%27 HTTP/1.1" 200 None
2026-03-30 11:13:47 [auto1.es] INFO: Scrape type for YA78719: 1
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: GB26165
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: GS28595
2026-03-30 11:13:47 [auto1.es] INFO: Found listing with ID: YN14059
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YN14059%27 HTTP/1.1" 200 None
2026-03-30 11:13:47 [auto1.es] INFO: Scrape type for YN14059: 2
2026-03-30 11:13:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3caa5e50-737a-5878-b712-0e181595fa4e with identifier: YN14059
2026-03-30 11:13:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3caa5e50-737a-5878-b712-0e181595fa4e with scrape type 2
2026-03-30 11:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3caa5e50-737a-5878-b712-0e181595fa4e with scrape type 2
2026-03-30 11:13:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3caa5e50-737a-5878-b712-0e181595fa4e, identifier: YN14059
2026-03-30 11:13:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3caa5e50-737a-5878-b712-0e181595fa4e with identifier: YN14059
2026-03-30 11:13:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3caa5e50-737a-5878-b712-0e181595fa4e with identifier: YN14059
2026-03-30 11:13:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3caa5e50-737a-5878-b712-0e181595fa4e with identifier: YN14059 to the API
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-31T15:12:00Z',
'fuel_type': 'diesel',
'id': '3caa5e50-737a-5878-b712-0e181595fa4e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN14059',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 96243,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-28',
'seller_name': None,
'title': 'Citroen C3 1.6 Blue-HDi Exclusive',
'transmission': 'manual',
'trim': 'Exclusive',
'year': 2016}
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YN14059%27 HTTP/1.1" 200 None
2026-03-30 11:13:47 [auto1.es] INFO: Saving data for YN14059: {'auction_closing_time': 1774969920.0, 'created_time': 1773691627.551692, 'last_price_update_time': 1774869227.896456}
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YN14059') HTTP/1.1" 204 0
2026-03-30 11:13:48 [auto1.es] INFO: Found listing with ID: JS29951
2026-03-30 11:13:48 [auto1.es] INFO: Found listing with ID: VH94950
2026-03-30 11:13:48 [auto1.es] INFO: Found listing with ID: MB90755
2026-03-30 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MB90755%27 HTTP/1.1" 200 None
2026-03-30 11:13:48 [auto1.es] INFO: Scrape type for MB90755: 1
2026-03-30 11:13:48 [auto1.es] INFO: Found listing with ID: MW45147
2026-03-30 11:13:48 [auto1.es] INFO: Found listing with ID: JP78473
2026-03-30 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JP78473%27 HTTP/1.1" 200 None
2026-03-30 11:13:48 [auto1.es] INFO: Scrape type for JP78473: 1
2026-03-30 11:13:48 [auto1.es] INFO: Found listing with ID: PH62275
2026-03-30 11:13:48 [auto1.es] INFO: Found listing with ID: CM38953
2026-03-30 11:13:48 [auto1.es] INFO: Found listing with ID: JY50490
2026-03-30 11:13:48 [auto1.es] INFO: Found listing with ID: UK20362
2026-03-30 11:13:48 [auto1.es] INFO: Found listing with ID: MA14893
2026-03-30 11:13:48 [auto1.es] INFO: Found listing with ID: VU27795
2026-03-30 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VU27795%27 HTTP/1.1" 200 None
2026-03-30 11:13:48 [auto1.es] INFO: Scrape type for VU27795: 2
2026-03-30 11:13:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 423e6c39-587c-5f38-a941-e32d9a8fa865 with identifier: VU27795
2026-03-30 11:13:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 423e6c39-587c-5f38-a941-e32d9a8fa865 with scrape type 2
2026-03-30 11:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 423e6c39-587c-5f38-a941-e32d9a8fa865 with scrape type 2
2026-03-30 11:13:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 423e6c39-587c-5f38-a941-e32d9a8fa865, identifier: VU27795
2026-03-30 11:13:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 423e6c39-587c-5f38-a941-e32d9a8fa865 with identifier: VU27795
2026-03-30 11:13:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 423e6c39-587c-5f38-a941-e32d9a8fa865 with identifier: VU27795
2026-03-30 11:13:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 423e6c39-587c-5f38-a941-e32d9a8fa865 with identifier: VU27795 to the API
2026-03-30 11:13:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 60,
'expiration_date': '2026-03-31T15:24:40Z',
'fuel_type': 'petrol',
'id': '423e6c39-587c-5f38-a941-e32d9a8fa865',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU27795',
'listing': 'auction',
'make': 'Fiat',
'model': 'Panda',
'odometer': 104611,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-09-09',
'seller_name': None,
'title': 'Fiat Panda 1.2 Dynamic',
'transmission': 'manual',
'trim': 'Dynamic',
'year': 2004}
2026-03-30 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VU27795%27 HTTP/1.1" 200 None
2026-03-30 11:13:48 [auto1.es] INFO: Saving data for VU27795: {'auction_closing_time': 1774970680.0, 'created_time': 1773670044.298181, 'last_price_update_time': 1774869228.500342}
2026-03-30 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VU27795') HTTP/1.1" 204 0
2026-03-30 11:13:48 [auto1.es] INFO: Found listing with ID: MZ74432
2026-03-30 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MZ74432%27 HTTP/1.1" 200 None
2026-03-30 11:13:48 [auto1.es] INFO: Scrape type for MZ74432: 2
2026-03-30 11:13:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 802796f0-cf50-59bc-be32-1f87d9f6d142 with identifier: MZ74432
2026-03-30 11:13:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 802796f0-cf50-59bc-be32-1f87d9f6d142 with scrape type 2
2026-03-30 11:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 802796f0-cf50-59bc-be32-1f87d9f6d142 with scrape type 2
2026-03-30 11:13:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 802796f0-cf50-59bc-be32-1f87d9f6d142, identifier: MZ74432
2026-03-30 11:13:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 802796f0-cf50-59bc-be32-1f87d9f6d142 with identifier: MZ74432
2026-03-30 11:13:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 802796f0-cf50-59bc-be32-1f87d9f6d142 with identifier: MZ74432
2026-03-30 11:13:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 802796f0-cf50-59bc-be32-1f87d9f6d142 with identifier: MZ74432 to the API
2026-03-30 11:13:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-31T15:39:57Z',
'fuel_type': 'diesel',
'id': '802796f0-cf50-59bc-be32-1f87d9f6d142',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ74432',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 181753,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-21',
'seller_name': None,
'title': 'BMW 3er 318d GT',
'transmission': 'manual',
'trim': '',
'year': 2014}
2026-03-30 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MZ74432%27 HTTP/1.1" 200 None
2026-03-30 11:13:49 [auto1.es] INFO: Saving data for MZ74432: {'auction_closing_time': 1774971597.0, 'created_time': 1773127047.181184, 'last_price_update_time': 1774869229.055534}
2026-03-30 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MZ74432') HTTP/1.1" 204 0
2026-03-30 11:13:49 [auto1.es] INFO: Found listing with ID: TX15158
2026-03-30 11:13:49 [auto1.es] INFO: Found listing with ID: BP04557
2026-03-30 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BP04557%27 HTTP/1.1" 200 None
2026-03-30 11:13:49 [auto1.es] INFO: Scrape type for BP04557: 1
2026-03-30 11:13:49 [auto1.es] INFO: Found listing with ID: ZT79266
2026-03-30 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZT79266%27 HTTP/1.1" 200 None
2026-03-30 11:13:49 [auto1.es] INFO: Scrape type for ZT79266: 2
2026-03-30 11:13:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cf0707f-3f3b-5b73-8023-561f6181af45 with identifier: ZT79266
2026-03-30 11:13:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cf0707f-3f3b-5b73-8023-561f6181af45 with scrape type 2
2026-03-30 11:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2cf0707f-3f3b-5b73-8023-561f6181af45 with scrape type 2
2026-03-30 11:13:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2cf0707f-3f3b-5b73-8023-561f6181af45, identifier: ZT79266
2026-03-30 11:13:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2cf0707f-3f3b-5b73-8023-561f6181af45 with identifier: ZT79266
2026-03-30 11:13:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2cf0707f-3f3b-5b73-8023-561f6181af45 with identifier: ZT79266
2026-03-30 11:13:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2cf0707f-3f3b-5b73-8023-561f6181af45 with identifier: ZT79266 to the API
2026-03-30 11:13:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-31T15:13:58Z',
'fuel_type': 'diesel',
'id': '2cf0707f-3f3b-5b73-8023-561f6181af45',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT79266',
'listing': 'auction',
'make': 'Audi',
'model': 'A4 Allroad',
'odometer': 321901,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-09-08',
'seller_name': None,
'title': 'Audi A4 Allroad 2.0 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-30 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZT79266%27 HTTP/1.1" 200 None
2026-03-30 11:13:49 [auto1.es] INFO: Saving data for ZT79266: {'auction_closing_time': 1774970038.0, 'created_time': 1773777963.012405, 'last_price_update_time': 1774869229.676689}
2026-03-30 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZT79266') HTTP/1.1" 204 0
2026-03-30 11:13:49 [auto1.es] INFO: Found listing with ID: NA01743
2026-03-30 11:13:49 [auto1.es] INFO: Found listing with ID: ZD80422
2026-03-30 11:13:49 [auto1.es] INFO: Found listing with ID: CN25328
2026-03-30 11:13:49 [auto1.es] INFO: Found listing with ID: FC08911
2026-03-30 11:13:49 [auto1.es] INFO: Found listing with ID: UY14262
2026-03-30 11:13:49 [auto1.es] INFO: Found listing with ID: AC42816
2026-03-30 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AC42816%27 HTTP/1.1" 200 None
2026-03-30 11:13:49 [auto1.es] INFO: Scrape type for AC42816: 2
2026-03-30 11:13:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ceb9e9c-08a4-5032-b30b-e47f8ca102b7 with identifier: AC42816
2026-03-30 11:13:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ceb9e9c-08a4-5032-b30b-e47f8ca102b7 with scrape type 2
2026-03-30 11:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ceb9e9c-08a4-5032-b30b-e47f8ca102b7 with scrape type 2
2026-03-30 11:13:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0ceb9e9c-08a4-5032-b30b-e47f8ca102b7, identifier: AC42816
2026-03-30 11:13:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0ceb9e9c-08a4-5032-b30b-e47f8ca102b7 with identifier: AC42816
2026-03-30 11:13:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0ceb9e9c-08a4-5032-b30b-e47f8ca102b7 with identifier: AC42816
2026-03-30 11:13:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0ceb9e9c-08a4-5032-b30b-e47f8ca102b7 with identifier: AC42816 to the API
2026-03-30 11:13:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 106,
'expiration_date': '2026-03-31T15:53:42Z',
'fuel_type': 'petrol',
'id': '0ceb9e9c-08a4-5032-b30b-e47f8ca102b7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC42816',
'listing': 'auction',
'make': 'MG',
'model': 'ZS',
'odometer': 29590,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-05',
'seller_name': None,
'title': 'MG ZS 1.5 VTi Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2023}
2026-03-30 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AC42816%27 HTTP/1.1" 200 None
2026-03-30 11:13:50 [auto1.es] INFO: Saving data for AC42816: {'auction_closing_time': 1774972422.0, 'created_time': 1773671198.795522, 'last_price_update_time': 1774869230.140293}
2026-03-30 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AC42816') HTTP/1.1" 204 0
2026-03-30 11:13:50 [auto1.es] INFO: Found listing with ID: LA52472
2026-03-30 11:13:50 [auto1.es] INFO: Found listing with ID: JN94907
2026-03-30 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JN94907%27 HTTP/1.1" 200 None
2026-03-30 11:13:50 [auto1.es] INFO: Scrape type for JN94907: 1
2026-03-30 11:13:50 [auto1.es] INFO: Found listing with ID: YP32131
2026-03-30 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YP32131%27 HTTP/1.1" 200 None
2026-03-30 11:13:50 [auto1.es] INFO: Scrape type for YP32131: 1
2026-03-30 11:13:50 [auto1.es] INFO: Found listing with ID: UR30668
2026-03-30 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UR30668%27 HTTP/1.1" 200 None
2026-03-30 11:13:50 [auto1.es] INFO: Scrape type for UR30668: 1
2026-03-30 11:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SU99027> (referer: https://www.auto1.com/v1/car-details-view/SU99027/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b93373a-5b09-58f6-9ec4-37bc0d7ab3ad with identifier: SU99027
2026-03-30 11:13:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b93373a-5b09-58f6-9ec4-37bc0d7ab3ad with scrape type 1
2026-03-30 11:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 4b93373a-5b09-58f6-9ec4-37bc0d7ab3ad
2026-03-30 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F9c%252F919c4686164a7cd9b300857b09792661%252Fpa%252FSU99027_7c8cce8948e3b610c1774d6c405add02.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/9c/919c4686164a7cd9b300857b09792661/pa/SU99027_7c8cce8948e3b610c1774d6c405add02.jpg already downloaded
2026-03-30 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F9c%252F919c4686164a7cd9b300857b09792661%252Fpa%252FSU99027_989cd0369de1bb5df8ce1993774d7b23.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/9c/919c4686164a7cd9b300857b09792661/pa/SU99027_989cd0369de1bb5df8ce1993774d7b23.jpg already downloaded
2026-03-30 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F9c%252F919c4686164a7cd9b300857b09792661%252Fpa%252FSU99027_24fd28e3b2c2020f58ca8b4936098f80.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/9c/919c4686164a7cd9b300857b09792661/pa/SU99027_24fd28e3b2c2020f58ca8b4936098f80.jpg already downloaded
2026-03-30 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F9c%252F919c4686164a7cd9b300857b09792661%252Fpa%252FSU99027_78b07427000d75351bb82302af484d1d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/9c/919c4686164a7cd9b300857b09792661/pa/SU99027_78b07427000d75351bb82302af484d1d.jpg already downloaded
2026-03-30 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F9c%252F919c4686164a7cd9b300857b09792661%252Fpa%252FSU99027_5b0cdc1443125c649c73a8fddd03c427.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/9c/919c4686164a7cd9b300857b09792661/pa/SU99027_5b0cdc1443125c649c73a8fddd03c427.jpg already downloaded
2026-03-30 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F9c%252F919c4686164a7cd9b300857b09792661%252Fpa%252FSU99027_18c2de6140ec5fa16c96fc4c2289f578.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/9c/919c4686164a7cd9b300857b09792661/pa/SU99027_18c2de6140ec5fa16c96fc4c2289f578.jpg already downloaded
2026-03-30 11:13:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4b93373a-5b09-58f6-9ec4-37bc0d7ab3ad, identifier: SU99027
2026-03-30 11:13:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4b93373a-5b09-58f6-9ec4-37bc0d7ab3ad with identifier: SU99027
2026-03-30 11:13:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4b93373a-5b09-58f6-9ec4-37bc0d7ab3ad with identifier: SU99027
2026-03-30 11:13:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4b93373a-5b09-58f6-9ec4-37bc0d7ab3ad with identifier: SU99027 to the API
2026-03-30 11:13:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SU99027>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.4L',
'engine_horse_power': 73,
'expiration_date': '2026-03-31T15:13:33Z',
'fuel_type': 'petrol',
'id': '4b93373a-5b09-58f6-9ec4-37bc0d7ab3ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU99027',
'listing': 'auction',
'location': 'ES, Barcelona',
'make': 'Citroen',
'model': 'C3',
'odometer': 130173,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img91/9c/919c4686164a7cd9b300857b09792661/pa/SU99027_7c8cce8948e3b610c1774d6c405add02.jpg',
'https://img-pa.auto1.com/img91/9c/919c4686164a7cd9b300857b09792661/pa/SU99027_989cd0369de1bb5df8ce1993774d7b23.jpg',
'https://img-pa.auto1.com/img91/9c/919c4686164a7cd9b300857b09792661/pa/SU99027_24fd28e3b2c2020f58ca8b4936098f80.jpg',
'https://img-pa.auto1.com/img91/9c/919c4686164a7cd9b300857b09792661/pa/SU99027_78b07427000d75351bb82302af484d1d.jpg',
'https://img-pa.auto1.com/img91/9c/919c4686164a7cd9b300857b09792661/pa/SU99027_5b0cdc1443125c649c73a8fddd03c427.jpg',
'https://img-pa.auto1.com/img91/9c/919c4686164a7cd9b300857b09792661/pa/SU99027_18c2de6140ec5fa16c96fc4c2289f578.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b93373a-5b09-58f6-9ec4-37bc0d7ab3ad/4b93373a-5b09-58f6-9ec4-37bc0d7ab3ad_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115175,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/9c/919c4686164a7cd9b300857b09792661/pa/SU99027_7c8cce8948e3b610c1774d6c405add02.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b93373a-5b09-58f6-9ec4-37bc0d7ab3ad/4b93373a-5b09-58f6-9ec4-37bc0d7ab3ad_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107597,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/9c/919c4686164a7cd9b300857b09792661/pa/SU99027_989cd0369de1bb5df8ce1993774d7b23.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b93373a-5b09-58f6-9ec4-37bc0d7ab3ad/4b93373a-5b09-58f6-9ec4-37bc0d7ab3ad_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83877,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/9c/919c4686164a7cd9b300857b09792661/pa/SU99027_24fd28e3b2c2020f58ca8b4936098f80.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b93373a-5b09-58f6-9ec4-37bc0d7ab3ad/4b93373a-5b09-58f6-9ec4-37bc0d7ab3ad_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52294,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/9c/919c4686164a7cd9b300857b09792661/pa/SU99027_78b07427000d75351bb82302af484d1d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b93373a-5b09-58f6-9ec4-37bc0d7ab3ad/4b93373a-5b09-58f6-9ec4-37bc0d7ab3ad_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69265,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/9c/919c4686164a7cd9b300857b09792661/pa/SU99027_5b0cdc1443125c649c73a8fddd03c427.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b93373a-5b09-58f6-9ec4-37bc0d7ab3ad/4b93373a-5b09-58f6-9ec4-37bc0d7ab3ad_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85385,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/9c/919c4686164a7cd9b300857b09792661/pa/SU99027_18c2de6140ec5fa16c96fc4c2289f578.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2006-02-28',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.4 SX Plus',
'transmission': 'manual',
'trim': 'SX Plus',
'year': 2006}
2026-03-30 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SU99027%27 HTTP/1.1" 200 None
2026-03-30 11:13:51 [auto1.es] INFO: Saving data for SU99027: {'created_time': 1774869231.858814, 'last_price_update_time': 1774869231.858834, 'auction_closing_time': 1774970013.0}
2026-03-30 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SU99027') HTTP/1.1" 204 0
2026-03-30 11:13:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DF86538> (referer: https://www.auto1.com/v1/car-details-view/DF86538/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0578f389-64ff-5a7b-a920-19e1b2adf204 with identifier: DF86538
2026-03-30 11:13:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0578f389-64ff-5a7b-a920-19e1b2adf204 with scrape type 1
2026-03-30 11:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 0578f389-64ff-5a7b-a920-19e1b2adf204
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa7%252Fdfa71cc8b90dcf79d39e30c96af0369b%252Fpa%252FDF86538_38702e90f4543272e1f9f9c9ed9e2dc8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a7/dfa71cc8b90dcf79d39e30c96af0369b/pa/DF86538_38702e90f4543272e1f9f9c9ed9e2dc8.jpg not downloaded yet
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa7%252Fdfa71cc8b90dcf79d39e30c96af0369b%252Fpa%252FDF86538_bbaa8d92de85c7b61d87aa0f1c4ce88b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a7/dfa71cc8b90dcf79d39e30c96af0369b/pa/DF86538_bbaa8d92de85c7b61d87aa0f1c4ce88b.jpg not downloaded yet
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa7%252Fdfa71cc8b90dcf79d39e30c96af0369b%252Fpa%252FDF86538_e65adb28f0a499a0ba03f8e9f1a88ede.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a7/dfa71cc8b90dcf79d39e30c96af0369b/pa/DF86538_e65adb28f0a499a0ba03f8e9f1a88ede.jpg not downloaded yet
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa7%252Fdfa71cc8b90dcf79d39e30c96af0369b%252Fpa%252FDF86538_0ec91b99cd786627028958123f461dc5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a7/dfa71cc8b90dcf79d39e30c96af0369b/pa/DF86538_0ec91b99cd786627028958123f461dc5.jpg not downloaded yet
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa7%252Fdfa71cc8b90dcf79d39e30c96af0369b%252Fpa%252FDF86538_1387c64e113463cceb4e3a62d25ef40e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a7/dfa71cc8b90dcf79d39e30c96af0369b/pa/DF86538_1387c64e113463cceb4e3a62d25ef40e.jpg not downloaded yet
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa7%252Fdfa71cc8b90dcf79d39e30c96af0369b%252Fpa%252FDF86538_37e01dc878fa7b37032ffe8f499108de.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a7/dfa71cc8b90dcf79d39e30c96af0369b/pa/DF86538_37e01dc878fa7b37032ffe8f499108de.jpg not downloaded yet
2026-03-30 11:14:04 [scrapy.extensions.logstats] INFO: Crawled 19 pages (at 6 pages/min), scraped 13 items (at 9 items/min)
2026-03-30 11:14:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 154MiB
2026-03-30 11:14:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PH25180> (referer: https://www.auto1.com/v1/car-details-view/PH25180/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 593e162f-db56-522f-88fb-1a65187dbbf3 with identifier: PH25180
2026-03-30 11:14:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 593e162f-db56-522f-88fb-1a65187dbbf3 with scrape type 1
2026-03-30 11:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 593e162f-db56-522f-88fb-1a65187dbbf3
2026-03-30 11:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F68%252F73682bf325dd075d61652c808302d3bc%252Fpa%252FPH25180_cf41c1ec8130c45829bfcb5887a29fa5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/68/73682bf325dd075d61652c808302d3bc/pa/PH25180_cf41c1ec8130c45829bfcb5887a29fa5.jpg not downloaded yet
2026-03-30 11:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F68%252F73682bf325dd075d61652c808302d3bc%252Fpa%252FPH25180_efea102e2aae392f1679fb225e382982.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/68/73682bf325dd075d61652c808302d3bc/pa/PH25180_efea102e2aae392f1679fb225e382982.jpg already downloaded
2026-03-30 11:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F68%252F73682bf325dd075d61652c808302d3bc%252Fpa%252FPH25180_c81d5fbf886b950b3f55a32011803474.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/68/73682bf325dd075d61652c808302d3bc/pa/PH25180_c81d5fbf886b950b3f55a32011803474.jpg not downloaded yet
2026-03-30 11:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F68%252F73682bf325dd075d61652c808302d3bc%252Fpa%252FPH25180_6e7f20aefad773fad9d8d0519793acdc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/68/73682bf325dd075d61652c808302d3bc/pa/PH25180_6e7f20aefad773fad9d8d0519793acdc.jpg already downloaded
2026-03-30 11:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F68%252F73682bf325dd075d61652c808302d3bc%252Fpa%252FPH25180_276a499c3182232361c7c0ed217183a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/68/73682bf325dd075d61652c808302d3bc/pa/PH25180_276a499c3182232361c7c0ed217183a1.jpg not downloaded yet
2026-03-30 11:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F68%252F73682bf325dd075d61652c808302d3bc%252Fpa%252FPH25180_3655e733ea31ec7d4506befc69714007.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/68/73682bf325dd075d61652c808302d3bc/pa/PH25180_3655e733ea31ec7d4506befc69714007.jpg not downloaded yet
2026-03-30 11:14:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/a7/dfa71cc8b90dcf79d39e30c96af0369b/pa/DF86538_37e01dc878fa7b37032ffe8f499108de.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/68/73682bf325dd075d61652c808302d3bc/pa/PH25180_3655e733ea31ec7d4506befc69714007.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-30 11:14:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-30 11:14:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ae73310>
2026-03-30 11:14:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 11:14:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2114
2026-03-30 11:14:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-30 11:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0578f389-64ff-5a7b-a920-19e1b2adf204/0578f389-64ff-5a7b-a920-19e1b2adf204_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa7%252Fdfa71cc8b90dcf79d39e30c96af0369b%252Fpa%252FDF86538_37e01dc878fa7b37032ffe8f499108de.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a7/dfa71cc8b90dcf79d39e30c96af0369b/pa/DF86538_37e01dc878fa7b37032ffe8f499108de.jpg saved to cache
2026-03-30 11:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0578f389-64ff-5a7b-a920-19e1b2adf204
2026-03-30 11:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/68/73682bf325dd075d61652c808302d3bc/pa/PH25180_276a499c3182232361c7c0ed217183a1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a42eb90>
2026-03-30 11:14:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593e162f-db56-522f-88fb-1a65187dbbf3/593e162f-db56-522f-88fb-1a65187dbbf3_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F68%252F73682bf325dd075d61652c808302d3bc%252Fpa%252FPH25180_3655e733ea31ec7d4506befc69714007.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/68/73682bf325dd075d61652c808302d3bc/pa/PH25180_3655e733ea31ec7d4506befc69714007.jpg saved to cache
2026-03-30 11:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 593e162f-db56-522f-88fb-1a65187dbbf3
2026-03-30 11:14:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad79f50>
2026-03-30 11:14:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593e162f-db56-522f-88fb-1a65187dbbf3/593e162f-db56-522f-88fb-1a65187dbbf3_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F68%252F73682bf325dd075d61652c808302d3bc%252Fpa%252FPH25180_276a499c3182232361c7c0ed217183a1.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/68/73682bf325dd075d61652c808302d3bc/pa/PH25180_276a499c3182232361c7c0ed217183a1.jpg saved to cache
2026-03-30 11:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 593e162f-db56-522f-88fb-1a65187dbbf3
2026-03-30 11:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/68/73682bf325dd075d61652c808302d3bc/pa/PH25180_c81d5fbf886b950b3f55a32011803474.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/68/73682bf325dd075d61652c808302d3bc/pa/PH25180_cf41c1ec8130c45829bfcb5887a29fa5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4248d0>
2026-03-30 11:14:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593e162f-db56-522f-88fb-1a65187dbbf3/593e162f-db56-522f-88fb-1a65187dbbf3_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F68%252F73682bf325dd075d61652c808302d3bc%252Fpa%252FPH25180_c81d5fbf886b950b3f55a32011803474.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/68/73682bf325dd075d61652c808302d3bc/pa/PH25180_c81d5fbf886b950b3f55a32011803474.jpg saved to cache
2026-03-30 11:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 593e162f-db56-522f-88fb-1a65187dbbf3
2026-03-30 11:14:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05adb4190>
2026-03-30 11:14:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593e162f-db56-522f-88fb-1a65187dbbf3/593e162f-db56-522f-88fb-1a65187dbbf3_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F68%252F73682bf325dd075d61652c808302d3bc%252Fpa%252FPH25180_cf41c1ec8130c45829bfcb5887a29fa5.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/68/73682bf325dd075d61652c808302d3bc/pa/PH25180_cf41c1ec8130c45829bfcb5887a29fa5.jpg saved to cache
2026-03-30 11:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 593e162f-db56-522f-88fb-1a65187dbbf3
2026-03-30 11:14:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 593e162f-db56-522f-88fb-1a65187dbbf3, skipping ID generation
2026-03-30 11:14:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 593e162f-db56-522f-88fb-1a65187dbbf3 with scrape type 1
2026-03-30 11:14:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 593e162f-db56-522f-88fb-1a65187dbbf3 sending to next pipeline
2026-03-30 11:14:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 593e162f-db56-522f-88fb-1a65187dbbf3, identifier: PH25180
2026-03-30 11:14:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 593e162f-db56-522f-88fb-1a65187dbbf3 with identifier: PH25180
2026-03-30 11:14:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 593e162f-db56-522f-88fb-1a65187dbbf3 with identifier: PH25180
2026-03-30 11:14:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 593e162f-db56-522f-88fb-1a65187dbbf3 with identifier: PH25180 to the API
2026-03-30 11:14:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img73/68/73682bf325dd075d61652c808302d3bc/pa/PH25180_cf41c1ec8130c45829bfcb5887a29fa5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 95,
'expiration_date': '2026-03-31T15:30:16Z',
'fuel_type': 'diesel',
'id': '593e162f-db56-522f-88fb-1a65187dbbf3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH25180',
'listing': 'auction',
'location': 'ES, Madrid',
'make': 'Chevrolet',
'model': 'Aveo',
'odometer': 125964,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593e162f-db56-522f-88fb-1a65187dbbf3/593e162f-db56-522f-88fb-1a65187dbbf3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89128,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/68/73682bf325dd075d61652c808302d3bc/pa/PH25180_cf41c1ec8130c45829bfcb5887a29fa5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593e162f-db56-522f-88fb-1a65187dbbf3/593e162f-db56-522f-88fb-1a65187dbbf3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103302,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/68/73682bf325dd075d61652c808302d3bc/pa/PH25180_efea102e2aae392f1679fb225e382982.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593e162f-db56-522f-88fb-1a65187dbbf3/593e162f-db56-522f-88fb-1a65187dbbf3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84936,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/68/73682bf325dd075d61652c808302d3bc/pa/PH25180_c81d5fbf886b950b3f55a32011803474.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593e162f-db56-522f-88fb-1a65187dbbf3/593e162f-db56-522f-88fb-1a65187dbbf3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92195,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/68/73682bf325dd075d61652c808302d3bc/pa/PH25180_6e7f20aefad773fad9d8d0519793acdc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593e162f-db56-522f-88fb-1a65187dbbf3/593e162f-db56-522f-88fb-1a65187dbbf3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67351,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/68/73682bf325dd075d61652c808302d3bc/pa/PH25180_276a499c3182232361c7c0ed217183a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593e162f-db56-522f-88fb-1a65187dbbf3/593e162f-db56-522f-88fb-1a65187dbbf3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86018,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/68/73682bf325dd075d61652c808302d3bc/pa/PH25180_3655e733ea31ec7d4506befc69714007.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-09-27',
'seats_number': 5,
'seller_name': None,
'title': 'Chevrolet Aveo 1.3 Diesel LT+',
'transmission': 'manual',
'trim': 'LT+',
'year': 2012}
2026-03-30 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PH25180%27 HTTP/1.1" 200 None
2026-03-30 11:14:06 [auto1.es] INFO: Saving data for PH25180: {'created_time': 1774869246.959667, 'last_price_update_time': 1774869246.959679, 'auction_closing_time': 1774971016.0}
2026-03-30 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PH25180') HTTP/1.1" 204 0
2026-03-30 11:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/a7/dfa71cc8b90dcf79d39e30c96af0369b/pa/DF86538_1387c64e113463cceb4e3a62d25ef40e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a43a850>
2026-03-30 11:14:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0578f389-64ff-5a7b-a920-19e1b2adf204/0578f389-64ff-5a7b-a920-19e1b2adf204_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa7%252Fdfa71cc8b90dcf79d39e30c96af0369b%252Fpa%252FDF86538_1387c64e113463cceb4e3a62d25ef40e.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a7/dfa71cc8b90dcf79d39e30c96af0369b/pa/DF86538_1387c64e113463cceb4e3a62d25ef40e.jpg saved to cache
2026-03-30 11:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0578f389-64ff-5a7b-a920-19e1b2adf204
2026-03-30 11:14:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/a7/dfa71cc8b90dcf79d39e30c96af0369b/pa/DF86538_0ec91b99cd786627028958123f461dc5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a42ee90>
2026-03-30 11:14:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0578f389-64ff-5a7b-a920-19e1b2adf204/0578f389-64ff-5a7b-a920-19e1b2adf204_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa7%252Fdfa71cc8b90dcf79d39e30c96af0369b%252Fpa%252FDF86538_0ec91b99cd786627028958123f461dc5.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a7/dfa71cc8b90dcf79d39e30c96af0369b/pa/DF86538_0ec91b99cd786627028958123f461dc5.jpg saved to cache
2026-03-30 11:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0578f389-64ff-5a7b-a920-19e1b2adf204
2026-03-30 11:14:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/a7/dfa71cc8b90dcf79d39e30c96af0369b/pa/DF86538_e65adb28f0a499a0ba03f8e9f1a88ede.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05aee0450>
2026-03-30 11:14:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0578f389-64ff-5a7b-a920-19e1b2adf204/0578f389-64ff-5a7b-a920-19e1b2adf204_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa7%252Fdfa71cc8b90dcf79d39e30c96af0369b%252Fpa%252FDF86538_e65adb28f0a499a0ba03f8e9f1a88ede.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a7/dfa71cc8b90dcf79d39e30c96af0369b/pa/DF86538_e65adb28f0a499a0ba03f8e9f1a88ede.jpg saved to cache
2026-03-30 11:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0578f389-64ff-5a7b-a920-19e1b2adf204
2026-03-30 11:14:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/a7/dfa71cc8b90dcf79d39e30c96af0369b/pa/DF86538_bbaa8d92de85c7b61d87aa0f1c4ce88b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/a7/dfa71cc8b90dcf79d39e30c96af0369b/pa/DF86538_38702e90f4543272e1f9f9c9ed9e2dc8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060feb210>
2026-03-30 11:14:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0578f389-64ff-5a7b-a920-19e1b2adf204/0578f389-64ff-5a7b-a920-19e1b2adf204_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa7%252Fdfa71cc8b90dcf79d39e30c96af0369b%252Fpa%252FDF86538_bbaa8d92de85c7b61d87aa0f1c4ce88b.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a7/dfa71cc8b90dcf79d39e30c96af0369b/pa/DF86538_bbaa8d92de85c7b61d87aa0f1c4ce88b.jpg saved to cache
2026-03-30 11:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0578f389-64ff-5a7b-a920-19e1b2adf204
2026-03-30 11:14:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad2e950>
2026-03-30 11:14:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0578f389-64ff-5a7b-a920-19e1b2adf204/0578f389-64ff-5a7b-a920-19e1b2adf204_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa7%252Fdfa71cc8b90dcf79d39e30c96af0369b%252Fpa%252FDF86538_38702e90f4543272e1f9f9c9ed9e2dc8.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a7/dfa71cc8b90dcf79d39e30c96af0369b/pa/DF86538_38702e90f4543272e1f9f9c9ed9e2dc8.jpg saved to cache
2026-03-30 11:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0578f389-64ff-5a7b-a920-19e1b2adf204
2026-03-30 11:14:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0578f389-64ff-5a7b-a920-19e1b2adf204, skipping ID generation
2026-03-30 11:14:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0578f389-64ff-5a7b-a920-19e1b2adf204 with scrape type 1
2026-03-30 11:14:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0578f389-64ff-5a7b-a920-19e1b2adf204 sending to next pipeline
2026-03-30 11:14:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0578f389-64ff-5a7b-a920-19e1b2adf204, identifier: DF86538
2026-03-30 11:14:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0578f389-64ff-5a7b-a920-19e1b2adf204 with identifier: DF86538
2026-03-30 11:14:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0578f389-64ff-5a7b-a920-19e1b2adf204 with identifier: DF86538
2026-03-30 11:14:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0578f389-64ff-5a7b-a920-19e1b2adf204 with identifier: DF86538 to the API
2026-03-30 11:14:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdf/a7/dfa71cc8b90dcf79d39e30c96af0369b/pa/DF86538_38702e90f4543272e1f9f9c9ed9e2dc8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 4',
'engine': '2.4L',
'engine_horse_power': 163,
'expiration_date': '2026-03-31T15:43:21Z',
'fuel_type': 'diesel',
'id': '0578f389-64ff-5a7b-a920-19e1b2adf204',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF86538',
'listing': 'auction',
'location': 'ES, Dos Hermanas',
'make': 'Volvo',
'model': 'S60',
'odometer': 251070,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0578f389-64ff-5a7b-a920-19e1b2adf204/0578f389-64ff-5a7b-a920-19e1b2adf204_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98630,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/a7/dfa71cc8b90dcf79d39e30c96af0369b/pa/DF86538_38702e90f4543272e1f9f9c9ed9e2dc8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0578f389-64ff-5a7b-a920-19e1b2adf204/0578f389-64ff-5a7b-a920-19e1b2adf204_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104594,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/a7/dfa71cc8b90dcf79d39e30c96af0369b/pa/DF86538_bbaa8d92de85c7b61d87aa0f1c4ce88b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0578f389-64ff-5a7b-a920-19e1b2adf204/0578f389-64ff-5a7b-a920-19e1b2adf204_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78755,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/a7/dfa71cc8b90dcf79d39e30c96af0369b/pa/DF86538_e65adb28f0a499a0ba03f8e9f1a88ede.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0578f389-64ff-5a7b-a920-19e1b2adf204/0578f389-64ff-5a7b-a920-19e1b2adf204_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57068,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/a7/dfa71cc8b90dcf79d39e30c96af0369b/pa/DF86538_0ec91b99cd786627028958123f461dc5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0578f389-64ff-5a7b-a920-19e1b2adf204/0578f389-64ff-5a7b-a920-19e1b2adf204_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47718,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/a7/dfa71cc8b90dcf79d39e30c96af0369b/pa/DF86538_1387c64e113463cceb4e3a62d25ef40e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0578f389-64ff-5a7b-a920-19e1b2adf204/0578f389-64ff-5a7b-a920-19e1b2adf204_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71783,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/a7/dfa71cc8b90dcf79d39e30c96af0369b/pa/DF86538_37e01dc878fa7b37032ffe8f499108de.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2006-10-31',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo S60 2.4 D Momentum',
'transmission': 'manual',
'trim': 'Momentum',
'year': 2006}
2026-03-30 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DF86538%27 HTTP/1.1" 200 None
2026-03-30 11:14:08 [auto1.es] INFO: Saving data for DF86538: {'created_time': 1774869248.276724, 'last_price_update_time': 1774869248.276736, 'auction_closing_time': 1774971801.0}
2026-03-30 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DF86538') HTTP/1.1" 204 0
2026-03-30 11:14:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PG13200> (referer: https://www.auto1.com/v1/car-details-view/PG13200/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: daf029ac-de9f-5917-8b7a-24799eb34468 with identifier: PG13200
2026-03-30 11:14:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daf029ac-de9f-5917-8b7a-24799eb34468 with scrape type 1
2026-03-30 11:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item daf029ac-de9f-5917-8b7a-24799eb34468
2026-03-30 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fb2%252F05b2a606e13f515f471518f9d193fa12%252Fpa%252FPG13200_9c5fb78dd0115a0dfeae33f3c995950f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/b2/05b2a606e13f515f471518f9d193fa12/pa/PG13200_9c5fb78dd0115a0dfeae33f3c995950f.jpg not downloaded yet
2026-03-30 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fb2%252F05b2a606e13f515f471518f9d193fa12%252Fpa%252FPG13200_3ccb2bf27e994a4d60ed9b1d38f4d1e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/b2/05b2a606e13f515f471518f9d193fa12/pa/PG13200_3ccb2bf27e994a4d60ed9b1d38f4d1e1.jpg not downloaded yet
2026-03-30 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fb2%252F05b2a606e13f515f471518f9d193fa12%252Fpa%252FPG13200_df5917eaa744318a827b9765208ac447.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/b2/05b2a606e13f515f471518f9d193fa12/pa/PG13200_df5917eaa744318a827b9765208ac447.jpg not downloaded yet
2026-03-30 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fb2%252F05b2a606e13f515f471518f9d193fa12%252Fpa%252FPG13200_1c4d36bc9fb9bf9967fe30a21eac561d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/b2/05b2a606e13f515f471518f9d193fa12/pa/PG13200_1c4d36bc9fb9bf9967fe30a21eac561d.jpg not downloaded yet
2026-03-30 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fb2%252F05b2a606e13f515f471518f9d193fa12%252Fpa%252FPG13200_8ae2b79d8eade00acbc136d20c27e270.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/b2/05b2a606e13f515f471518f9d193fa12/pa/PG13200_8ae2b79d8eade00acbc136d20c27e270.jpg not downloaded yet
2026-03-30 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fb2%252F05b2a606e13f515f471518f9d193fa12%252Fpa%252FPG13200_96b3243373905be7a3639eecbcfd631e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/b2/05b2a606e13f515f471518f9d193fa12/pa/PG13200_96b3243373905be7a3639eecbcfd631e.jpg not downloaded yet
2026-03-30 11:14:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UR19507> (referer: https://www.auto1.com/v1/car-details-view/UR19507/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/b2/05b2a606e13f515f471518f9d193fa12/pa/PG13200_96b3243373905be7a3639eecbcfd631e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/b2/05b2a606e13f515f471518f9d193fa12/pa/PG13200_8ae2b79d8eade00acbc136d20c27e270.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97369704-643b-5108-ba5c-61e5bb28e925 with identifier: UR19507
2026-03-30 11:14:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97369704-643b-5108-ba5c-61e5bb28e925 with scrape type 1
2026-03-30 11:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 97369704-643b-5108-ba5c-61e5bb28e925
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb1%252Fdcb138ada53b6b5184f002feb7291a37%252Fpa%252FUR19507_1374bf3b10cfc72b77e796145ad3e5d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b1/dcb138ada53b6b5184f002feb7291a37/pa/UR19507_1374bf3b10cfc72b77e796145ad3e5d8.jpg already downloaded
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb1%252Fdcb138ada53b6b5184f002feb7291a37%252Fpa%252FUR19507_103188026b13207d8067eb783a1675ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b1/dcb138ada53b6b5184f002feb7291a37/pa/UR19507_103188026b13207d8067eb783a1675ae.jpg already downloaded
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb1%252Fdcb138ada53b6b5184f002feb7291a37%252Fpa%252FUR19507_3412aaf34ff3cce76f97074079b40a18.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b1/dcb138ada53b6b5184f002feb7291a37/pa/UR19507_3412aaf34ff3cce76f97074079b40a18.jpg already downloaded
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb1%252Fdcb138ada53b6b5184f002feb7291a37%252Fpa%252FUR19507_67e12e6505913d6c38ef11b72c730390.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b1/dcb138ada53b6b5184f002feb7291a37/pa/UR19507_67e12e6505913d6c38ef11b72c730390.jpg already downloaded
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb1%252Fdcb138ada53b6b5184f002feb7291a37%252Fpa%252FUR19507_48b1b81c74db1d875ec8b9e6b4fd170d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b1/dcb138ada53b6b5184f002feb7291a37/pa/UR19507_48b1b81c74db1d875ec8b9e6b4fd170d.jpg already downloaded
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb1%252Fdcb138ada53b6b5184f002feb7291a37%252Fpa%252FUR19507_c248368840f49c577c5c9a2c262ec9c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b1/dcb138ada53b6b5184f002feb7291a37/pa/UR19507_c248368840f49c577c5c9a2c262ec9c0.jpg already downloaded
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb1%252Fdcb138ada53b6b5184f002feb7291a37%252Fpa%252FUR19507_abf44c21bbd6dcf0364e640b766bab47.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b1/dcb138ada53b6b5184f002feb7291a37/pa/UR19507_abf44c21bbd6dcf0364e640b766bab47.jpg already downloaded
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb1%252Fdcb138ada53b6b5184f002feb7291a37%252Fpa%252FUR19507_ad3f20a861626cc011159c00d8ccc110.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b1/dcb138ada53b6b5184f002feb7291a37/pa/UR19507_ad3f20a861626cc011159c00d8ccc110.jpg already downloaded
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb1%252Fdcb138ada53b6b5184f002feb7291a37%252Fpa%252FUR19507_979f53bd6f836f90590b735a639800e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b1/dcb138ada53b6b5184f002feb7291a37/pa/UR19507_979f53bd6f836f90590b735a639800e7.jpg already downloaded
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb1%252Fdcb138ada53b6b5184f002feb7291a37%252Fpa%252FUR19507_611e807864cf066752b36c03312a5510.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b1/dcb138ada53b6b5184f002feb7291a37/pa/UR19507_611e807864cf066752b36c03312a5510.jpg already downloaded
2026-03-30 11:14:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 97369704-643b-5108-ba5c-61e5bb28e925, identifier: UR19507
2026-03-30 11:14:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 97369704-643b-5108-ba5c-61e5bb28e925 with identifier: UR19507
2026-03-30 11:14:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 97369704-643b-5108-ba5c-61e5bb28e925 with identifier: UR19507
2026-03-30 11:14:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 97369704-643b-5108-ba5c-61e5bb28e925 with identifier: UR19507 to the API
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UR19507>
{'auction_title': '',
'c_o_2_emission_value': 249,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'engine_horse_power': 350,
'expiration_date': '2026-03-31T15:51:07Z',
'fuel_type': 'petrol',
'id': '97369704-643b-5108-ba5c-61e5bb28e925',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR19507',
'listing': 'auction',
'location': 'ES',
'make': 'Maserati',
'model': 'Levante',
'odometer': 87430,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 38,
'photo_urls': ['https://img-pa.auto1.com/imgdc/b1/dcb138ada53b6b5184f002feb7291a37/pa/UR19507_1374bf3b10cfc72b77e796145ad3e5d8.jpg',
'https://img-pa.auto1.com/imgdc/b1/dcb138ada53b6b5184f002feb7291a37/pa/UR19507_103188026b13207d8067eb783a1675ae.jpg',
'https://img-pa.auto1.com/imgdc/b1/dcb138ada53b6b5184f002feb7291a37/pa/UR19507_3412aaf34ff3cce76f97074079b40a18.jpg',
'https://img-pa.auto1.com/imgdc/b1/dcb138ada53b6b5184f002feb7291a37/pa/UR19507_67e12e6505913d6c38ef11b72c730390.jpg',
'https://img-pa.auto1.com/imgdc/b1/dcb138ada53b6b5184f002feb7291a37/pa/UR19507_48b1b81c74db1d875ec8b9e6b4fd170d.jpg',
'https://img-pa.auto1.com/imgdc/b1/dcb138ada53b6b5184f002feb7291a37/pa/UR19507_c248368840f49c577c5c9a2c262ec9c0.jpg',
'https://img-pa.auto1.com/imgdc/b1/dcb138ada53b6b5184f002feb7291a37/pa/UR19507_abf44c21bbd6dcf0364e640b766bab47.jpg',
'https://img-pa.auto1.com/imgdc/b1/dcb138ada53b6b5184f002feb7291a37/pa/UR19507_ad3f20a861626cc011159c00d8ccc110.jpg',
'https://img-pa.auto1.com/imgdc/b1/dcb138ada53b6b5184f002feb7291a37/pa/UR19507_979f53bd6f836f90590b735a639800e7.jpg',
'https://img-pa.auto1.com/imgdc/b1/dcb138ada53b6b5184f002feb7291a37/pa/UR19507_611e807864cf066752b36c03312a5510.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97369704-643b-5108-ba5c-61e5bb28e925/97369704-643b-5108-ba5c-61e5bb28e925_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46786,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/b1/dcb138ada53b6b5184f002feb7291a37/pa/UR19507_1374bf3b10cfc72b77e796145ad3e5d8.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97369704-643b-5108-ba5c-61e5bb28e925/97369704-643b-5108-ba5c-61e5bb28e925_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47420,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/b1/dcb138ada53b6b5184f002feb7291a37/pa/UR19507_103188026b13207d8067eb783a1675ae.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97369704-643b-5108-ba5c-61e5bb28e925/97369704-643b-5108-ba5c-61e5bb28e925_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42779,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/b1/dcb138ada53b6b5184f002feb7291a37/pa/UR19507_3412aaf34ff3cce76f97074079b40a18.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97369704-643b-5108-ba5c-61e5bb28e925/97369704-643b-5108-ba5c-61e5bb28e925_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42907,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/b1/dcb138ada53b6b5184f002feb7291a37/pa/UR19507_67e12e6505913d6c38ef11b72c730390.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97369704-643b-5108-ba5c-61e5bb28e925/97369704-643b-5108-ba5c-61e5bb28e925_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40636,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/b1/dcb138ada53b6b5184f002feb7291a37/pa/UR19507_48b1b81c74db1d875ec8b9e6b4fd170d.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97369704-643b-5108-ba5c-61e5bb28e925/97369704-643b-5108-ba5c-61e5bb28e925_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73271,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/b1/dcb138ada53b6b5184f002feb7291a37/pa/UR19507_c248368840f49c577c5c9a2c262ec9c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97369704-643b-5108-ba5c-61e5bb28e925/97369704-643b-5108-ba5c-61e5bb28e925_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32066,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/b1/dcb138ada53b6b5184f002feb7291a37/pa/UR19507_abf44c21bbd6dcf0364e640b766bab47.jpg',
'Width': 338},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97369704-643b-5108-ba5c-61e5bb28e925/97369704-643b-5108-ba5c-61e5bb28e925_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108846,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/b1/dcb138ada53b6b5184f002feb7291a37/pa/UR19507_ad3f20a861626cc011159c00d8ccc110.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97369704-643b-5108-ba5c-61e5bb28e925/97369704-643b-5108-ba5c-61e5bb28e925_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78446,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/b1/dcb138ada53b6b5184f002feb7291a37/pa/UR19507_979f53bd6f836f90590b735a639800e7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97369704-643b-5108-ba5c-61e5bb28e925/97369704-643b-5108-ba5c-61e5bb28e925_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80206,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/b1/dcb138ada53b6b5184f002feb7291a37/pa/UR19507_611e807864cf066752b36c03312a5510.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-03-27',
'seats_number': 5,
'seller_name': None,
'title': 'Maserati Levante 3.0 V6 TwinTurbo Gran Sport Q4',
'transmission': 'automatic',
'trim': 'Gran Sport Q4',
'year': 2018}
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UR19507%27 HTTP/1.1" 200 None
2026-03-30 11:14:21 [auto1.es] INFO: Saving data for UR19507: {'created_time': 1774869261.216926, 'last_price_update_time': 1774869261.21694, 'auction_closing_time': 1774972267.0}
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UR19507') HTTP/1.1" 204 0
2026-03-30 11:14:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/b2/05b2a606e13f515f471518f9d193fa12/pa/PG13200_1c4d36bc9fb9bf9967fe30a21eac561d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a42eed0>
2026-03-30 11:14:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daf029ac-de9f-5917-8b7a-24799eb34468/daf029ac-de9f-5917-8b7a-24799eb34468_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fb2%252F05b2a606e13f515f471518f9d193fa12%252Fpa%252FPG13200_96b3243373905be7a3639eecbcfd631e.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/b2/05b2a606e13f515f471518f9d193fa12/pa/PG13200_96b3243373905be7a3639eecbcfd631e.jpg saved to cache
2026-03-30 11:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item daf029ac-de9f-5917-8b7a-24799eb34468
2026-03-30 11:14:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ae7ead0>
2026-03-30 11:14:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daf029ac-de9f-5917-8b7a-24799eb34468/daf029ac-de9f-5917-8b7a-24799eb34468_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fb2%252F05b2a606e13f515f471518f9d193fa12%252Fpa%252FPG13200_8ae2b79d8eade00acbc136d20c27e270.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/b2/05b2a606e13f515f471518f9d193fa12/pa/PG13200_8ae2b79d8eade00acbc136d20c27e270.jpg saved to cache
2026-03-30 11:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item daf029ac-de9f-5917-8b7a-24799eb34468
2026-03-30 11:14:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/b2/05b2a606e13f515f471518f9d193fa12/pa/PG13200_df5917eaa744318a827b9765208ac447.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a462a50>
2026-03-30 11:14:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daf029ac-de9f-5917-8b7a-24799eb34468/daf029ac-de9f-5917-8b7a-24799eb34468_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fb2%252F05b2a606e13f515f471518f9d193fa12%252Fpa%252FPG13200_1c4d36bc9fb9bf9967fe30a21eac561d.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/b2/05b2a606e13f515f471518f9d193fa12/pa/PG13200_1c4d36bc9fb9bf9967fe30a21eac561d.jpg saved to cache
2026-03-30 11:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item daf029ac-de9f-5917-8b7a-24799eb34468
2026-03-30 11:14:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/b2/05b2a606e13f515f471518f9d193fa12/pa/PG13200_3ccb2bf27e994a4d60ed9b1d38f4d1e1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/b2/05b2a606e13f515f471518f9d193fa12/pa/PG13200_9c5fb78dd0115a0dfeae33f3c995950f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ae4a510>
2026-03-30 11:14:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daf029ac-de9f-5917-8b7a-24799eb34468/daf029ac-de9f-5917-8b7a-24799eb34468_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fb2%252F05b2a606e13f515f471518f9d193fa12%252Fpa%252FPG13200_df5917eaa744318a827b9765208ac447.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/b2/05b2a606e13f515f471518f9d193fa12/pa/PG13200_df5917eaa744318a827b9765208ac447.jpg saved to cache
2026-03-30 11:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item daf029ac-de9f-5917-8b7a-24799eb34468
2026-03-30 11:14:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a484910>
2026-03-30 11:14:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daf029ac-de9f-5917-8b7a-24799eb34468/daf029ac-de9f-5917-8b7a-24799eb34468_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fb2%252F05b2a606e13f515f471518f9d193fa12%252Fpa%252FPG13200_3ccb2bf27e994a4d60ed9b1d38f4d1e1.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/b2/05b2a606e13f515f471518f9d193fa12/pa/PG13200_3ccb2bf27e994a4d60ed9b1d38f4d1e1.jpg saved to cache
2026-03-30 11:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item daf029ac-de9f-5917-8b7a-24799eb34468
2026-03-30 11:14:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a424450>
2026-03-30 11:14:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daf029ac-de9f-5917-8b7a-24799eb34468/daf029ac-de9f-5917-8b7a-24799eb34468_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fb2%252F05b2a606e13f515f471518f9d193fa12%252Fpa%252FPG13200_9c5fb78dd0115a0dfeae33f3c995950f.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/b2/05b2a606e13f515f471518f9d193fa12/pa/PG13200_9c5fb78dd0115a0dfeae33f3c995950f.jpg saved to cache
2026-03-30 11:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item daf029ac-de9f-5917-8b7a-24799eb34468
2026-03-30 11:14:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: daf029ac-de9f-5917-8b7a-24799eb34468, skipping ID generation
2026-03-30 11:14:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daf029ac-de9f-5917-8b7a-24799eb34468 with scrape type 1
2026-03-30 11:14:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item daf029ac-de9f-5917-8b7a-24799eb34468 sending to next pipeline
2026-03-30 11:14:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: daf029ac-de9f-5917-8b7a-24799eb34468, identifier: PG13200
2026-03-30 11:14:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: daf029ac-de9f-5917-8b7a-24799eb34468 with identifier: PG13200
2026-03-30 11:14:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: daf029ac-de9f-5917-8b7a-24799eb34468 with identifier: PG13200
2026-03-30 11:14:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: daf029ac-de9f-5917-8b7a-24799eb34468 with identifier: PG13200 to the API
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img05/b2/05b2a606e13f515f471518f9d193fa12/pa/PG13200_9c5fb78dd0115a0dfeae33f3c995950f.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'engine_horse_power': 80,
'expiration_date': '2026-03-31T15:45:59Z',
'fuel_type': 'petrol',
'id': 'daf029ac-de9f-5917-8b7a-24799eb34468',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG13200',
'listing': 'auction',
'location': 'ES, Barcelona',
'make': 'Nissan',
'model': 'Micra',
'odometer': 168482,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daf029ac-de9f-5917-8b7a-24799eb34468/daf029ac-de9f-5917-8b7a-24799eb34468_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89787,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/b2/05b2a606e13f515f471518f9d193fa12/pa/PG13200_9c5fb78dd0115a0dfeae33f3c995950f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daf029ac-de9f-5917-8b7a-24799eb34468/daf029ac-de9f-5917-8b7a-24799eb34468_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82200,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/b2/05b2a606e13f515f471518f9d193fa12/pa/PG13200_3ccb2bf27e994a4d60ed9b1d38f4d1e1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daf029ac-de9f-5917-8b7a-24799eb34468/daf029ac-de9f-5917-8b7a-24799eb34468_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79165,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/b2/05b2a606e13f515f471518f9d193fa12/pa/PG13200_df5917eaa744318a827b9765208ac447.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daf029ac-de9f-5917-8b7a-24799eb34468/daf029ac-de9f-5917-8b7a-24799eb34468_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56515,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/b2/05b2a606e13f515f471518f9d193fa12/pa/PG13200_1c4d36bc9fb9bf9967fe30a21eac561d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daf029ac-de9f-5917-8b7a-24799eb34468/daf029ac-de9f-5917-8b7a-24799eb34468_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31797,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/b2/05b2a606e13f515f471518f9d193fa12/pa/PG13200_8ae2b79d8eade00acbc136d20c27e270.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daf029ac-de9f-5917-8b7a-24799eb34468/daf029ac-de9f-5917-8b7a-24799eb34468_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93851,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/b2/05b2a606e13f515f471518f9d193fa12/pa/PG13200_96b3243373905be7a3639eecbcfd631e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2006-05-04',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Micra 1.2 Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2006}
2026-03-30 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PG13200%27 HTTP/1.1" 200 None
2026-03-30 11:14:22 [auto1.es] INFO: Saving data for PG13200: {'created_time': 1774869262.102078, 'last_price_update_time': 1774869262.10209, 'auction_closing_time': 1774971959.0}
2026-03-30 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PG13200') HTTP/1.1" 204 0
2026-03-30 11:14:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JN78830> (referer: https://www.auto1.com/v1/car-details-view/JN78830/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e332835f-619a-5e9a-83c7-45291333b9b3 with identifier: JN78830
2026-03-30 11:14:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e332835f-619a-5e9a-83c7-45291333b9b3 with scrape type 1
2026-03-30 11:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e332835f-619a-5e9a-83c7-45291333b9b3
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fdc%252Fe3dc7e4000b28122a89f5d80ac453405%252Fpa%252FJN78830_24b3c319a583bacf97ded0323a92b546.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_24b3c319a583bacf97ded0323a92b546.jpg not downloaded yet
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fdc%252Fe3dc7e4000b28122a89f5d80ac453405%252Fpa%252FJN78830_64021c9c23f312ce8a9629696433b924.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_64021c9c23f312ce8a9629696433b924.jpg not downloaded yet
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fdc%252Fe3dc7e4000b28122a89f5d80ac453405%252Fpa%252FJN78830_0b5d6530d5d7abec76100ed7e26a1a9d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_0b5d6530d5d7abec76100ed7e26a1a9d.jpg not downloaded yet
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fdc%252Fe3dc7e4000b28122a89f5d80ac453405%252Fpa%252FJN78830_daab90110193ff0e988bfbb882c9b861.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_daab90110193ff0e988bfbb882c9b861.jpg not downloaded yet
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fdc%252Fe3dc7e4000b28122a89f5d80ac453405%252Fpa%252FJN78830_b98a1893e80e0281733461031c025494.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_b98a1893e80e0281733461031c025494.jpg not downloaded yet
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fdc%252Fe3dc7e4000b28122a89f5d80ac453405%252Fpa%252FJN78830_b1a6b9403ed517666526e5745e782b03.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_b1a6b9403ed517666526e5745e782b03.jpg not downloaded yet
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fdc%252Fe3dc7e4000b28122a89f5d80ac453405%252Fpa%252FJN78830_921375a418dc0e6cd66523608b21db7f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_921375a418dc0e6cd66523608b21db7f.jpg not downloaded yet
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fdc%252Fe3dc7e4000b28122a89f5d80ac453405%252Fpa%252FJN78830_c4e0ad4f088b87584366ad324ce64203.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_c4e0ad4f088b87584366ad324ce64203.jpg not downloaded yet
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fdc%252Fe3dc7e4000b28122a89f5d80ac453405%252Fpa%252FJN78830_68cc2ff42d572746aa384a33dd6b37c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_68cc2ff42d572746aa384a33dd6b37c5.jpg not downloaded yet
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fdc%252Fe3dc7e4000b28122a89f5d80ac453405%252Fpa%252FJN78830_77dc58d69fbdb678ea3a895aa5d724c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_77dc58d69fbdb678ea3a895aa5d724c1.jpg not downloaded yet
2026-03-30 11:14:46 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.208(s), this was the 1st time calling it.
2026-03-30 11:14:46 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.139833756030698 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:14:46 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.257(s), this was the 1st time calling it.
2026-03-30 11:14:46 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.246580532117745 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:14:46 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.174(s), this was the 1st time calling it.
2026-03-30 11:14:46 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.961267565606116 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:14:46 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.295(s), this was the 1st time calling it.
2026-03-30 11:14:46 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.279279620066362 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:14:48 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.283(s), this was the 1st time calling it.
2026-03-30 11:14:48 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.746180052376377 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:14:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:14:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:14:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:14:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:14:54 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.239(s), this was the 1st time calling it.
2026-03-30 11:14:54 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.141827351387519 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:14:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:15:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JU25572/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:15:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_77dc58d69fbdb678ea3a895aa5d724c1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_68cc2ff42d572746aa384a33dd6b37c5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:15:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:15:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ae7d310>
2026-03-30 11:15:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:15:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:15:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:15:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e332835f-619a-5e9a-83c7-45291333b9b3/e332835f-619a-5e9a-83c7-45291333b9b3_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fdc%252Fe3dc7e4000b28122a89f5d80ac453405%252Fpa%252FJN78830_77dc58d69fbdb678ea3a895aa5d724c1.jpg') HTTP/1.1" 204 0
2026-03-30 11:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_77dc58d69fbdb678ea3a895aa5d724c1.jpg saved to cache
2026-03-30 11:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e332835f-619a-5e9a-83c7-45291333b9b3
2026-03-30 11:15:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:15:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a424090>
2026-03-30 11:15:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:15:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:15:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:15:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e332835f-619a-5e9a-83c7-45291333b9b3/e332835f-619a-5e9a-83c7-45291333b9b3_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fdc%252Fe3dc7e4000b28122a89f5d80ac453405%252Fpa%252FJN78830_68cc2ff42d572746aa384a33dd6b37c5.jpg') HTTP/1.1" 204 0
2026-03-30 11:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_68cc2ff42d572746aa384a33dd6b37c5.jpg saved to cache
2026-03-30 11:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e332835f-619a-5e9a-83c7-45291333b9b3
2026-03-30 11:15:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NG43974/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:15:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:15:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_c4e0ad4f088b87584366ad324ce64203.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:15:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_921375a418dc0e6cd66523608b21db7f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:15:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:15:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a477590>
2026-03-30 11:15:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:15:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e332835f-619a-5e9a-83c7-45291333b9b3/e332835f-619a-5e9a-83c7-45291333b9b3_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fdc%252Fe3dc7e4000b28122a89f5d80ac453405%252Fpa%252FJN78830_c4e0ad4f088b87584366ad324ce64203.jpg') HTTP/1.1" 204 0
2026-03-30 11:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_c4e0ad4f088b87584366ad324ce64203.jpg saved to cache
2026-03-30 11:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e332835f-619a-5e9a-83c7-45291333b9b3
2026-03-30 11:15:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:15:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad4d910>
2026-03-30 11:15:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:15:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e332835f-619a-5e9a-83c7-45291333b9b3/e332835f-619a-5e9a-83c7-45291333b9b3_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fdc%252Fe3dc7e4000b28122a89f5d80ac453405%252Fpa%252FJN78830_921375a418dc0e6cd66523608b21db7f.jpg') HTTP/1.1" 204 0
2026-03-30 11:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_921375a418dc0e6cd66523608b21db7f.jpg saved to cache
2026-03-30 11:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e332835f-619a-5e9a-83c7-45291333b9b3
2026-03-30 11:15:04 [scrapy.extensions.logstats] INFO: Crawled 25 pages (at 6 pages/min), scraped 17 items (at 4 items/min)
2026-03-30 11:15:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 158MiB
2026-03-30 11:15:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UL16630/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:15:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:15:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_b1a6b9403ed517666526e5745e782b03.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:15:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_b98a1893e80e0281733461031c025494.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:15:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:15:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a467010>
2026-03-30 11:15:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:15:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:15:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:15:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e332835f-619a-5e9a-83c7-45291333b9b3/e332835f-619a-5e9a-83c7-45291333b9b3_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fdc%252Fe3dc7e4000b28122a89f5d80ac453405%252Fpa%252FJN78830_b1a6b9403ed517666526e5745e782b03.jpg') HTTP/1.1" 204 0
2026-03-30 11:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_b1a6b9403ed517666526e5745e782b03.jpg saved to cache
2026-03-30 11:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e332835f-619a-5e9a-83c7-45291333b9b3
2026-03-30 11:15:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:15:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ae7d4d0>
2026-03-30 11:15:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:15:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:15:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:15:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e332835f-619a-5e9a-83c7-45291333b9b3/e332835f-619a-5e9a-83c7-45291333b9b3_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fdc%252Fe3dc7e4000b28122a89f5d80ac453405%252Fpa%252FJN78830_b98a1893e80e0281733461031c025494.jpg') HTTP/1.1" 204 0
2026-03-30 11:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_b98a1893e80e0281733461031c025494.jpg saved to cache
2026-03-30 11:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e332835f-619a-5e9a-83c7-45291333b9b3
2026-03-30 11:15:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PR99923> (referer: https://www.auto1.com/v1/car-details-view/PR99923/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:15:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:15:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_daab90110193ff0e988bfbb882c9b861.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:15:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31c53c12-75d3-5d0d-a2e7-2cff68f54041 with identifier: PR99923
2026-03-30 11:15:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31c53c12-75d3-5d0d-a2e7-2cff68f54041 with scrape type 1
2026-03-30 11:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 31c53c12-75d3-5d0d-a2e7-2cff68f54041
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F52%252F7a52354823951716178821374008338f%252Fpa%252FPR99923_bbab50a8957854671ad780f921abfdeb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/52/7a52354823951716178821374008338f/pa/PR99923_bbab50a8957854671ad780f921abfdeb.jpg not downloaded yet
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F52%252F7a52354823951716178821374008338f%252Fpa%252FPR99923_b046028ca44845b1566b5beeba9e8411.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/52/7a52354823951716178821374008338f/pa/PR99923_b046028ca44845b1566b5beeba9e8411.jpg already downloaded
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F52%252F7a52354823951716178821374008338f%252Fpa%252FPR99923_249bfe4831f92b6c170fcf0cac47b853.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/52/7a52354823951716178821374008338f/pa/PR99923_249bfe4831f92b6c170fcf0cac47b853.jpg already downloaded
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F52%252F7a52354823951716178821374008338f%252Fpa%252FPR99923_bcf9b3ad6089dcc670b902228ea06fdb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/52/7a52354823951716178821374008338f/pa/PR99923_bcf9b3ad6089dcc670b902228ea06fdb.jpg already downloaded
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F52%252F7a52354823951716178821374008338f%252Fpa%252FPR99923_8b727994d2d40eec0fa0cbf1d4eb155b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/52/7a52354823951716178821374008338f/pa/PR99923_8b727994d2d40eec0fa0cbf1d4eb155b.jpg already downloaded
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F52%252F7a52354823951716178821374008338f%252Fpa%252FPR99923_bbe721388d636d5c27fabe9f71bd33b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/52/7a52354823951716178821374008338f/pa/PR99923_bbe721388d636d5c27fabe9f71bd33b5.jpg already downloaded
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F52%252F7a52354823951716178821374008338f%252Fpa%252FPR99923_7c1a770a02f616e0049911accec015a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/52/7a52354823951716178821374008338f/pa/PR99923_7c1a770a02f616e0049911accec015a3.jpg already downloaded
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F52%252F7a52354823951716178821374008338f%252Fpa%252FPR99923_891823d406cfe63dcfe3ad39b104dd69.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/52/7a52354823951716178821374008338f/pa/PR99923_891823d406cfe63dcfe3ad39b104dd69.jpg already downloaded
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F52%252F7a52354823951716178821374008338f%252Fpa%252FPR99923_1082fc17d4b24e02e9737b713877ea37.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/52/7a52354823951716178821374008338f/pa/PR99923_1082fc17d4b24e02e9737b713877ea37.jpg already downloaded
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F52%252F7a52354823951716178821374008338f%252Fpa%252FPR99923_c2794484f3c9f735de71c21cb6eedbb6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/52/7a52354823951716178821374008338f/pa/PR99923_c2794484f3c9f735de71c21cb6eedbb6.jpg already downloaded
2026-03-30 11:15:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:15:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a484350>
2026-03-30 11:15:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:15:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e332835f-619a-5e9a-83c7-45291333b9b3/e332835f-619a-5e9a-83c7-45291333b9b3_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fdc%252Fe3dc7e4000b28122a89f5d80ac453405%252Fpa%252FJN78830_daab90110193ff0e988bfbb882c9b861.jpg') HTTP/1.1" 204 0
2026-03-30 11:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_daab90110193ff0e988bfbb882c9b861.jpg saved to cache
2026-03-30 11:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e332835f-619a-5e9a-83c7-45291333b9b3
2026-03-30 11:15:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_0b5d6530d5d7abec76100ed7e26a1a9d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:15:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/52/7a52354823951716178821374008338f/pa/PR99923_bbab50a8957854671ad780f921abfdeb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:15:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_64021c9c23f312ce8a9629696433b924.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:15:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_24b3c319a583bacf97ded0323a92b546.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:15:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:15:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05aeb1d10>
2026-03-30 11:15:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:15:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e332835f-619a-5e9a-83c7-45291333b9b3/e332835f-619a-5e9a-83c7-45291333b9b3_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fdc%252Fe3dc7e4000b28122a89f5d80ac453405%252Fpa%252FJN78830_0b5d6530d5d7abec76100ed7e26a1a9d.jpg') HTTP/1.1" 204 0
2026-03-30 11:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_0b5d6530d5d7abec76100ed7e26a1a9d.jpg saved to cache
2026-03-30 11:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e332835f-619a-5e9a-83c7-45291333b9b3
2026-03-30 11:15:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:15:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05aeeb410>
2026-03-30 11:15:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:15:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c53c12-75d3-5d0d-a2e7-2cff68f54041/31c53c12-75d3-5d0d-a2e7-2cff68f54041_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F52%252F7a52354823951716178821374008338f%252Fpa%252FPR99923_bbab50a8957854671ad780f921abfdeb.jpg') HTTP/1.1" 204 0
2026-03-30 11:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/52/7a52354823951716178821374008338f/pa/PR99923_bbab50a8957854671ad780f921abfdeb.jpg saved to cache
2026-03-30 11:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 31c53c12-75d3-5d0d-a2e7-2cff68f54041
2026-03-30 11:15:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 31c53c12-75d3-5d0d-a2e7-2cff68f54041, skipping ID generation
2026-03-30 11:15:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31c53c12-75d3-5d0d-a2e7-2cff68f54041 with scrape type 1
2026-03-30 11:15:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 31c53c12-75d3-5d0d-a2e7-2cff68f54041 sending to next pipeline
2026-03-30 11:15:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 31c53c12-75d3-5d0d-a2e7-2cff68f54041, identifier: PR99923
2026-03-30 11:15:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:15:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad4c950>
2026-03-30 11:15:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:15:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e332835f-619a-5e9a-83c7-45291333b9b3/e332835f-619a-5e9a-83c7-45291333b9b3_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fdc%252Fe3dc7e4000b28122a89f5d80ac453405%252Fpa%252FJN78830_64021c9c23f312ce8a9629696433b924.jpg') HTTP/1.1" 204 0
2026-03-30 11:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_64021c9c23f312ce8a9629696433b924.jpg saved to cache
2026-03-30 11:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e332835f-619a-5e9a-83c7-45291333b9b3
2026-03-30 11:15:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:15:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a459790>
2026-03-30 11:15:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:15:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e332835f-619a-5e9a-83c7-45291333b9b3/e332835f-619a-5e9a-83c7-45291333b9b3_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fdc%252Fe3dc7e4000b28122a89f5d80ac453405%252Fpa%252FJN78830_24b3c319a583bacf97ded0323a92b546.jpg') HTTP/1.1" 204 0
2026-03-30 11:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_24b3c319a583bacf97ded0323a92b546.jpg saved to cache
2026-03-30 11:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e332835f-619a-5e9a-83c7-45291333b9b3
2026-03-30 11:15:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e332835f-619a-5e9a-83c7-45291333b9b3, skipping ID generation
2026-03-30 11:15:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e332835f-619a-5e9a-83c7-45291333b9b3 with scrape type 1
2026-03-30 11:15:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e332835f-619a-5e9a-83c7-45291333b9b3 sending to next pipeline
2026-03-30 11:15:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e332835f-619a-5e9a-83c7-45291333b9b3, identifier: JN78830
2026-03-30 11:15:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 31c53c12-75d3-5d0d-a2e7-2cff68f54041 with identifier: PR99923
2026-03-30 11:15:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 31c53c12-75d3-5d0d-a2e7-2cff68f54041 with identifier: PR99923
2026-03-30 11:15:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 31c53c12-75d3-5d0d-a2e7-2cff68f54041 with identifier: PR99923 to the API
2026-03-30 11:15:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:15:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:15:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7a/52/7a52354823951716178821374008338f/pa/PR99923_bbab50a8957854671ad780f921abfdeb.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 4',
'engine': '2.1L',
'engine_horse_power': 170,
'expiration_date': '2026-03-31T15:22:18Z',
'fuel_type': 'diesel',
'id': '31c53c12-75d3-5d0d-a2e7-2cff68f54041',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR99923',
'listing': 'auction',
'location': 'ES',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 495607,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c53c12-75d3-5d0d-a2e7-2cff68f54041/31c53c12-75d3-5d0d-a2e7-2cff68f54041_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89772,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/52/7a52354823951716178821374008338f/pa/PR99923_bbab50a8957854671ad780f921abfdeb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c53c12-75d3-5d0d-a2e7-2cff68f54041/31c53c12-75d3-5d0d-a2e7-2cff68f54041_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78806,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/52/7a52354823951716178821374008338f/pa/PR99923_b046028ca44845b1566b5beeba9e8411.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c53c12-75d3-5d0d-a2e7-2cff68f54041/31c53c12-75d3-5d0d-a2e7-2cff68f54041_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74258,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/52/7a52354823951716178821374008338f/pa/PR99923_249bfe4831f92b6c170fcf0cac47b853.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c53c12-75d3-5d0d-a2e7-2cff68f54041/31c53c12-75d3-5d0d-a2e7-2cff68f54041_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68293,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/52/7a52354823951716178821374008338f/pa/PR99923_bcf9b3ad6089dcc670b902228ea06fdb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c53c12-75d3-5d0d-a2e7-2cff68f54041/31c53c12-75d3-5d0d-a2e7-2cff68f54041_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74889,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/52/7a52354823951716178821374008338f/pa/PR99923_8b727994d2d40eec0fa0cbf1d4eb155b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c53c12-75d3-5d0d-a2e7-2cff68f54041/31c53c12-75d3-5d0d-a2e7-2cff68f54041_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81208,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/52/7a52354823951716178821374008338f/pa/PR99923_bbe721388d636d5c27fabe9f71bd33b5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c53c12-75d3-5d0d-a2e7-2cff68f54041/31c53c12-75d3-5d0d-a2e7-2cff68f54041_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85304,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/52/7a52354823951716178821374008338f/pa/PR99923_7c1a770a02f616e0049911accec015a3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c53c12-75d3-5d0d-a2e7-2cff68f54041/31c53c12-75d3-5d0d-a2e7-2cff68f54041_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110170,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/52/7a52354823951716178821374008338f/pa/PR99923_891823d406cfe63dcfe3ad39b104dd69.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c53c12-75d3-5d0d-a2e7-2cff68f54041/31c53c12-75d3-5d0d-a2e7-2cff68f54041_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64328,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/52/7a52354823951716178821374008338f/pa/PR99923_1082fc17d4b24e02e9737b713877ea37.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c53c12-75d3-5d0d-a2e7-2cff68f54041/31c53c12-75d3-5d0d-a2e7-2cff68f54041_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71538,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/52/7a52354823951716178821374008338f/pa/PR99923_c2794484f3c9f735de71c21cb6eedbb6.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-06-09',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 220 CDI BlueEfficiency Standard',
'transmission': 'automatic',
'trim': 'BlueEfficiency Standard',
'year': 2009}
2026-03-30 11:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PR99923%27 HTTP/1.1" 200 None
2026-03-30 11:15:15 [auto1.es] INFO: Saving data for PR99923: {'created_time': 1774869315.318024, 'last_price_update_time': 1774869315.318035, 'auction_closing_time': 1774970538.0}
2026-03-30 11:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PR99923') HTTP/1.1" 204 0
2026-03-30 11:15:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e332835f-619a-5e9a-83c7-45291333b9b3 with identifier: JN78830
2026-03-30 11:15:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e332835f-619a-5e9a-83c7-45291333b9b3 with identifier: JN78830
2026-03-30 11:15:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e332835f-619a-5e9a-83c7-45291333b9b3 with identifier: JN78830 to the API
2026-03-30 11:15:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:15:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:15:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_24b3c319a583bacf97ded0323a92b546.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.4L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:16:15Z',
'fuel_type': 'diesel',
'id': 'e332835f-619a-5e9a-83c7-45291333b9b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN78830',
'listing': 'auction',
'location': 'ES',
'make': 'Toyota',
'model': 'Hilux',
'odometer': 10581,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e332835f-619a-5e9a-83c7-45291333b9b3/e332835f-619a-5e9a-83c7-45291333b9b3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343308,
'Height': 960,
'OriginUrl': 'https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_24b3c319a583bacf97ded0323a92b546.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e332835f-619a-5e9a-83c7-45291333b9b3/e332835f-619a-5e9a-83c7-45291333b9b3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343308,
'Height': 960,
'OriginUrl': 'https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_64021c9c23f312ce8a9629696433b924.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e332835f-619a-5e9a-83c7-45291333b9b3/e332835f-619a-5e9a-83c7-45291333b9b3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336555,
'Height': 960,
'OriginUrl': 'https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_0b5d6530d5d7abec76100ed7e26a1a9d.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e332835f-619a-5e9a-83c7-45291333b9b3/e332835f-619a-5e9a-83c7-45291333b9b3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343092,
'Height': 960,
'OriginUrl': 'https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_daab90110193ff0e988bfbb882c9b861.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e332835f-619a-5e9a-83c7-45291333b9b3/e332835f-619a-5e9a-83c7-45291333b9b3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336397,
'Height': 960,
'OriginUrl': 'https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_b98a1893e80e0281733461031c025494.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e332835f-619a-5e9a-83c7-45291333b9b3/e332835f-619a-5e9a-83c7-45291333b9b3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357700,
'Height': 960,
'OriginUrl': 'https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_b1a6b9403ed517666526e5745e782b03.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e332835f-619a-5e9a-83c7-45291333b9b3/e332835f-619a-5e9a-83c7-45291333b9b3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 362402,
'Height': 960,
'OriginUrl': 'https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_921375a418dc0e6cd66523608b21db7f.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e332835f-619a-5e9a-83c7-45291333b9b3/e332835f-619a-5e9a-83c7-45291333b9b3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343308,
'Height': 960,
'OriginUrl': 'https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_c4e0ad4f088b87584366ad324ce64203.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e332835f-619a-5e9a-83c7-45291333b9b3/e332835f-619a-5e9a-83c7-45291333b9b3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 188112,
'Height': 960,
'OriginUrl': 'https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_68cc2ff42d572746aa384a33dd6b37c5.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e332835f-619a-5e9a-83c7-45291333b9b3/e332835f-619a-5e9a-83c7-45291333b9b3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 170762,
'Height': 960,
'OriginUrl': 'https://img-pa.auto1.com/imge3/dc/e3dc7e4000b28122a89f5d80ac453405/pa/JN78830_77dc58d69fbdb678ea3a895aa5d724c1.jpg',
'Width': 1280}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-03-04',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Hilux 2.4 D-4D Double Cab Le Cap 4WD',
'transmission': 'automatic',
'trim': 'Double Cab Le Cap 4WD',
'year': 2021}
2026-03-30 11:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JN78830%27 HTTP/1.1" 200 None
2026-03-30 11:15:15 [auto1.es] INFO: Saving data for JN78830: {'created_time': 1774869315.701562, 'last_price_update_time': 1774869315.701573, 'auction_closing_time': 1774970175.0}
2026-03-30 11:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JN78830') HTTP/1.1" 204 0
2026-03-30 11:15:31 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.439(s), this was the 1st time calling it.
2026-03-30 11:15:31 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.5645929904983245 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:15:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YP32131/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:15:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:15:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:15:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GT52927> (referer: https://www.auto1.com/v1/car-details-view/GT52927/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:15:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:15:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b72ca419-cd26-5958-a93b-b1887ba99ddb with identifier: GT52927
2026-03-30 11:15:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b72ca419-cd26-5958-a93b-b1887ba99ddb with scrape type 1
2026-03-30 11:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b72ca419-cd26-5958-a93b-b1887ba99ddb
2026-03-30 11:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fea%252F47ea7525bfb708361e24674ba525ba4c%252Fpa%252FGT52927_c4b13ca0841c776729710e8bfcef71f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/ea/47ea7525bfb708361e24674ba525ba4c/pa/GT52927_c4b13ca0841c776729710e8bfcef71f3.jpg not downloaded yet
2026-03-30 11:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fea%252F47ea7525bfb708361e24674ba525ba4c%252Fpa%252FGT52927_c40128053498ef01ecb7e5e36094eba5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/ea/47ea7525bfb708361e24674ba525ba4c/pa/GT52927_c40128053498ef01ecb7e5e36094eba5.jpg not downloaded yet
2026-03-30 11:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fea%252F47ea7525bfb708361e24674ba525ba4c%252Fpa%252FGT52927_3d2e3b60c3c9d8cb3dfce79fcddaa526.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/ea/47ea7525bfb708361e24674ba525ba4c/pa/GT52927_3d2e3b60c3c9d8cb3dfce79fcddaa526.jpg not downloaded yet
2026-03-30 11:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fea%252F47ea7525bfb708361e24674ba525ba4c%252Fpa%252FGT52927_9c82df6b5fc3d43471aa9368bb615872.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/ea/47ea7525bfb708361e24674ba525ba4c/pa/GT52927_9c82df6b5fc3d43471aa9368bb615872.jpg not downloaded yet
2026-03-30 11:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fea%252F47ea7525bfb708361e24674ba525ba4c%252Fpa%252FGT52927_d6299a32baad9075e04352a2975e92ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/ea/47ea7525bfb708361e24674ba525ba4c/pa/GT52927_d6299a32baad9075e04352a2975e92ff.jpg not downloaded yet
2026-03-30 11:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fea%252F47ea7525bfb708361e24674ba525ba4c%252Fpa%252FGT52927_51c7afec6623eda55dfab1bea8136ed9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/ea/47ea7525bfb708361e24674ba525ba4c/pa/GT52927_51c7afec6623eda55dfab1bea8136ed9.jpg not downloaded yet
2026-03-30 11:15:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BP04557/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:15:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:15:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/ea/47ea7525bfb708361e24674ba525ba4c/pa/GT52927_51c7afec6623eda55dfab1bea8136ed9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:15:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:15:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a49dbd0>
2026-03-30 11:15:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:15:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:15:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:15:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72ca419-cd26-5958-a93b-b1887ba99ddb/b72ca419-cd26-5958-a93b-b1887ba99ddb_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fea%252F47ea7525bfb708361e24674ba525ba4c%252Fpa%252FGT52927_51c7afec6623eda55dfab1bea8136ed9.jpg') HTTP/1.1" 204 0
2026-03-30 11:15:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/ea/47ea7525bfb708361e24674ba525ba4c/pa/GT52927_51c7afec6623eda55dfab1bea8136ed9.jpg saved to cache
2026-03-30 11:15:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b72ca419-cd26-5958-a93b-b1887ba99ddb
2026-03-30 11:15:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JP78473/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:15:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:15:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/ea/47ea7525bfb708361e24674ba525ba4c/pa/GT52927_d6299a32baad9075e04352a2975e92ff.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:15:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/ea/47ea7525bfb708361e24674ba525ba4c/pa/GT52927_9c82df6b5fc3d43471aa9368bb615872.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:15:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/ea/47ea7525bfb708361e24674ba525ba4c/pa/GT52927_3d2e3b60c3c9d8cb3dfce79fcddaa526.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:15:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:15:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a454a10>
2026-03-30 11:15:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:15:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:15:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:15:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72ca419-cd26-5958-a93b-b1887ba99ddb/b72ca419-cd26-5958-a93b-b1887ba99ddb_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fea%252F47ea7525bfb708361e24674ba525ba4c%252Fpa%252FGT52927_d6299a32baad9075e04352a2975e92ff.jpg') HTTP/1.1" 204 0
2026-03-30 11:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/ea/47ea7525bfb708361e24674ba525ba4c/pa/GT52927_d6299a32baad9075e04352a2975e92ff.jpg saved to cache
2026-03-30 11:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b72ca419-cd26-5958-a93b-b1887ba99ddb
2026-03-30 11:15:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:15:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4ae210>
2026-03-30 11:15:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:15:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:15:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:15:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72ca419-cd26-5958-a93b-b1887ba99ddb/b72ca419-cd26-5958-a93b-b1887ba99ddb_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fea%252F47ea7525bfb708361e24674ba525ba4c%252Fpa%252FGT52927_9c82df6b5fc3d43471aa9368bb615872.jpg') HTTP/1.1" 204 0
2026-03-30 11:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/ea/47ea7525bfb708361e24674ba525ba4c/pa/GT52927_9c82df6b5fc3d43471aa9368bb615872.jpg saved to cache
2026-03-30 11:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b72ca419-cd26-5958-a93b-b1887ba99ddb
2026-03-30 11:15:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:15:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad4fe10>
2026-03-30 11:15:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:15:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:15:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:15:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72ca419-cd26-5958-a93b-b1887ba99ddb/b72ca419-cd26-5958-a93b-b1887ba99ddb_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fea%252F47ea7525bfb708361e24674ba525ba4c%252Fpa%252FGT52927_3d2e3b60c3c9d8cb3dfce79fcddaa526.jpg') HTTP/1.1" 204 0
2026-03-30 11:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/ea/47ea7525bfb708361e24674ba525ba4c/pa/GT52927_3d2e3b60c3c9d8cb3dfce79fcddaa526.jpg saved to cache
2026-03-30 11:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b72ca419-cd26-5958-a93b-b1887ba99ddb
2026-03-30 11:15:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JN94907/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:15:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:15:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/ea/47ea7525bfb708361e24674ba525ba4c/pa/GT52927_c40128053498ef01ecb7e5e36094eba5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:15:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/ea/47ea7525bfb708361e24674ba525ba4c/pa/GT52927_c4b13ca0841c776729710e8bfcef71f3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:15:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:15:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4aced0>
2026-03-30 11:15:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:15:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:15:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:15:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72ca419-cd26-5958-a93b-b1887ba99ddb/b72ca419-cd26-5958-a93b-b1887ba99ddb_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fea%252F47ea7525bfb708361e24674ba525ba4c%252Fpa%252FGT52927_c40128053498ef01ecb7e5e36094eba5.jpg') HTTP/1.1" 204 0
2026-03-30 11:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/ea/47ea7525bfb708361e24674ba525ba4c/pa/GT52927_c40128053498ef01ecb7e5e36094eba5.jpg saved to cache
2026-03-30 11:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b72ca419-cd26-5958-a93b-b1887ba99ddb
2026-03-30 11:15:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:15:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a430bd0>
2026-03-30 11:15:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:15:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:15:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:15:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72ca419-cd26-5958-a93b-b1887ba99ddb/b72ca419-cd26-5958-a93b-b1887ba99ddb_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fea%252F47ea7525bfb708361e24674ba525ba4c%252Fpa%252FGT52927_c4b13ca0841c776729710e8bfcef71f3.jpg') HTTP/1.1" 204 0
2026-03-30 11:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/ea/47ea7525bfb708361e24674ba525ba4c/pa/GT52927_c4b13ca0841c776729710e8bfcef71f3.jpg saved to cache
2026-03-30 11:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b72ca419-cd26-5958-a93b-b1887ba99ddb
2026-03-30 11:15:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b72ca419-cd26-5958-a93b-b1887ba99ddb, skipping ID generation
2026-03-30 11:15:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b72ca419-cd26-5958-a93b-b1887ba99ddb with scrape type 1
2026-03-30 11:15:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b72ca419-cd26-5958-a93b-b1887ba99ddb sending to next pipeline
2026-03-30 11:15:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b72ca419-cd26-5958-a93b-b1887ba99ddb, identifier: GT52927
2026-03-30 11:15:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b72ca419-cd26-5958-a93b-b1887ba99ddb with identifier: GT52927
2026-03-30 11:15:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b72ca419-cd26-5958-a93b-b1887ba99ddb with identifier: GT52927
2026-03-30 11:15:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b72ca419-cd26-5958-a93b-b1887ba99ddb with identifier: GT52927 to the API
2026-03-30 11:15:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:15:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:15:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img47/ea/47ea7525bfb708361e24674ba525ba4c/pa/GT52927_c4b13ca0841c776729710e8bfcef71f3.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 4',
'engine': '1.4L',
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:04:26Z',
'fuel_type': 'petrol',
'id': 'b72ca419-cd26-5958-a93b-b1887ba99ddb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT52927',
'listing': 'auction',
'location': 'ES, AlmerÃa',
'make': 'Volkswagen',
'model': 'Fox',
'odometer': 91189,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b72ca419-cd26-5958-a93b-b1887ba99ddb/b72ca419-cd26-5958-a93b-b1887ba99ddb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73484,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img47/ea/47ea7525bfb708361e24674ba525ba4c/pa/GT52927_c4b13ca0841c776729710e8bfcef71f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b72ca419-cd26-5958-a93b-b1887ba99ddb/b72ca419-cd26-5958-a93b-b1887ba99ddb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70430,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img47/ea/47ea7525bfb708361e24674ba525ba4c/pa/GT52927_c40128053498ef01ecb7e5e36094eba5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b72ca419-cd26-5958-a93b-b1887ba99ddb/b72ca419-cd26-5958-a93b-b1887ba99ddb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71504,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img47/ea/47ea7525bfb708361e24674ba525ba4c/pa/GT52927_3d2e3b60c3c9d8cb3dfce79fcddaa526.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b72ca419-cd26-5958-a93b-b1887ba99ddb/b72ca419-cd26-5958-a93b-b1887ba99ddb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55562,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img47/ea/47ea7525bfb708361e24674ba525ba4c/pa/GT52927_9c82df6b5fc3d43471aa9368bb615872.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b72ca419-cd26-5958-a93b-b1887ba99ddb/b72ca419-cd26-5958-a93b-b1887ba99ddb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65157,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img47/ea/47ea7525bfb708361e24674ba525ba4c/pa/GT52927_d6299a32baad9075e04352a2975e92ff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b72ca419-cd26-5958-a93b-b1887ba99ddb/b72ca419-cd26-5958-a93b-b1887ba99ddb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78755,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img47/ea/47ea7525bfb708361e24674ba525ba4c/pa/GT52927_51c7afec6623eda55dfab1bea8136ed9.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2006-08-06',
'seats_number': 4,
'seller_name': None,
'title': 'Volkswagen Fox 1.4',
'transmission': 'manual',
'trim': '',
'year': 2006}
2026-03-30 11:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT52927%27 HTTP/1.1" 200 None
2026-03-30 11:15:55 [auto1.es] INFO: Saving data for GT52927: {'created_time': 1774869355.373163, 'last_price_update_time': 1774869355.373172, 'auction_closing_time': 1774969466.0}
2026-03-30 11:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GT52927') HTTP/1.1" 204 0
2026-03-30 11:16:04 [scrapy.extensions.logstats] INFO: Crawled 32 pages (at 7 pages/min), scraped 20 items (at 3 items/min)
2026-03-30 11:16:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 159MiB
2026-03-30 11:17:01 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 265.422(s), this was the 2nd time calling it.
2026-03-30 11:17:01 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.205324148923884 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:17:01 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 264.460(s), this was the 2nd time calling it.
2026-03-30 11:17:01 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 8.65302408635838 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:17:03 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 267.425(s), this was the 2nd time calling it.
2026-03-30 11:17:03 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.346365006249126 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:17:04 [scrapy.extensions.logstats] INFO: Crawled 32 pages (at 0 pages/min), scraped 20 items (at 0 items/min)
2026-03-30 11:17:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 159MiB
2026-03-30 11:17:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 11:17:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 11:17:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 11:17:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MJ08668/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:13 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.988(s), this was the 1st time calling it.
2026-03-30 11:17:13 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.135508946164388 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:17:15 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.586(s), this was the 1st time calling it.
2026-03-30 11:17:15 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.155483510173704 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:17:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:17:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:17:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HC40345/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UL16630> (referer: https://www.auto1.com/v1/car-details-view/UL16630/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6dde12c1-a841-5885-84f4-49c199bb63d3 with identifier: UL16630
2026-03-30 11:17:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6dde12c1-a841-5885-84f4-49c199bb63d3 with scrape type 1
2026-03-30 11:17:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6dde12c1-a841-5885-84f4-49c199bb63d3
2026-03-30 11:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F48%252Fd34828b950e0a04d650440433708f646%252Fpa%252FUL16630_dbffb478e7a4e7478f172afbabd5fc57.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_dbffb478e7a4e7478f172afbabd5fc57.jpg not downloaded yet
2026-03-30 11:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F48%252Fd34828b950e0a04d650440433708f646%252Fpa%252FUL16630_da20ae36b27910e8d5c275b992ee6cdb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_da20ae36b27910e8d5c275b992ee6cdb.jpg not downloaded yet
2026-03-30 11:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F48%252Fd34828b950e0a04d650440433708f646%252Fpa%252FUL16630_b2f7e17f03847ea59c9adc33ceefa5c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_b2f7e17f03847ea59c9adc33ceefa5c9.jpg not downloaded yet
2026-03-30 11:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F48%252Fd34828b950e0a04d650440433708f646%252Fpa%252FUL16630_5bda8025d6d8771a5bc3b1d6fc94002d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_5bda8025d6d8771a5bc3b1d6fc94002d.jpg not downloaded yet
2026-03-30 11:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F48%252Fd34828b950e0a04d650440433708f646%252Fpa%252FUL16630_c4c7c2259074864d2220aaa963a31210.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_c4c7c2259074864d2220aaa963a31210.jpg not downloaded yet
2026-03-30 11:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F48%252Fd34828b950e0a04d650440433708f646%252Fpa%252FUL16630_9296526f40669b9438f13a740ea410cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_9296526f40669b9438f13a740ea410cc.jpg not downloaded yet
2026-03-30 11:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F48%252Fd34828b950e0a04d650440433708f646%252Fpa%252FUL16630_a3fd71d066553e91c874c40000d0e98d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_a3fd71d066553e91c874c40000d0e98d.jpg not downloaded yet
2026-03-30 11:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F48%252Fd34828b950e0a04d650440433708f646%252Fpa%252FUL16630_70b1ce98e04a5785bee5a9419b5cd472.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_70b1ce98e04a5785bee5a9419b5cd472.jpg not downloaded yet
2026-03-30 11:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F48%252Fd34828b950e0a04d650440433708f646%252Fpa%252FUL16630_df479c8dd14ffef384bc01e67eede88a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_df479c8dd14ffef384bc01e67eede88a.jpg not downloaded yet
2026-03-30 11:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F48%252Fd34828b950e0a04d650440433708f646%252Fpa%252FUL16630_45c52051e58c9f2f91a9e1cf91bbae58.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_45c52051e58c9f2f91a9e1cf91bbae58.jpg not downloaded yet
2026-03-30 11:17:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UR30668/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_45c52051e58c9f2f91a9e1cf91bbae58.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad2e5d0>
2026-03-30 11:17:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dde12c1-a841-5885-84f4-49c199bb63d3/6dde12c1-a841-5885-84f4-49c199bb63d3_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F48%252Fd34828b950e0a04d650440433708f646%252Fpa%252FUL16630_45c52051e58c9f2f91a9e1cf91bbae58.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_45c52051e58c9f2f91a9e1cf91bbae58.jpg saved to cache
2026-03-30 11:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6dde12c1-a841-5885-84f4-49c199bb63d3
2026-03-30 11:17:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AJ27440/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_df479c8dd14ffef384bc01e67eede88a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4a4850>
2026-03-30 11:17:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dde12c1-a841-5885-84f4-49c199bb63d3/6dde12c1-a841-5885-84f4-49c199bb63d3_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F48%252Fd34828b950e0a04d650440433708f646%252Fpa%252FUL16630_df479c8dd14ffef384bc01e67eede88a.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_df479c8dd14ffef384bc01e67eede88a.jpg saved to cache
2026-03-30 11:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6dde12c1-a841-5885-84f4-49c199bb63d3
2026-03-30 11:17:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FD15561/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_70b1ce98e04a5785bee5a9419b5cd472.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a488c50>
2026-03-30 11:17:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dde12c1-a841-5885-84f4-49c199bb63d3/6dde12c1-a841-5885-84f4-49c199bb63d3_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F48%252Fd34828b950e0a04d650440433708f646%252Fpa%252FUL16630_70b1ce98e04a5785bee5a9419b5cd472.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_70b1ce98e04a5785bee5a9419b5cd472.jpg saved to cache
2026-03-30 11:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6dde12c1-a841-5885-84f4-49c199bb63d3
2026-03-30 11:17:48 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 266.654(s), this was the 2nd time calling it.
2026-03-30 11:17:48 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.983099998691428 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:17:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BP04557> (referer: https://www.auto1.com/v1/car-details-view/BP04557/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f19fbd20-bbd2-5bf7-a085-46f3a60af12d with identifier: BP04557
2026-03-30 11:17:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f19fbd20-bbd2-5bf7-a085-46f3a60af12d with scrape type 1
2026-03-30 11:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f19fbd20-bbd2-5bf7-a085-46f3a60af12d
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fbf%252F36bfddd37f0e0b535cb5ef8d95857c12%252Fpa%252FBP04557_417b0241903ea78bcd4842fbb2d13135.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/bf/36bfddd37f0e0b535cb5ef8d95857c12/pa/BP04557_417b0241903ea78bcd4842fbb2d13135.jpg already downloaded
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fbf%252F36bfddd37f0e0b535cb5ef8d95857c12%252Fpa%252FBP04557_1ee2c8276eae7699211d7b5a18c4e625.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/bf/36bfddd37f0e0b535cb5ef8d95857c12/pa/BP04557_1ee2c8276eae7699211d7b5a18c4e625.jpg already downloaded
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fbf%252F36bfddd37f0e0b535cb5ef8d95857c12%252Fpa%252FBP04557_4b0e969c73f37a07852753ba3ce9e177.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/bf/36bfddd37f0e0b535cb5ef8d95857c12/pa/BP04557_4b0e969c73f37a07852753ba3ce9e177.jpg already downloaded
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fbf%252F36bfddd37f0e0b535cb5ef8d95857c12%252Fpa%252FBP04557_f74d5047ab4e762ce45cd8b5d883e4a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/bf/36bfddd37f0e0b535cb5ef8d95857c12/pa/BP04557_f74d5047ab4e762ce45cd8b5d883e4a9.jpg already downloaded
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fbf%252F36bfddd37f0e0b535cb5ef8d95857c12%252Fpa%252FBP04557_fc39bb6cc8427e52bc822bcdf76c856f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/bf/36bfddd37f0e0b535cb5ef8d95857c12/pa/BP04557_fc39bb6cc8427e52bc822bcdf76c856f.jpg already downloaded
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fbf%252F36bfddd37f0e0b535cb5ef8d95857c12%252Fpa%252FBP04557_bcc75824d0a7ac835591bff82cbcaf3b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/bf/36bfddd37f0e0b535cb5ef8d95857c12/pa/BP04557_bcc75824d0a7ac835591bff82cbcaf3b.jpg already downloaded
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fbf%252F36bfddd37f0e0b535cb5ef8d95857c12%252Fpa%252FBP04557_e1248505d80f3f7c172cdc2c770c2803.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/bf/36bfddd37f0e0b535cb5ef8d95857c12/pa/BP04557_e1248505d80f3f7c172cdc2c770c2803.jpg already downloaded
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fbf%252F36bfddd37f0e0b535cb5ef8d95857c12%252Fpa%252FBP04557_03ebe91f6ee8f98b29a3916179697f30.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/bf/36bfddd37f0e0b535cb5ef8d95857c12/pa/BP04557_03ebe91f6ee8f98b29a3916179697f30.jpg already downloaded
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fbf%252F36bfddd37f0e0b535cb5ef8d95857c12%252Fpa%252FBP04557_bd586ce21d66cc2af501a46c6607f88e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/bf/36bfddd37f0e0b535cb5ef8d95857c12/pa/BP04557_bd586ce21d66cc2af501a46c6607f88e.jpg already downloaded
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fbf%252F36bfddd37f0e0b535cb5ef8d95857c12%252Fpa%252FBP04557_30fe9ef08a6f9d03856d6e90ff2d12ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/bf/36bfddd37f0e0b535cb5ef8d95857c12/pa/BP04557_30fe9ef08a6f9d03856d6e90ff2d12ca.jpg already downloaded
2026-03-30 11:17:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f19fbd20-bbd2-5bf7-a085-46f3a60af12d, identifier: BP04557
2026-03-30 11:17:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f19fbd20-bbd2-5bf7-a085-46f3a60af12d with identifier: BP04557
2026-03-30 11:17:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f19fbd20-bbd2-5bf7-a085-46f3a60af12d with identifier: BP04557
2026-03-30 11:17:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f19fbd20-bbd2-5bf7-a085-46f3a60af12d with identifier: BP04557 to the API
2026-03-30 11:17:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:17:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:17:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BP04557>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': 'Rental',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:47:42Z',
'fuel_type': 'petrol',
'id': 'f19fbd20-bbd2-5bf7-a085-46f3a60af12d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP04557',
'listing': 'auction',
'location': 'ES, Sevilla',
'make': 'Renault',
'model': 'Captur',
'odometer': 97101,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img36/bf/36bfddd37f0e0b535cb5ef8d95857c12/pa/BP04557_417b0241903ea78bcd4842fbb2d13135.jpg',
'https://img-pa.auto1.com/img36/bf/36bfddd37f0e0b535cb5ef8d95857c12/pa/BP04557_1ee2c8276eae7699211d7b5a18c4e625.jpg',
'https://img-pa.auto1.com/img36/bf/36bfddd37f0e0b535cb5ef8d95857c12/pa/BP04557_4b0e969c73f37a07852753ba3ce9e177.jpg',
'https://img-pa.auto1.com/img36/bf/36bfddd37f0e0b535cb5ef8d95857c12/pa/BP04557_f74d5047ab4e762ce45cd8b5d883e4a9.jpg',
'https://img-pa.auto1.com/img36/bf/36bfddd37f0e0b535cb5ef8d95857c12/pa/BP04557_fc39bb6cc8427e52bc822bcdf76c856f.jpg',
'https://img-pa.auto1.com/img36/bf/36bfddd37f0e0b535cb5ef8d95857c12/pa/BP04557_bcc75824d0a7ac835591bff82cbcaf3b.jpg',
'https://img-pa.auto1.com/img36/bf/36bfddd37f0e0b535cb5ef8d95857c12/pa/BP04557_e1248505d80f3f7c172cdc2c770c2803.jpg',
'https://img-pa.auto1.com/img36/bf/36bfddd37f0e0b535cb5ef8d95857c12/pa/BP04557_03ebe91f6ee8f98b29a3916179697f30.jpg',
'https://img-pa.auto1.com/img36/bf/36bfddd37f0e0b535cb5ef8d95857c12/pa/BP04557_bd586ce21d66cc2af501a46c6607f88e.jpg',
'https://img-pa.auto1.com/img36/bf/36bfddd37f0e0b535cb5ef8d95857c12/pa/BP04557_30fe9ef08a6f9d03856d6e90ff2d12ca.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f19fbd20-bbd2-5bf7-a085-46f3a60af12d/f19fbd20-bbd2-5bf7-a085-46f3a60af12d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94200,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/bf/36bfddd37f0e0b535cb5ef8d95857c12/pa/BP04557_417b0241903ea78bcd4842fbb2d13135.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f19fbd20-bbd2-5bf7-a085-46f3a60af12d/f19fbd20-bbd2-5bf7-a085-46f3a60af12d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82371,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/bf/36bfddd37f0e0b535cb5ef8d95857c12/pa/BP04557_1ee2c8276eae7699211d7b5a18c4e625.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f19fbd20-bbd2-5bf7-a085-46f3a60af12d/f19fbd20-bbd2-5bf7-a085-46f3a60af12d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87428,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/bf/36bfddd37f0e0b535cb5ef8d95857c12/pa/BP04557_4b0e969c73f37a07852753ba3ce9e177.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f19fbd20-bbd2-5bf7-a085-46f3a60af12d/f19fbd20-bbd2-5bf7-a085-46f3a60af12d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63476,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/bf/36bfddd37f0e0b535cb5ef8d95857c12/pa/BP04557_f74d5047ab4e762ce45cd8b5d883e4a9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f19fbd20-bbd2-5bf7-a085-46f3a60af12d/f19fbd20-bbd2-5bf7-a085-46f3a60af12d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71442,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/bf/36bfddd37f0e0b535cb5ef8d95857c12/pa/BP04557_fc39bb6cc8427e52bc822bcdf76c856f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f19fbd20-bbd2-5bf7-a085-46f3a60af12d/f19fbd20-bbd2-5bf7-a085-46f3a60af12d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88147,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/bf/36bfddd37f0e0b535cb5ef8d95857c12/pa/BP04557_bcc75824d0a7ac835591bff82cbcaf3b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f19fbd20-bbd2-5bf7-a085-46f3a60af12d/f19fbd20-bbd2-5bf7-a085-46f3a60af12d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66254,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/bf/36bfddd37f0e0b535cb5ef8d95857c12/pa/BP04557_e1248505d80f3f7c172cdc2c770c2803.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f19fbd20-bbd2-5bf7-a085-46f3a60af12d/f19fbd20-bbd2-5bf7-a085-46f3a60af12d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81997,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/bf/36bfddd37f0e0b535cb5ef8d95857c12/pa/BP04557_03ebe91f6ee8f98b29a3916179697f30.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f19fbd20-bbd2-5bf7-a085-46f3a60af12d/f19fbd20-bbd2-5bf7-a085-46f3a60af12d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91519,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/bf/36bfddd37f0e0b535cb5ef8d95857c12/pa/BP04557_bd586ce21d66cc2af501a46c6607f88e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f19fbd20-bbd2-5bf7-a085-46f3a60af12d/f19fbd20-bbd2-5bf7-a085-46f3a60af12d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69384,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/bf/36bfddd37f0e0b535cb5ef8d95857c12/pa/BP04557_30fe9ef08a6f9d03856d6e90ff2d12ca.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-06-01',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Captur 1.2 TCe Energy Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2017}
2026-03-30 11:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BP04557%27 HTTP/1.1" 200 None
2026-03-30 11:17:51 [auto1.es] INFO: Saving data for BP04557: {'created_time': 1774869471.184881, 'last_price_update_time': 1774869471.184895, 'auction_closing_time': 1774972062.0}
2026-03-30 11:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BP04557') HTTP/1.1" 204 0
2026-03-30 11:17:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_a3fd71d066553e91c874c40000d0e98d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060eb6d90>
2026-03-30 11:17:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dde12c1-a841-5885-84f4-49c199bb63d3/6dde12c1-a841-5885-84f4-49c199bb63d3_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F48%252Fd34828b950e0a04d650440433708f646%252Fpa%252FUL16630_a3fd71d066553e91c874c40000d0e98d.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_a3fd71d066553e91c874c40000d0e98d.jpg saved to cache
2026-03-30 11:17:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6dde12c1-a841-5885-84f4-49c199bb63d3
2026-03-30 11:17:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_9296526f40669b9438f13a740ea410cc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ae95f90>
2026-03-30 11:17:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dde12c1-a841-5885-84f4-49c199bb63d3/6dde12c1-a841-5885-84f4-49c199bb63d3_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F48%252Fd34828b950e0a04d650440433708f646%252Fpa%252FUL16630_9296526f40669b9438f13a740ea410cc.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_9296526f40669b9438f13a740ea410cc.jpg saved to cache
2026-03-30 11:17:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6dde12c1-a841-5885-84f4-49c199bb63d3
2026-03-30 11:17:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_c4c7c2259074864d2220aaa963a31210.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad22210>
2026-03-30 11:17:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dde12c1-a841-5885-84f4-49c199bb63d3/6dde12c1-a841-5885-84f4-49c199bb63d3_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F48%252Fd34828b950e0a04d650440433708f646%252Fpa%252FUL16630_c4c7c2259074864d2220aaa963a31210.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_c4c7c2259074864d2220aaa963a31210.jpg saved to cache
2026-03-30 11:17:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6dde12c1-a841-5885-84f4-49c199bb63d3
2026-03-30 11:17:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_5bda8025d6d8771a5bc3b1d6fc94002d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ae96c90>
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dde12c1-a841-5885-84f4-49c199bb63d3/6dde12c1-a841-5885-84f4-49c199bb63d3_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F48%252Fd34828b950e0a04d650440433708f646%252Fpa%252FUL16630_5bda8025d6d8771a5bc3b1d6fc94002d.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_5bda8025d6d8771a5bc3b1d6fc94002d.jpg saved to cache
2026-03-30 11:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6dde12c1-a841-5885-84f4-49c199bb63d3
2026-03-30 11:17:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_b2f7e17f03847ea59c9adc33ceefa5c9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad8a6d0>
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dde12c1-a841-5885-84f4-49c199bb63d3/6dde12c1-a841-5885-84f4-49c199bb63d3_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F48%252Fd34828b950e0a04d650440433708f646%252Fpa%252FUL16630_b2f7e17f03847ea59c9adc33ceefa5c9.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_b2f7e17f03847ea59c9adc33ceefa5c9.jpg saved to cache
2026-03-30 11:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6dde12c1-a841-5885-84f4-49c199bb63d3
2026-03-30 11:17:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_da20ae36b27910e8d5c275b992ee6cdb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_dbffb478e7a4e7478f172afbabd5fc57.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad6cdd0>
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dde12c1-a841-5885-84f4-49c199bb63d3/6dde12c1-a841-5885-84f4-49c199bb63d3_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F48%252Fd34828b950e0a04d650440433708f646%252Fpa%252FUL16630_da20ae36b27910e8d5c275b992ee6cdb.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_da20ae36b27910e8d5c275b992ee6cdb.jpg saved to cache
2026-03-30 11:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6dde12c1-a841-5885-84f4-49c199bb63d3
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad23010>
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dde12c1-a841-5885-84f4-49c199bb63d3/6dde12c1-a841-5885-84f4-49c199bb63d3_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F48%252Fd34828b950e0a04d650440433708f646%252Fpa%252FUL16630_dbffb478e7a4e7478f172afbabd5fc57.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_dbffb478e7a4e7478f172afbabd5fc57.jpg saved to cache
2026-03-30 11:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6dde12c1-a841-5885-84f4-49c199bb63d3
2026-03-30 11:17:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6dde12c1-a841-5885-84f4-49c199bb63d3, skipping ID generation
2026-03-30 11:17:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6dde12c1-a841-5885-84f4-49c199bb63d3 with scrape type 1
2026-03-30 11:17:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6dde12c1-a841-5885-84f4-49c199bb63d3 sending to next pipeline
2026-03-30 11:17:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6dde12c1-a841-5885-84f4-49c199bb63d3, identifier: UL16630
2026-03-30 11:17:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6dde12c1-a841-5885-84f4-49c199bb63d3 with identifier: UL16630
2026-03-30 11:17:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6dde12c1-a841-5885-84f4-49c199bb63d3 with identifier: UL16630
2026-03-30 11:17:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6dde12c1-a841-5885-84f4-49c199bb63d3 with identifier: UL16630 to the API
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:17:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:17:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_dbffb478e7a4e7478f172afbabd5fc57.jpg>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': 'Rental',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 105,
'expiration_date': '2026-03-31T15:17:02Z',
'fuel_type': 'diesel',
'id': '6dde12c1-a841-5885-84f4-49c199bb63d3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL16630',
'listing': 'auction',
'location': 'ES, Jerez de la Frontera',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 126694,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dde12c1-a841-5885-84f4-49c199bb63d3/6dde12c1-a841-5885-84f4-49c199bb63d3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82285,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_dbffb478e7a4e7478f172afbabd5fc57.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dde12c1-a841-5885-84f4-49c199bb63d3/6dde12c1-a841-5885-84f4-49c199bb63d3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74987,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_da20ae36b27910e8d5c275b992ee6cdb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dde12c1-a841-5885-84f4-49c199bb63d3/6dde12c1-a841-5885-84f4-49c199bb63d3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78788,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_b2f7e17f03847ea59c9adc33ceefa5c9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dde12c1-a841-5885-84f4-49c199bb63d3/6dde12c1-a841-5885-84f4-49c199bb63d3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68605,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_5bda8025d6d8771a5bc3b1d6fc94002d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dde12c1-a841-5885-84f4-49c199bb63d3/6dde12c1-a841-5885-84f4-49c199bb63d3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83019,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_c4c7c2259074864d2220aaa963a31210.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dde12c1-a841-5885-84f4-49c199bb63d3/6dde12c1-a841-5885-84f4-49c199bb63d3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82628,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_9296526f40669b9438f13a740ea410cc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dde12c1-a841-5885-84f4-49c199bb63d3/6dde12c1-a841-5885-84f4-49c199bb63d3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58918,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_a3fd71d066553e91c874c40000d0e98d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dde12c1-a841-5885-84f4-49c199bb63d3/6dde12c1-a841-5885-84f4-49c199bb63d3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78116,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_70b1ce98e04a5785bee5a9419b5cd472.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dde12c1-a841-5885-84f4-49c199bb63d3/6dde12c1-a841-5885-84f4-49c199bb63d3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74748,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_df479c8dd14ffef384bc01e67eede88a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dde12c1-a841-5885-84f4-49c199bb63d3/6dde12c1-a841-5885-84f4-49c199bb63d3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70664,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/48/d34828b950e0a04d650440433708f646/pa/UL16630_45c52051e58c9f2f91a9e1cf91bbae58.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-07-07',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Ibiza 1.6 TDI Stylance / Style',
'transmission': 'manual',
'trim': 'Stylance / Style',
'year': 2013}
2026-03-30 11:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UL16630%27 HTTP/1.1" 200 None
2026-03-30 11:17:53 [auto1.es] INFO: Saving data for UL16630: {'created_time': 1774869473.155918, 'last_price_update_time': 1774869473.155967, 'auction_closing_time': 1774970222.0}
2026-03-30 11:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UL16630') HTTP/1.1" 204 0
2026-03-30 11:17:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZV81401/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YA78719/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HU27637/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 11:17:56 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.954(s), this was the 1st time calling it.
2026-03-30 11:17:56 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.5296207814855025 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:17:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JP78473> (referer: https://www.auto1.com/v1/car-details-view/JP78473/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a64a5b1e-1b6f-5717-a2ae-621a881b5a9b with identifier: JP78473
2026-03-30 11:17:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a64a5b1e-1b6f-5717-a2ae-621a881b5a9b with scrape type 1
2026-03-30 11:17:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a64a5b1e-1b6f-5717-a2ae-621a881b5a9b
2026-03-30 11:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F73%252F26737a75203ef21b15cf86967f7e58a1%252Fpa%252FJP78473_549e3de9e4c23bb7101b63b789b0d414.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_549e3de9e4c23bb7101b63b789b0d414.jpg not downloaded yet
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F73%252F26737a75203ef21b15cf86967f7e58a1%252Fpa%252FJP78473_b765709eb653cdbf7d8681358d9fdf74.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_b765709eb653cdbf7d8681358d9fdf74.jpg not downloaded yet
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F73%252F26737a75203ef21b15cf86967f7e58a1%252Fpa%252FJP78473_88157955b899a12cdc63218b462c2414.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_88157955b899a12cdc63218b462c2414.jpg not downloaded yet
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F73%252F26737a75203ef21b15cf86967f7e58a1%252Fpa%252FJP78473_db3fdd3dfe1316dc60b2fc21b9f55f0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_db3fdd3dfe1316dc60b2fc21b9f55f0e.jpg not downloaded yet
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F73%252F26737a75203ef21b15cf86967f7e58a1%252Fpa%252FJP78473_bec3b78d9b3c843c912dcd8cd713682b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_bec3b78d9b3c843c912dcd8cd713682b.jpg not downloaded yet
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F73%252F26737a75203ef21b15cf86967f7e58a1%252Fpa%252FJP78473_815a3138442481fb016b89b55774109f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_815a3138442481fb016b89b55774109f.jpg not downloaded yet
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F73%252F26737a75203ef21b15cf86967f7e58a1%252Fpa%252FJP78473_8f9579e81b2e2ab4c93b1a9de32c66e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_8f9579e81b2e2ab4c93b1a9de32c66e3.jpg not downloaded yet
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F73%252F26737a75203ef21b15cf86967f7e58a1%252Fpa%252FJP78473_66bc82076f2451965f3ef573bcd12b6e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_66bc82076f2451965f3ef573bcd12b6e.jpg not downloaded yet
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F73%252F26737a75203ef21b15cf86967f7e58a1%252Fpa%252FJP78473_ceb33ef92c023f9a754762d1870a8f60.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_ceb33ef92c023f9a754762d1870a8f60.jpg not downloaded yet
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F73%252F26737a75203ef21b15cf86967f7e58a1%252Fpa%252FJP78473_d1df3ba81d349c8511e5b2ef2dcdbff1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_d1df3ba81d349c8511e5b2ef2dcdbff1.jpg not downloaded yet
2026-03-30 11:18:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:18:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MB90755/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_d1df3ba81d349c8511e5b2ef2dcdbff1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4a7810>
2026-03-30 11:18:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a64a5b1e-1b6f-5717-a2ae-621a881b5a9b/a64a5b1e-1b6f-5717-a2ae-621a881b5a9b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F73%252F26737a75203ef21b15cf86967f7e58a1%252Fpa%252FJP78473_d1df3ba81d349c8511e5b2ef2dcdbff1.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_d1df3ba81d349c8511e5b2ef2dcdbff1.jpg saved to cache
2026-03-30 11:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a64a5b1e-1b6f-5717-a2ae-621a881b5a9b
2026-03-30 11:18:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YP32131> (referer: https://www.auto1.com/v1/car-details-view/YP32131/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9ae4fd2-d78b-54a4-8a0a-53d45e590d60 with identifier: YP32131
2026-03-30 11:18:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9ae4fd2-d78b-54a4-8a0a-53d45e590d60 with scrape type 1
2026-03-30 11:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a9ae4fd2-d78b-54a4-8a0a-53d45e590d60
2026-03-30 11:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F61%252Fd161a3a20ac11f53a8b645a924873fe9%252Fpa%252FYP32131_0f5b3eecf6d27edf938b09fd70d8a1c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/61/d161a3a20ac11f53a8b645a924873fe9/pa/YP32131_0f5b3eecf6d27edf938b09fd70d8a1c1.jpg already downloaded
2026-03-30 11:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F61%252Fd161a3a20ac11f53a8b645a924873fe9%252Fpa%252FYP32131_7888c03d0cb99b5639e95754fc6860cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/61/d161a3a20ac11f53a8b645a924873fe9/pa/YP32131_7888c03d0cb99b5639e95754fc6860cd.jpg already downloaded
2026-03-30 11:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F61%252Fd161a3a20ac11f53a8b645a924873fe9%252Fpa%252FYP32131_0fa6e4772920c4bea825fc11f8852820.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/61/d161a3a20ac11f53a8b645a924873fe9/pa/YP32131_0fa6e4772920c4bea825fc11f8852820.jpg already downloaded
2026-03-30 11:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F61%252Fd161a3a20ac11f53a8b645a924873fe9%252Fpa%252FYP32131_ca45cec499401634f42150838ba26fd8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/61/d161a3a20ac11f53a8b645a924873fe9/pa/YP32131_ca45cec499401634f42150838ba26fd8.jpg already downloaded
2026-03-30 11:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F61%252Fd161a3a20ac11f53a8b645a924873fe9%252Fpa%252FYP32131_4ba07796f912fceea16a1d970f2fbf96.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/61/d161a3a20ac11f53a8b645a924873fe9/pa/YP32131_4ba07796f912fceea16a1d970f2fbf96.jpg already downloaded
2026-03-30 11:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F61%252Fd161a3a20ac11f53a8b645a924873fe9%252Fpa%252FYP32131_934916fd21b2f395b110f2cefb184492.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/61/d161a3a20ac11f53a8b645a924873fe9/pa/YP32131_934916fd21b2f395b110f2cefb184492.jpg already downloaded
2026-03-30 11:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F61%252Fd161a3a20ac11f53a8b645a924873fe9%252Fpa%252FYP32131_a7a683671c57565a588064bae3947326.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/61/d161a3a20ac11f53a8b645a924873fe9/pa/YP32131_a7a683671c57565a588064bae3947326.jpg already downloaded
2026-03-30 11:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F61%252Fd161a3a20ac11f53a8b645a924873fe9%252Fpa%252FYP32131_6dd25162c499d77ebf2b0a89f3c361f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/61/d161a3a20ac11f53a8b645a924873fe9/pa/YP32131_6dd25162c499d77ebf2b0a89f3c361f9.jpg already downloaded
2026-03-30 11:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F61%252Fd161a3a20ac11f53a8b645a924873fe9%252Fpa%252FYP32131_a04b6c6b0c04c8b9d17e5643c56e9bb8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/61/d161a3a20ac11f53a8b645a924873fe9/pa/YP32131_a04b6c6b0c04c8b9d17e5643c56e9bb8.jpg already downloaded
2026-03-30 11:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F61%252Fd161a3a20ac11f53a8b645a924873fe9%252Fpa%252FYP32131_453cc7099ab499f4df930c8d5f481aee.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/61/d161a3a20ac11f53a8b645a924873fe9/pa/YP32131_453cc7099ab499f4df930c8d5f481aee.jpg already downloaded
2026-03-30 11:18:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a9ae4fd2-d78b-54a4-8a0a-53d45e590d60, identifier: YP32131
2026-03-30 11:18:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a9ae4fd2-d78b-54a4-8a0a-53d45e590d60 with identifier: YP32131
2026-03-30 11:18:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a9ae4fd2-d78b-54a4-8a0a-53d45e590d60 with identifier: YP32131
2026-03-30 11:18:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a9ae4fd2-d78b-54a4-8a0a-53d45e590d60 with identifier: YP32131 to the API
2026-03-30 11:18:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YP32131>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': 'Rental',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.0L',
'engine_horse_power': 143,
'expiration_date': '2026-03-31T15:27:08Z',
'fuel_type': 'diesel',
'id': 'a9ae4fd2-d78b-54a4-8a0a-53d45e590d60',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP32131',
'listing': 'auction',
'location': 'ES, La Roda de AndalucÃa',
'make': 'BMW',
'model': '3er',
'odometer': 184820,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgd1/61/d161a3a20ac11f53a8b645a924873fe9/pa/YP32131_0f5b3eecf6d27edf938b09fd70d8a1c1.jpg',
'https://img-pa.auto1.com/imgd1/61/d161a3a20ac11f53a8b645a924873fe9/pa/YP32131_7888c03d0cb99b5639e95754fc6860cd.jpg',
'https://img-pa.auto1.com/imgd1/61/d161a3a20ac11f53a8b645a924873fe9/pa/YP32131_0fa6e4772920c4bea825fc11f8852820.jpg',
'https://img-pa.auto1.com/imgd1/61/d161a3a20ac11f53a8b645a924873fe9/pa/YP32131_ca45cec499401634f42150838ba26fd8.jpg',
'https://img-pa.auto1.com/imgd1/61/d161a3a20ac11f53a8b645a924873fe9/pa/YP32131_4ba07796f912fceea16a1d970f2fbf96.jpg',
'https://img-pa.auto1.com/imgd1/61/d161a3a20ac11f53a8b645a924873fe9/pa/YP32131_934916fd21b2f395b110f2cefb184492.jpg',
'https://img-pa.auto1.com/imgd1/61/d161a3a20ac11f53a8b645a924873fe9/pa/YP32131_a7a683671c57565a588064bae3947326.jpg',
'https://img-pa.auto1.com/imgd1/61/d161a3a20ac11f53a8b645a924873fe9/pa/YP32131_6dd25162c499d77ebf2b0a89f3c361f9.jpg',
'https://img-pa.auto1.com/imgd1/61/d161a3a20ac11f53a8b645a924873fe9/pa/YP32131_a04b6c6b0c04c8b9d17e5643c56e9bb8.jpg',
'https://img-pa.auto1.com/imgd1/61/d161a3a20ac11f53a8b645a924873fe9/pa/YP32131_453cc7099ab499f4df930c8d5f481aee.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ae4fd2-d78b-54a4-8a0a-53d45e590d60/a9ae4fd2-d78b-54a4-8a0a-53d45e590d60_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97781,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd1/61/d161a3a20ac11f53a8b645a924873fe9/pa/YP32131_0f5b3eecf6d27edf938b09fd70d8a1c1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ae4fd2-d78b-54a4-8a0a-53d45e590d60/a9ae4fd2-d78b-54a4-8a0a-53d45e590d60_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88227,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd1/61/d161a3a20ac11f53a8b645a924873fe9/pa/YP32131_7888c03d0cb99b5639e95754fc6860cd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ae4fd2-d78b-54a4-8a0a-53d45e590d60/a9ae4fd2-d78b-54a4-8a0a-53d45e590d60_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67725,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd1/61/d161a3a20ac11f53a8b645a924873fe9/pa/YP32131_0fa6e4772920c4bea825fc11f8852820.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ae4fd2-d78b-54a4-8a0a-53d45e590d60/a9ae4fd2-d78b-54a4-8a0a-53d45e590d60_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64487,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd1/61/d161a3a20ac11f53a8b645a924873fe9/pa/YP32131_ca45cec499401634f42150838ba26fd8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ae4fd2-d78b-54a4-8a0a-53d45e590d60/a9ae4fd2-d78b-54a4-8a0a-53d45e590d60_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74128,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd1/61/d161a3a20ac11f53a8b645a924873fe9/pa/YP32131_4ba07796f912fceea16a1d970f2fbf96.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ae4fd2-d78b-54a4-8a0a-53d45e590d60/a9ae4fd2-d78b-54a4-8a0a-53d45e590d60_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80996,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd1/61/d161a3a20ac11f53a8b645a924873fe9/pa/YP32131_934916fd21b2f395b110f2cefb184492.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ae4fd2-d78b-54a4-8a0a-53d45e590d60/a9ae4fd2-d78b-54a4-8a0a-53d45e590d60_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60982,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd1/61/d161a3a20ac11f53a8b645a924873fe9/pa/YP32131_a7a683671c57565a588064bae3947326.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ae4fd2-d78b-54a4-8a0a-53d45e590d60/a9ae4fd2-d78b-54a4-8a0a-53d45e590d60_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82375,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd1/61/d161a3a20ac11f53a8b645a924873fe9/pa/YP32131_6dd25162c499d77ebf2b0a89f3c361f9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ae4fd2-d78b-54a4-8a0a-53d45e590d60/a9ae4fd2-d78b-54a4-8a0a-53d45e590d60_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88948,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd1/61/d161a3a20ac11f53a8b645a924873fe9/pa/YP32131_a04b6c6b0c04c8b9d17e5643c56e9bb8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ae4fd2-d78b-54a4-8a0a-53d45e590d60/a9ae4fd2-d78b-54a4-8a0a-53d45e590d60_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66011,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd1/61/d161a3a20ac11f53a8b645a924873fe9/pa/YP32131_453cc7099ab499f4df930c8d5f481aee.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-02-12',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 3er 318d',
'transmission': 'manual',
'trim': '',
'year': 2013}
2026-03-30 11:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YP32131%27 HTTP/1.1" 200 None
2026-03-30 11:18:03 [auto1.es] INFO: Saving data for YP32131: {'created_time': 1774869483.841625, 'last_price_update_time': 1774869483.841642, 'auction_closing_time': 1774970828.0}
2026-03-30 11:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YP32131') HTTP/1.1" 204 0
2026-03-30 11:18:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_ceb33ef92c023f9a754762d1870a8f60.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SK77432> (referer: https://www.auto1.com/v1/car-details-view/SK77432/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a49fd50>
2026-03-30 11:18:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a64a5b1e-1b6f-5717-a2ae-621a881b5a9b/a64a5b1e-1b6f-5717-a2ae-621a881b5a9b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F73%252F26737a75203ef21b15cf86967f7e58a1%252Fpa%252FJP78473_ceb33ef92c023f9a754762d1870a8f60.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_ceb33ef92c023f9a754762d1870a8f60.jpg saved to cache
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a64a5b1e-1b6f-5717-a2ae-621a881b5a9b
2026-03-30 11:18:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b01f4f8d-5ddf-586d-b45e-f62e7079f252 with identifier: SK77432
2026-03-30 11:18:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b01f4f8d-5ddf-586d-b45e-f62e7079f252 with scrape type 1
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b01f4f8d-5ddf-586d-b45e-f62e7079f252
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fbc%252F29bce3ada582050267f4a912cebdbbf5%252Fpa%252FSK77432_6fa75333b58d8c23733ae19a5f78bb9a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_6fa75333b58d8c23733ae19a5f78bb9a.jpg not downloaded yet
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fbc%252F29bce3ada582050267f4a912cebdbbf5%252Fpa%252FSK77432_ecbdff65a002bdf8e04b0dd81ce639cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_ecbdff65a002bdf8e04b0dd81ce639cb.jpg not downloaded yet
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fbc%252F29bce3ada582050267f4a912cebdbbf5%252Fpa%252FSK77432_f063b2ff30e3cb3c78d2cc336f68b0fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_f063b2ff30e3cb3c78d2cc336f68b0fd.jpg not downloaded yet
2026-03-30 11:18:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_66bc82076f2451965f3ef573bcd12b6e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fbc%252F29bce3ada582050267f4a912cebdbbf5%252Fpa%252FSK77432_0a8ac85020a36c5e8fe8ce7f3593210e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_0a8ac85020a36c5e8fe8ce7f3593210e.jpg not downloaded yet
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fbc%252F29bce3ada582050267f4a912cebdbbf5%252Fpa%252FSK77432_8c7cf467b4104f16f3e52553572a31e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_8c7cf467b4104f16f3e52553572a31e2.jpg not downloaded yet
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fbc%252F29bce3ada582050267f4a912cebdbbf5%252Fpa%252FSK77432_3551ab081066b443700e16e3feabb815.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_3551ab081066b443700e16e3feabb815.jpg not downloaded yet
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fbc%252F29bce3ada582050267f4a912cebdbbf5%252Fpa%252FSK77432_d8dee92e079a940479d4e2043276e9d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_d8dee92e079a940479d4e2043276e9d4.jpg not downloaded yet
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fbc%252F29bce3ada582050267f4a912cebdbbf5%252Fpa%252FSK77432_85743497e77e7cab72fbe4af5f433841.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_85743497e77e7cab72fbe4af5f433841.jpg not downloaded yet
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fbc%252F29bce3ada582050267f4a912cebdbbf5%252Fpa%252FSK77432_9681b20458ecff83ed7ec5c23afacca1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_9681b20458ecff83ed7ec5c23afacca1.jpg not downloaded yet
2026-03-30 11:18:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_8f9579e81b2e2ab4c93b1a9de32c66e3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fbc%252F29bce3ada582050267f4a912cebdbbf5%252Fpa%252FSK77432_e161e7c161c23e73479c04610393477b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_e161e7c161c23e73479c04610393477b.jpg not downloaded yet
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a460910>
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a64a5b1e-1b6f-5717-a2ae-621a881b5a9b/a64a5b1e-1b6f-5717-a2ae-621a881b5a9b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F73%252F26737a75203ef21b15cf86967f7e58a1%252Fpa%252FJP78473_66bc82076f2451965f3ef573bcd12b6e.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_66bc82076f2451965f3ef573bcd12b6e.jpg saved to cache
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a64a5b1e-1b6f-5717-a2ae-621a881b5a9b
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060eb50d0>
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a64a5b1e-1b6f-5717-a2ae-621a881b5a9b/a64a5b1e-1b6f-5717-a2ae-621a881b5a9b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F73%252F26737a75203ef21b15cf86967f7e58a1%252Fpa%252FJP78473_8f9579e81b2e2ab4c93b1a9de32c66e3.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_8f9579e81b2e2ab4c93b1a9de32c66e3.jpg saved to cache
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a64a5b1e-1b6f-5717-a2ae-621a881b5a9b
2026-03-30 11:18:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_9681b20458ecff83ed7ec5c23afacca1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_f063b2ff30e3cb3c78d2cc336f68b0fd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_e161e7c161c23e73479c04610393477b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_d8dee92e079a940479d4e2043276e9d4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_3551ab081066b443700e16e3feabb815.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05aed5710>
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b01f4f8d-5ddf-586d-b45e-f62e7079f252/b01f4f8d-5ddf-586d-b45e-f62e7079f252_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fbc%252F29bce3ada582050267f4a912cebdbbf5%252Fpa%252FSK77432_9681b20458ecff83ed7ec5c23afacca1.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_9681b20458ecff83ed7ec5c23afacca1.jpg saved to cache
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b01f4f8d-5ddf-586d-b45e-f62e7079f252
2026-03-30 11:18:04 [scrapy.extensions.logstats] INFO: Crawled 50 pages (at 18 pages/min), scraped 23 items (at 3 items/min)
2026-03-30 11:18:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 159MiB
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060eb7850>
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b01f4f8d-5ddf-586d-b45e-f62e7079f252/b01f4f8d-5ddf-586d-b45e-f62e7079f252_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fbc%252F29bce3ada582050267f4a912cebdbbf5%252Fpa%252FSK77432_f063b2ff30e3cb3c78d2cc336f68b0fd.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_f063b2ff30e3cb3c78d2cc336f68b0fd.jpg saved to cache
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b01f4f8d-5ddf-586d-b45e-f62e7079f252
2026-03-30 11:18:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_8c7cf467b4104f16f3e52553572a31e2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad1c2d0>
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b01f4f8d-5ddf-586d-b45e-f62e7079f252/b01f4f8d-5ddf-586d-b45e-f62e7079f252_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fbc%252F29bce3ada582050267f4a912cebdbbf5%252Fpa%252FSK77432_e161e7c161c23e73479c04610393477b.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_e161e7c161c23e73479c04610393477b.jpg saved to cache
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b01f4f8d-5ddf-586d-b45e-f62e7079f252
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4efc90>
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b01f4f8d-5ddf-586d-b45e-f62e7079f252/b01f4f8d-5ddf-586d-b45e-f62e7079f252_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fbc%252F29bce3ada582050267f4a912cebdbbf5%252Fpa%252FSK77432_d8dee92e079a940479d4e2043276e9d4.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_d8dee92e079a940479d4e2043276e9d4.jpg saved to cache
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b01f4f8d-5ddf-586d-b45e-f62e7079f252
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ae72e90>
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b01f4f8d-5ddf-586d-b45e-f62e7079f252/b01f4f8d-5ddf-586d-b45e-f62e7079f252_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fbc%252F29bce3ada582050267f4a912cebdbbf5%252Fpa%252FSK77432_3551ab081066b443700e16e3feabb815.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_3551ab081066b443700e16e3feabb815.jpg saved to cache
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b01f4f8d-5ddf-586d-b45e-f62e7079f252
2026-03-30 11:18:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_85743497e77e7cab72fbe4af5f433841.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_0a8ac85020a36c5e8fe8ce7f3593210e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a47f890>
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b01f4f8d-5ddf-586d-b45e-f62e7079f252/b01f4f8d-5ddf-586d-b45e-f62e7079f252_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fbc%252F29bce3ada582050267f4a912cebdbbf5%252Fpa%252FSK77432_8c7cf467b4104f16f3e52553572a31e2.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_8c7cf467b4104f16f3e52553572a31e2.jpg saved to cache
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b01f4f8d-5ddf-586d-b45e-f62e7079f252
2026-03-30 11:18:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_6fa75333b58d8c23733ae19a5f78bb9a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AJ27440> (referer: https://www.auto1.com/v1/car-details-view/AJ27440/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4b6810>
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b01f4f8d-5ddf-586d-b45e-f62e7079f252/b01f4f8d-5ddf-586d-b45e-f62e7079f252_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fbc%252F29bce3ada582050267f4a912cebdbbf5%252Fpa%252FSK77432_85743497e77e7cab72fbe4af5f433841.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_85743497e77e7cab72fbe4af5f433841.jpg saved to cache
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b01f4f8d-5ddf-586d-b45e-f62e7079f252
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4fb890>
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b01f4f8d-5ddf-586d-b45e-f62e7079f252/b01f4f8d-5ddf-586d-b45e-f62e7079f252_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fbc%252F29bce3ada582050267f4a912cebdbbf5%252Fpa%252FSK77432_0a8ac85020a36c5e8fe8ce7f3593210e.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_0a8ac85020a36c5e8fe8ce7f3593210e.jpg saved to cache
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b01f4f8d-5ddf-586d-b45e-f62e7079f252
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a47df90>
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b01f4f8d-5ddf-586d-b45e-f62e7079f252/b01f4f8d-5ddf-586d-b45e-f62e7079f252_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fbc%252F29bce3ada582050267f4a912cebdbbf5%252Fpa%252FSK77432_6fa75333b58d8c23733ae19a5f78bb9a.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_6fa75333b58d8c23733ae19a5f78bb9a.jpg saved to cache
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b01f4f8d-5ddf-586d-b45e-f62e7079f252
2026-03-30 11:18:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9296e2d0-9f58-5387-86ce-068c64ebd94a with identifier: AJ27440
2026-03-30 11:18:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9296e2d0-9f58-5387-86ce-068c64ebd94a with scrape type 1
2026-03-30 11:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9296e2d0-9f58-5387-86ce-068c64ebd94a
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fba%252F6dba77244f2196dcbdf72f8784108dce%252Fpa%252FAJ27440_c70515315b77573a474b9bc4e6c0bc4d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_c70515315b77573a474b9bc4e6c0bc4d.jpg not downloaded yet
2026-03-30 11:18:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_ecbdff65a002bdf8e04b0dd81ce639cb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fba%252F6dba77244f2196dcbdf72f8784108dce%252Fpa%252FAJ27440_95ebc6d98a036b8a3d3463f061f1bc0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_95ebc6d98a036b8a3d3463f061f1bc0e.jpg not downloaded yet
2026-03-30 11:18:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_815a3138442481fb016b89b55774109f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fba%252F6dba77244f2196dcbdf72f8784108dce%252Fpa%252FAJ27440_ed2721f65127c2d81566753efd588d12.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_ed2721f65127c2d81566753efd588d12.jpg not downloaded yet
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fba%252F6dba77244f2196dcbdf72f8784108dce%252Fpa%252FAJ27440_2e04ea7b51c4a46a124037b288bb6329.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_2e04ea7b51c4a46a124037b288bb6329.jpg not downloaded yet
2026-03-30 11:18:05 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.450(s), this was the 1st time calling it.
2026-03-30 11:18:05 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.259823190383133 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:18:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_c70515315b77573a474b9bc4e6c0bc4d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fba%252F6dba77244f2196dcbdf72f8784108dce%252Fpa%252FAJ27440_17a7884b36765efaa909b8b336ae2bde.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_17a7884b36765efaa909b8b336ae2bde.jpg not downloaded yet
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fba%252F6dba77244f2196dcbdf72f8784108dce%252Fpa%252FAJ27440_ed0c34932f22a3d377d4c04fe419c26f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_ed0c34932f22a3d377d4c04fe419c26f.jpg not downloaded yet
2026-03-30 11:18:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060fefd50>
2026-03-30 11:18:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b01f4f8d-5ddf-586d-b45e-f62e7079f252/b01f4f8d-5ddf-586d-b45e-f62e7079f252_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fbc%252F29bce3ada582050267f4a912cebdbbf5%252Fpa%252FSK77432_ecbdff65a002bdf8e04b0dd81ce639cb.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_ecbdff65a002bdf8e04b0dd81ce639cb.jpg saved to cache
2026-03-30 11:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b01f4f8d-5ddf-586d-b45e-f62e7079f252
2026-03-30 11:18:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b01f4f8d-5ddf-586d-b45e-f62e7079f252, skipping ID generation
2026-03-30 11:18:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b01f4f8d-5ddf-586d-b45e-f62e7079f252 with scrape type 1
2026-03-30 11:18:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b01f4f8d-5ddf-586d-b45e-f62e7079f252 sending to next pipeline
2026-03-30 11:18:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b01f4f8d-5ddf-586d-b45e-f62e7079f252, identifier: SK77432
2026-03-30 11:18:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b01f4f8d-5ddf-586d-b45e-f62e7079f252 with identifier: SK77432
2026-03-30 11:18:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b01f4f8d-5ddf-586d-b45e-f62e7079f252 with identifier: SK77432
2026-03-30 11:18:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b01f4f8d-5ddf-586d-b45e-f62e7079f252 with identifier: SK77432 to the API
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_ecbdff65a002bdf8e04b0dd81ce639cb.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.2L',
'engine_horse_power': 125,
'expiration_date': '2026-03-31T15:42:44Z',
'fuel_type': 'diesel',
'id': 'b01f4f8d-5ddf-586d-b45e-f62e7079f252',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK77432',
'listing': 'auction',
'location': 'ES',
'make': 'Opel',
'model': 'Vectra',
'odometer': 297251,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 14,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b01f4f8d-5ddf-586d-b45e-f62e7079f252/b01f4f8d-5ddf-586d-b45e-f62e7079f252_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82346,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_6fa75333b58d8c23733ae19a5f78bb9a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b01f4f8d-5ddf-586d-b45e-f62e7079f252/b01f4f8d-5ddf-586d-b45e-f62e7079f252_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75390,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_ecbdff65a002bdf8e04b0dd81ce639cb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b01f4f8d-5ddf-586d-b45e-f62e7079f252/b01f4f8d-5ddf-586d-b45e-f62e7079f252_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79148,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_f063b2ff30e3cb3c78d2cc336f68b0fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b01f4f8d-5ddf-586d-b45e-f62e7079f252/b01f4f8d-5ddf-586d-b45e-f62e7079f252_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67591,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_0a8ac85020a36c5e8fe8ce7f3593210e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b01f4f8d-5ddf-586d-b45e-f62e7079f252/b01f4f8d-5ddf-586d-b45e-f62e7079f252_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79695,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_8c7cf467b4104f16f3e52553572a31e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b01f4f8d-5ddf-586d-b45e-f62e7079f252/b01f4f8d-5ddf-586d-b45e-f62e7079f252_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75306,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_3551ab081066b443700e16e3feabb815.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b01f4f8d-5ddf-586d-b45e-f62e7079f252/b01f4f8d-5ddf-586d-b45e-f62e7079f252_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84692,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_d8dee92e079a940479d4e2043276e9d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b01f4f8d-5ddf-586d-b45e-f62e7079f252/b01f4f8d-5ddf-586d-b45e-f62e7079f252_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113107,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_85743497e77e7cab72fbe4af5f433841.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b01f4f8d-5ddf-586d-b45e-f62e7079f252/b01f4f8d-5ddf-586d-b45e-f62e7079f252_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93410,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_9681b20458ecff83ed7ec5c23afacca1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b01f4f8d-5ddf-586d-b45e-f62e7079f252/b01f4f8d-5ddf-586d-b45e-f62e7079f252_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57237,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/bc/29bce3ada582050267f4a912cebdbbf5/pa/SK77432_e161e7c161c23e73479c04610393477b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2004-02-23',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Vectra 2.2 DTI Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2004}
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SK77432%27 HTTP/1.1" 200 None
2026-03-30 11:18:05 [auto1.es] INFO: Saving data for SK77432: {'created_time': 1774869485.810354, 'last_price_update_time': 1774869485.810365, 'auction_closing_time': 1774971764.0}
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SK77432') HTTP/1.1" 204 0
2026-03-30 11:18:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_bec3b78d9b3c843c912dcd8cd713682b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_db3fdd3dfe1316dc60b2fc21b9f55f0e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_ed2721f65127c2d81566753efd588d12.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fba%252F6dba77244f2196dcbdf72f8784108dce%252Fpa%252FAJ27440_bba773fee14e6710984cce1d5c1d6153.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_bba773fee14e6710984cce1d5c1d6153.jpg not downloaded yet
2026-03-30 11:18:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad884d0>
2026-03-30 11:18:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a64a5b1e-1b6f-5717-a2ae-621a881b5a9b/a64a5b1e-1b6f-5717-a2ae-621a881b5a9b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F73%252F26737a75203ef21b15cf86967f7e58a1%252Fpa%252FJP78473_815a3138442481fb016b89b55774109f.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_815a3138442481fb016b89b55774109f.jpg saved to cache
2026-03-30 11:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a64a5b1e-1b6f-5717-a2ae-621a881b5a9b
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fba%252F6dba77244f2196dcbdf72f8784108dce%252Fpa%252FAJ27440_f220d1183b255dce0f97773db00a91b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_f220d1183b255dce0f97773db00a91b8.jpg not downloaded yet
2026-03-30 11:18:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a300090>
2026-03-30 11:18:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9296e2d0-9f58-5387-86ce-068c64ebd94a/9296e2d0-9f58-5387-86ce-068c64ebd94a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fba%252F6dba77244f2196dcbdf72f8784108dce%252Fpa%252FAJ27440_c70515315b77573a474b9bc4e6c0bc4d.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_c70515315b77573a474b9bc4e6c0bc4d.jpg saved to cache
2026-03-30 11:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9296e2d0-9f58-5387-86ce-068c64ebd94a
2026-03-30 11:18:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_17a7884b36765efaa909b8b336ae2bde.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fba%252F6dba77244f2196dcbdf72f8784108dce%252Fpa%252FAJ27440_f964d455e3b3af44522d3eec66c4cb83.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_f964d455e3b3af44522d3eec66c4cb83.jpg not downloaded yet
2026-03-30 11:18:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_ed0c34932f22a3d377d4c04fe419c26f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fba%252F6dba77244f2196dcbdf72f8784108dce%252Fpa%252FAJ27440_6a659c978f61e46df31fb57c0a7644a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_6a659c978f61e46df31fb57c0a7644a3.jpg not downloaded yet
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4818d0>
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a64a5b1e-1b6f-5717-a2ae-621a881b5a9b/a64a5b1e-1b6f-5717-a2ae-621a881b5a9b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F73%252F26737a75203ef21b15cf86967f7e58a1%252Fpa%252FJP78473_bec3b78d9b3c843c912dcd8cd713682b.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_bec3b78d9b3c843c912dcd8cd713682b.jpg saved to cache
2026-03-30 11:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a64a5b1e-1b6f-5717-a2ae-621a881b5a9b
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a35cb10>
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a64a5b1e-1b6f-5717-a2ae-621a881b5a9b/a64a5b1e-1b6f-5717-a2ae-621a881b5a9b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F73%252F26737a75203ef21b15cf86967f7e58a1%252Fpa%252FJP78473_db3fdd3dfe1316dc60b2fc21b9f55f0e.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_db3fdd3dfe1316dc60b2fc21b9f55f0e.jpg saved to cache
2026-03-30 11:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a64a5b1e-1b6f-5717-a2ae-621a881b5a9b
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a35fe50>
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9296e2d0-9f58-5387-86ce-068c64ebd94a/9296e2d0-9f58-5387-86ce-068c64ebd94a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fba%252F6dba77244f2196dcbdf72f8784108dce%252Fpa%252FAJ27440_ed2721f65127c2d81566753efd588d12.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_ed2721f65127c2d81566753efd588d12.jpg saved to cache
2026-03-30 11:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9296e2d0-9f58-5387-86ce-068c64ebd94a
2026-03-30 11:18:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_2e04ea7b51c4a46a124037b288bb6329.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_f220d1183b255dce0f97773db00a91b8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a358410>
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9296e2d0-9f58-5387-86ce-068c64ebd94a/9296e2d0-9f58-5387-86ce-068c64ebd94a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fba%252F6dba77244f2196dcbdf72f8784108dce%252Fpa%252FAJ27440_17a7884b36765efaa909b8b336ae2bde.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_17a7884b36765efaa909b8b336ae2bde.jpg saved to cache
2026-03-30 11:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9296e2d0-9f58-5387-86ce-068c64ebd94a
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a433550>
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9296e2d0-9f58-5387-86ce-068c64ebd94a/9296e2d0-9f58-5387-86ce-068c64ebd94a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fba%252F6dba77244f2196dcbdf72f8784108dce%252Fpa%252FAJ27440_ed0c34932f22a3d377d4c04fe419c26f.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_ed0c34932f22a3d377d4c04fe419c26f.jpg saved to cache
2026-03-30 11:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9296e2d0-9f58-5387-86ce-068c64ebd94a
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a48e590>
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9296e2d0-9f58-5387-86ce-068c64ebd94a/9296e2d0-9f58-5387-86ce-068c64ebd94a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fba%252F6dba77244f2196dcbdf72f8784108dce%252Fpa%252FAJ27440_2e04ea7b51c4a46a124037b288bb6329.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_2e04ea7b51c4a46a124037b288bb6329.jpg saved to cache
2026-03-30 11:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9296e2d0-9f58-5387-86ce-068c64ebd94a
2026-03-30 11:18:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_bba773fee14e6710984cce1d5c1d6153.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060cffe90>
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9296e2d0-9f58-5387-86ce-068c64ebd94a/9296e2d0-9f58-5387-86ce-068c64ebd94a_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fba%252F6dba77244f2196dcbdf72f8784108dce%252Fpa%252FAJ27440_f220d1183b255dce0f97773db00a91b8.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_f220d1183b255dce0f97773db00a91b8.jpg saved to cache
2026-03-30 11:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9296e2d0-9f58-5387-86ce-068c64ebd94a
2026-03-30 11:18:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_f964d455e3b3af44522d3eec66c4cb83.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_95ebc6d98a036b8a3d3463f061f1bc0e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05aebab10>
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9296e2d0-9f58-5387-86ce-068c64ebd94a/9296e2d0-9f58-5387-86ce-068c64ebd94a_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fba%252F6dba77244f2196dcbdf72f8784108dce%252Fpa%252FAJ27440_bba773fee14e6710984cce1d5c1d6153.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_bba773fee14e6710984cce1d5c1d6153.jpg saved to cache
2026-03-30 11:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9296e2d0-9f58-5387-86ce-068c64ebd94a
2026-03-30 11:18:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_6a659c978f61e46df31fb57c0a7644a3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a345150>
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9296e2d0-9f58-5387-86ce-068c64ebd94a/9296e2d0-9f58-5387-86ce-068c64ebd94a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fba%252F6dba77244f2196dcbdf72f8784108dce%252Fpa%252FAJ27440_f964d455e3b3af44522d3eec66c4cb83.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_f964d455e3b3af44522d3eec66c4cb83.jpg saved to cache
2026-03-30 11:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9296e2d0-9f58-5387-86ce-068c64ebd94a
2026-03-30 11:18:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_549e3de9e4c23bb7101b63b789b0d414.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a457ed0>
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9296e2d0-9f58-5387-86ce-068c64ebd94a/9296e2d0-9f58-5387-86ce-068c64ebd94a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fba%252F6dba77244f2196dcbdf72f8784108dce%252Fpa%252FAJ27440_95ebc6d98a036b8a3d3463f061f1bc0e.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_95ebc6d98a036b8a3d3463f061f1bc0e.jpg saved to cache
2026-03-30 11:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9296e2d0-9f58-5387-86ce-068c64ebd94a
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a432150>
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9296e2d0-9f58-5387-86ce-068c64ebd94a/9296e2d0-9f58-5387-86ce-068c64ebd94a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fba%252F6dba77244f2196dcbdf72f8784108dce%252Fpa%252FAJ27440_6a659c978f61e46df31fb57c0a7644a3.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_6a659c978f61e46df31fb57c0a7644a3.jpg saved to cache
2026-03-30 11:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9296e2d0-9f58-5387-86ce-068c64ebd94a
2026-03-30 11:18:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9296e2d0-9f58-5387-86ce-068c64ebd94a, skipping ID generation
2026-03-30 11:18:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9296e2d0-9f58-5387-86ce-068c64ebd94a with scrape type 1
2026-03-30 11:18:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9296e2d0-9f58-5387-86ce-068c64ebd94a sending to next pipeline
2026-03-30 11:18:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9296e2d0-9f58-5387-86ce-068c64ebd94a, identifier: AJ27440
2026-03-30 11:18:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9296e2d0-9f58-5387-86ce-068c64ebd94a with identifier: AJ27440
2026-03-30 11:18:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9296e2d0-9f58-5387-86ce-068c64ebd94a with identifier: AJ27440
2026-03-30 11:18:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9296e2d0-9f58-5387-86ce-068c64ebd94a with identifier: AJ27440 to the API
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_6a659c978f61e46df31fb57c0a7644a3.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.9L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:58:05Z',
'fuel_type': 'diesel',
'id': '9296e2d0-9f58-5387-86ce-068c64ebd94a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ27440',
'listing': 'auction',
'location': 'ES',
'make': 'Seat',
'model': 'Leon',
'odometer': 284153,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9296e2d0-9f58-5387-86ce-068c64ebd94a/9296e2d0-9f58-5387-86ce-068c64ebd94a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73941,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_c70515315b77573a474b9bc4e6c0bc4d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9296e2d0-9f58-5387-86ce-068c64ebd94a/9296e2d0-9f58-5387-86ce-068c64ebd94a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46040,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_95ebc6d98a036b8a3d3463f061f1bc0e.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9296e2d0-9f58-5387-86ce-068c64ebd94a/9296e2d0-9f58-5387-86ce-068c64ebd94a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48439,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_ed2721f65127c2d81566753efd588d12.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9296e2d0-9f58-5387-86ce-068c64ebd94a/9296e2d0-9f58-5387-86ce-068c64ebd94a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43240,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_2e04ea7b51c4a46a124037b288bb6329.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9296e2d0-9f58-5387-86ce-068c64ebd94a/9296e2d0-9f58-5387-86ce-068c64ebd94a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45275,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_17a7884b36765efaa909b8b336ae2bde.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9296e2d0-9f58-5387-86ce-068c64ebd94a/9296e2d0-9f58-5387-86ce-068c64ebd94a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48695,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_ed0c34932f22a3d377d4c04fe419c26f.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9296e2d0-9f58-5387-86ce-068c64ebd94a/9296e2d0-9f58-5387-86ce-068c64ebd94a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44889,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_bba773fee14e6710984cce1d5c1d6153.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9296e2d0-9f58-5387-86ce-068c64ebd94a/9296e2d0-9f58-5387-86ce-068c64ebd94a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58572,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_f220d1183b255dce0f97773db00a91b8.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9296e2d0-9f58-5387-86ce-068c64ebd94a/9296e2d0-9f58-5387-86ce-068c64ebd94a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41699,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_f964d455e3b3af44522d3eec66c4cb83.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9296e2d0-9f58-5387-86ce-068c64ebd94a/9296e2d0-9f58-5387-86ce-068c64ebd94a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 28132,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/ba/6dba77244f2196dcbdf72f8784108dce/pa/AJ27440_6a659c978f61e46df31fb57c0a7644a3.jpg',
'Width': 450}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2005-09-14',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Leon 1.9 TDI FR Special Edition',
'transmission': 'manual',
'trim': 'FR Special Edition',
'year': 2005}
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ27440%27 HTTP/1.1" 200 None
2026-03-30 11:18:07 [auto1.es] INFO: Saving data for AJ27440: {'created_time': 1774869487.204964, 'last_price_update_time': 1774869487.204975, 'auction_closing_time': 1774972685.0}
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AJ27440') HTTP/1.1" 204 0
2026-03-30 11:18:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_88157955b899a12cdc63218b462c2414.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_b765709eb653cdbf7d8681358d9fdf74.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a456d50>
2026-03-30 11:18:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a64a5b1e-1b6f-5717-a2ae-621a881b5a9b/a64a5b1e-1b6f-5717-a2ae-621a881b5a9b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F73%252F26737a75203ef21b15cf86967f7e58a1%252Fpa%252FJP78473_549e3de9e4c23bb7101b63b789b0d414.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_549e3de9e4c23bb7101b63b789b0d414.jpg saved to cache
2026-03-30 11:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a64a5b1e-1b6f-5717-a2ae-621a881b5a9b
2026-03-30 11:18:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060fe95d0>
2026-03-30 11:18:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a64a5b1e-1b6f-5717-a2ae-621a881b5a9b/a64a5b1e-1b6f-5717-a2ae-621a881b5a9b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F73%252F26737a75203ef21b15cf86967f7e58a1%252Fpa%252FJP78473_88157955b899a12cdc63218b462c2414.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_88157955b899a12cdc63218b462c2414.jpg saved to cache
2026-03-30 11:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a64a5b1e-1b6f-5717-a2ae-621a881b5a9b
2026-03-30 11:18:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a36c210>
2026-03-30 11:18:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a64a5b1e-1b6f-5717-a2ae-621a881b5a9b/a64a5b1e-1b6f-5717-a2ae-621a881b5a9b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F73%252F26737a75203ef21b15cf86967f7e58a1%252Fpa%252FJP78473_b765709eb653cdbf7d8681358d9fdf74.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_b765709eb653cdbf7d8681358d9fdf74.jpg saved to cache
2026-03-30 11:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a64a5b1e-1b6f-5717-a2ae-621a881b5a9b
2026-03-30 11:18:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a64a5b1e-1b6f-5717-a2ae-621a881b5a9b, skipping ID generation
2026-03-30 11:18:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a64a5b1e-1b6f-5717-a2ae-621a881b5a9b with scrape type 1
2026-03-30 11:18:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a64a5b1e-1b6f-5717-a2ae-621a881b5a9b sending to next pipeline
2026-03-30 11:18:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a64a5b1e-1b6f-5717-a2ae-621a881b5a9b, identifier: JP78473
2026-03-30 11:18:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a64a5b1e-1b6f-5717-a2ae-621a881b5a9b with identifier: JP78473
2026-03-30 11:18:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a64a5b1e-1b6f-5717-a2ae-621a881b5a9b with identifier: JP78473
2026-03-30 11:18:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a64a5b1e-1b6f-5717-a2ae-621a881b5a9b with identifier: JP78473 to the API
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_b765709eb653cdbf7d8681358d9fdf74.jpg>
{'auction_title': '',
'c_o_2_emission_value': 190,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 170,
'expiration_date': '2026-03-31T15:26:25Z',
'fuel_type': 'petrol',
'id': 'a64a5b1e-1b6f-5717-a2ae-621a881b5a9b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP78473',
'listing': 'auction',
'location': 'ES, Cornellà de Llobregat',
'make': 'Jeep',
'model': 'Compass',
'odometer': 67822,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a64a5b1e-1b6f-5717-a2ae-621a881b5a9b/a64a5b1e-1b6f-5717-a2ae-621a881b5a9b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80179,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_549e3de9e4c23bb7101b63b789b0d414.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a64a5b1e-1b6f-5717-a2ae-621a881b5a9b/a64a5b1e-1b6f-5717-a2ae-621a881b5a9b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77359,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_b765709eb653cdbf7d8681358d9fdf74.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a64a5b1e-1b6f-5717-a2ae-621a881b5a9b/a64a5b1e-1b6f-5717-a2ae-621a881b5a9b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73161,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_88157955b899a12cdc63218b462c2414.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a64a5b1e-1b6f-5717-a2ae-621a881b5a9b/a64a5b1e-1b6f-5717-a2ae-621a881b5a9b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58587,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_db3fdd3dfe1316dc60b2fc21b9f55f0e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a64a5b1e-1b6f-5717-a2ae-621a881b5a9b/a64a5b1e-1b6f-5717-a2ae-621a881b5a9b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63652,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_bec3b78d9b3c843c912dcd8cd713682b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a64a5b1e-1b6f-5717-a2ae-621a881b5a9b/a64a5b1e-1b6f-5717-a2ae-621a881b5a9b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73222,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_815a3138442481fb016b89b55774109f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a64a5b1e-1b6f-5717-a2ae-621a881b5a9b/a64a5b1e-1b6f-5717-a2ae-621a881b5a9b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64127,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_8f9579e81b2e2ab4c93b1a9de32c66e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a64a5b1e-1b6f-5717-a2ae-621a881b5a9b/a64a5b1e-1b6f-5717-a2ae-621a881b5a9b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72835,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_66bc82076f2451965f3ef573bcd12b6e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a64a5b1e-1b6f-5717-a2ae-621a881b5a9b/a64a5b1e-1b6f-5717-a2ae-621a881b5a9b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79828,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_ceb33ef92c023f9a754762d1870a8f60.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a64a5b1e-1b6f-5717-a2ae-621a881b5a9b/a64a5b1e-1b6f-5717-a2ae-621a881b5a9b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55743,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/73/26737a75203ef21b15cf86967f7e58a1/pa/JP78473_d1df3ba81d349c8511e5b2ef2dcdbff1.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-05-28',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Compass 1.4 M-Air Limited 4WD',
'transmission': 'automatic',
'trim': 'Limited 4WD',
'year': 2020}
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JP78473%27 HTTP/1.1" 200 None
2026-03-30 11:18:07 [auto1.es] INFO: Saving data for JP78473: {'created_time': 1774869487.961267, 'last_price_update_time': 1774869487.961279, 'auction_closing_time': 1774970785.0}
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JP78473') HTTP/1.1" 204 0
2026-03-30 11:18:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JN94907> (referer: https://www.auto1.com/v1/car-details-view/JN94907/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HC40345> (referer: https://www.auto1.com/v1/car-details-view/HC40345/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45e6050c-a98a-5f4b-a45d-3f0e1698c9f0 with identifier: JN94907
2026-03-30 11:18:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45e6050c-a98a-5f4b-a45d-3f0e1698c9f0 with scrape type 1
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 45e6050c-a98a-5f4b-a45d-3f0e1698c9f0
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Faa%252F59aa91c0203e1cce1ab455e14bc6cdd5%252Fpa%252FJN94907_17f859c647f4257b80ab4d6bda7fec1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_17f859c647f4257b80ab4d6bda7fec1b.jpg not downloaded yet
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Faa%252F59aa91c0203e1cce1ab455e14bc6cdd5%252Fpa%252FJN94907_753b10999015f14e3bbef1cc1ed77f71.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_753b10999015f14e3bbef1cc1ed77f71.jpg not downloaded yet
2026-03-30 11:18:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Faa%252F59aa91c0203e1cce1ab455e14bc6cdd5%252Fpa%252FJN94907_03a12b126eae11b3578bd2834e98c82c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_03a12b126eae11b3578bd2834e98c82c.jpg not downloaded yet
2026-03-30 11:18:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b73ad31d-8c23-5056-853d-605882a20d79 with identifier: HC40345
2026-03-30 11:18:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b73ad31d-8c23-5056-853d-605882a20d79 with scrape type 1
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b73ad31d-8c23-5056-853d-605882a20d79
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F73%252F0e73d011a79f4ec6c3b49a4572bf1d1e%252Fpa%252FHC40345_b7462e61204a4f06caf7d42650e4cb24.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_b7462e61204a4f06caf7d42650e4cb24.jpg not downloaded yet
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Faa%252F59aa91c0203e1cce1ab455e14bc6cdd5%252Fpa%252FJN94907_5a71ffda2c2c14f54d129f62b3667b3b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_5a71ffda2c2c14f54d129f62b3667b3b.jpg not downloaded yet
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F73%252F0e73d011a79f4ec6c3b49a4572bf1d1e%252Fpa%252FHC40345_dddba361ddc76dc4a28c787bbf83b2e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_dddba361ddc76dc4a28c787bbf83b2e3.jpg not downloaded yet
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Faa%252F59aa91c0203e1cce1ab455e14bc6cdd5%252Fpa%252FJN94907_fa3e991be586c306fed10457e93ccf75.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_fa3e991be586c306fed10457e93ccf75.jpg not downloaded yet
2026-03-30 11:18:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_17f859c647f4257b80ab4d6bda7fec1b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F73%252F0e73d011a79f4ec6c3b49a4572bf1d1e%252Fpa%252FHC40345_93ea7d1d5569b5bab3550bf742896f44.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_93ea7d1d5569b5bab3550bf742896f44.jpg not downloaded yet
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Faa%252F59aa91c0203e1cce1ab455e14bc6cdd5%252Fpa%252FJN94907_b236bf5545827aef5f91f7fbaa97bf45.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_b236bf5545827aef5f91f7fbaa97bf45.jpg not downloaded yet
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F73%252F0e73d011a79f4ec6c3b49a4572bf1d1e%252Fpa%252FHC40345_082b2106fec64a73a947e8639b51df0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_082b2106fec64a73a947e8639b51df0e.jpg not downloaded yet
2026-03-30 11:18:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_03a12b126eae11b3578bd2834e98c82c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Faa%252F59aa91c0203e1cce1ab455e14bc6cdd5%252Fpa%252FJN94907_235775b7828c9bbbc9d0a46000a544b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_235775b7828c9bbbc9d0a46000a544b6.jpg not downloaded yet
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F73%252F0e73d011a79f4ec6c3b49a4572bf1d1e%252Fpa%252FHC40345_322113f67af14ac0a2bd353b1baf4cad.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_322113f67af14ac0a2bd353b1baf4cad.jpg not downloaded yet
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Faa%252F59aa91c0203e1cce1ab455e14bc6cdd5%252Fpa%252FJN94907_63fdff336eb4d102bf4e2c3cb2e75c3d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_63fdff336eb4d102bf4e2c3cb2e75c3d.jpg not downloaded yet
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F73%252F0e73d011a79f4ec6c3b49a4572bf1d1e%252Fpa%252FHC40345_6f80de3e116e2af276a9354f49fc190d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_6f80de3e116e2af276a9354f49fc190d.jpg not downloaded yet
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Faa%252F59aa91c0203e1cce1ab455e14bc6cdd5%252Fpa%252FJN94907_6e63aebf0be1c7cd2bc96184d68736c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_6e63aebf0be1c7cd2bc96184d68736c6.jpg not downloaded yet
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F73%252F0e73d011a79f4ec6c3b49a4572bf1d1e%252Fpa%252FHC40345_08842590fd4b37eaff3b89c47ca7d8cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_08842590fd4b37eaff3b89c47ca7d8cd.jpg not downloaded yet
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Faa%252F59aa91c0203e1cce1ab455e14bc6cdd5%252Fpa%252FJN94907_cb9722b7d2f54a7598cd7a4193556007.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_cb9722b7d2f54a7598cd7a4193556007.jpg not downloaded yet
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05aed7d50>
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45e6050c-a98a-5f4b-a45d-3f0e1698c9f0/45e6050c-a98a-5f4b-a45d-3f0e1698c9f0_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Faa%252F59aa91c0203e1cce1ab455e14bc6cdd5%252Fpa%252FJN94907_17f859c647f4257b80ab4d6bda7fec1b.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_17f859c647f4257b80ab4d6bda7fec1b.jpg saved to cache
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 45e6050c-a98a-5f4b-a45d-3f0e1698c9f0
2026-03-30 11:18:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_082b2106fec64a73a947e8639b51df0e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_753b10999015f14e3bbef1cc1ed77f71.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F73%252F0e73d011a79f4ec6c3b49a4572bf1d1e%252Fpa%252FHC40345_6d20c3cca05f181a57dba4adbbf6f327.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_6d20c3cca05f181a57dba4adbbf6f327.jpg not downloaded yet
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ae80350>
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45e6050c-a98a-5f4b-a45d-3f0e1698c9f0/45e6050c-a98a-5f4b-a45d-3f0e1698c9f0_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Faa%252F59aa91c0203e1cce1ab455e14bc6cdd5%252Fpa%252FJN94907_03a12b126eae11b3578bd2834e98c82c.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_03a12b126eae11b3578bd2834e98c82c.jpg saved to cache
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 45e6050c-a98a-5f4b-a45d-3f0e1698c9f0
2026-03-30 11:18:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_fa3e991be586c306fed10457e93ccf75.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F73%252F0e73d011a79f4ec6c3b49a4572bf1d1e%252Fpa%252FHC40345_1773ed27c585065ac8945f36e38ed2d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_1773ed27c585065ac8945f36e38ed2d0.jpg not downloaded yet
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F73%252F0e73d011a79f4ec6c3b49a4572bf1d1e%252Fpa%252FHC40345_59d809496c32a9063b0a0037dd167628.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_59d809496c32a9063b0a0037dd167628.jpg not downloaded yet
2026-03-30 11:18:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_b7462e61204a4f06caf7d42650e4cb24.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060ff0350>
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b73ad31d-8c23-5056-853d-605882a20d79/b73ad31d-8c23-5056-853d-605882a20d79_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F73%252F0e73d011a79f4ec6c3b49a4572bf1d1e%252Fpa%252FHC40345_082b2106fec64a73a947e8639b51df0e.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_082b2106fec64a73a947e8639b51df0e.jpg saved to cache
2026-03-30 11:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b73ad31d-8c23-5056-853d-605882a20d79
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad85f90>
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45e6050c-a98a-5f4b-a45d-3f0e1698c9f0/45e6050c-a98a-5f4b-a45d-3f0e1698c9f0_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Faa%252F59aa91c0203e1cce1ab455e14bc6cdd5%252Fpa%252FJN94907_753b10999015f14e3bbef1cc1ed77f71.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_753b10999015f14e3bbef1cc1ed77f71.jpg saved to cache
2026-03-30 11:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 45e6050c-a98a-5f4b-a45d-3f0e1698c9f0
2026-03-30 11:18:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_59d809496c32a9063b0a0037dd167628.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc0603f1010>
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45e6050c-a98a-5f4b-a45d-3f0e1698c9f0/45e6050c-a98a-5f4b-a45d-3f0e1698c9f0_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Faa%252F59aa91c0203e1cce1ab455e14bc6cdd5%252Fpa%252FJN94907_fa3e991be586c306fed10457e93ccf75.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_fa3e991be586c306fed10457e93ccf75.jpg saved to cache
2026-03-30 11:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 45e6050c-a98a-5f4b-a45d-3f0e1698c9f0
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a454090>
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b73ad31d-8c23-5056-853d-605882a20d79/b73ad31d-8c23-5056-853d-605882a20d79_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F73%252F0e73d011a79f4ec6c3b49a4572bf1d1e%252Fpa%252FHC40345_b7462e61204a4f06caf7d42650e4cb24.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_b7462e61204a4f06caf7d42650e4cb24.jpg saved to cache
2026-03-30 11:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b73ad31d-8c23-5056-853d-605882a20d79
2026-03-30 11:18:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_6d20c3cca05f181a57dba4adbbf6f327.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_cb9722b7d2f54a7598cd7a4193556007.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_08842590fd4b37eaff3b89c47ca7d8cd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc0603fc990>
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b73ad31d-8c23-5056-853d-605882a20d79/b73ad31d-8c23-5056-853d-605882a20d79_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F73%252F0e73d011a79f4ec6c3b49a4572bf1d1e%252Fpa%252FHC40345_59d809496c32a9063b0a0037dd167628.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_59d809496c32a9063b0a0037dd167628.jpg saved to cache
2026-03-30 11:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b73ad31d-8c23-5056-853d-605882a20d79
2026-03-30 11:18:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_6f80de3e116e2af276a9354f49fc190d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_1773ed27c585065ac8945f36e38ed2d0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_322113f67af14ac0a2bd353b1baf4cad.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ae94e50>
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b73ad31d-8c23-5056-853d-605882a20d79/b73ad31d-8c23-5056-853d-605882a20d79_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F73%252F0e73d011a79f4ec6c3b49a4572bf1d1e%252Fpa%252FHC40345_6d20c3cca05f181a57dba4adbbf6f327.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_6d20c3cca05f181a57dba4adbbf6f327.jpg saved to cache
2026-03-30 11:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b73ad31d-8c23-5056-853d-605882a20d79
2026-03-30 11:18:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_b236bf5545827aef5f91f7fbaa97bf45.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ae7ecd0>
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45e6050c-a98a-5f4b-a45d-3f0e1698c9f0/45e6050c-a98a-5f4b-a45d-3f0e1698c9f0_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Faa%252F59aa91c0203e1cce1ab455e14bc6cdd5%252Fpa%252FJN94907_cb9722b7d2f54a7598cd7a4193556007.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_cb9722b7d2f54a7598cd7a4193556007.jpg saved to cache
2026-03-30 11:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 45e6050c-a98a-5f4b-a45d-3f0e1698c9f0
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4ae590>
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b73ad31d-8c23-5056-853d-605882a20d79/b73ad31d-8c23-5056-853d-605882a20d79_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F73%252F0e73d011a79f4ec6c3b49a4572bf1d1e%252Fpa%252FHC40345_08842590fd4b37eaff3b89c47ca7d8cd.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_08842590fd4b37eaff3b89c47ca7d8cd.jpg saved to cache
2026-03-30 11:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b73ad31d-8c23-5056-853d-605882a20d79
2026-03-30 11:18:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_6e63aebf0be1c7cd2bc96184d68736c6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_63fdff336eb4d102bf4e2c3cb2e75c3d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad6bb10>
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b73ad31d-8c23-5056-853d-605882a20d79/b73ad31d-8c23-5056-853d-605882a20d79_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F73%252F0e73d011a79f4ec6c3b49a4572bf1d1e%252Fpa%252FHC40345_6f80de3e116e2af276a9354f49fc190d.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_6f80de3e116e2af276a9354f49fc190d.jpg saved to cache
2026-03-30 11:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b73ad31d-8c23-5056-853d-605882a20d79
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4a0a90>
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b73ad31d-8c23-5056-853d-605882a20d79/b73ad31d-8c23-5056-853d-605882a20d79_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F73%252F0e73d011a79f4ec6c3b49a4572bf1d1e%252Fpa%252FHC40345_1773ed27c585065ac8945f36e38ed2d0.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_1773ed27c585065ac8945f36e38ed2d0.jpg saved to cache
2026-03-30 11:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b73ad31d-8c23-5056-853d-605882a20d79
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ae851d0>
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b73ad31d-8c23-5056-853d-605882a20d79/b73ad31d-8c23-5056-853d-605882a20d79_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F73%252F0e73d011a79f4ec6c3b49a4572bf1d1e%252Fpa%252FHC40345_322113f67af14ac0a2bd353b1baf4cad.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_322113f67af14ac0a2bd353b1baf4cad.jpg saved to cache
2026-03-30 11:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b73ad31d-8c23-5056-853d-605882a20d79
2026-03-30 11:18:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_235775b7828c9bbbc9d0a46000a544b6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_93ea7d1d5569b5bab3550bf742896f44.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a46af90>
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45e6050c-a98a-5f4b-a45d-3f0e1698c9f0/45e6050c-a98a-5f4b-a45d-3f0e1698c9f0_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Faa%252F59aa91c0203e1cce1ab455e14bc6cdd5%252Fpa%252FJN94907_b236bf5545827aef5f91f7fbaa97bf45.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_b236bf5545827aef5f91f7fbaa97bf45.jpg saved to cache
2026-03-30 11:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 45e6050c-a98a-5f4b-a45d-3f0e1698c9f0
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a331a90>
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45e6050c-a98a-5f4b-a45d-3f0e1698c9f0/45e6050c-a98a-5f4b-a45d-3f0e1698c9f0_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Faa%252F59aa91c0203e1cce1ab455e14bc6cdd5%252Fpa%252FJN94907_6e63aebf0be1c7cd2bc96184d68736c6.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_6e63aebf0be1c7cd2bc96184d68736c6.jpg saved to cache
2026-03-30 11:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 45e6050c-a98a-5f4b-a45d-3f0e1698c9f0
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060fee190>
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45e6050c-a98a-5f4b-a45d-3f0e1698c9f0/45e6050c-a98a-5f4b-a45d-3f0e1698c9f0_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Faa%252F59aa91c0203e1cce1ab455e14bc6cdd5%252Fpa%252FJN94907_63fdff336eb4d102bf4e2c3cb2e75c3d.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_63fdff336eb4d102bf4e2c3cb2e75c3d.jpg saved to cache
2026-03-30 11:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 45e6050c-a98a-5f4b-a45d-3f0e1698c9f0
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a331fd0>
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45e6050c-a98a-5f4b-a45d-3f0e1698c9f0/45e6050c-a98a-5f4b-a45d-3f0e1698c9f0_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Faa%252F59aa91c0203e1cce1ab455e14bc6cdd5%252Fpa%252FJN94907_235775b7828c9bbbc9d0a46000a544b6.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_235775b7828c9bbbc9d0a46000a544b6.jpg saved to cache
2026-03-30 11:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 45e6050c-a98a-5f4b-a45d-3f0e1698c9f0
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060fee210>
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b73ad31d-8c23-5056-853d-605882a20d79/b73ad31d-8c23-5056-853d-605882a20d79_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F73%252F0e73d011a79f4ec6c3b49a4572bf1d1e%252Fpa%252FHC40345_93ea7d1d5569b5bab3550bf742896f44.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_93ea7d1d5569b5bab3550bf742896f44.jpg saved to cache
2026-03-30 11:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b73ad31d-8c23-5056-853d-605882a20d79
2026-03-30 11:18:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_dddba361ddc76dc4a28c787bbf83b2e3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_5a71ffda2c2c14f54d129f62b3667b3b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad12fd0>
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b73ad31d-8c23-5056-853d-605882a20d79/b73ad31d-8c23-5056-853d-605882a20d79_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F73%252F0e73d011a79f4ec6c3b49a4572bf1d1e%252Fpa%252FHC40345_dddba361ddc76dc4a28c787bbf83b2e3.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_dddba361ddc76dc4a28c787bbf83b2e3.jpg saved to cache
2026-03-30 11:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b73ad31d-8c23-5056-853d-605882a20d79
2026-03-30 11:18:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b73ad31d-8c23-5056-853d-605882a20d79, skipping ID generation
2026-03-30 11:18:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b73ad31d-8c23-5056-853d-605882a20d79 with scrape type 1
2026-03-30 11:18:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b73ad31d-8c23-5056-853d-605882a20d79 sending to next pipeline
2026-03-30 11:18:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b73ad31d-8c23-5056-853d-605882a20d79, identifier: HC40345
2026-03-30 11:18:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b73ad31d-8c23-5056-853d-605882a20d79 with identifier: HC40345
2026-03-30 11:18:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b73ad31d-8c23-5056-853d-605882a20d79 with identifier: HC40345
2026-03-30 11:18:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b73ad31d-8c23-5056-853d-605882a20d79 with identifier: HC40345 to the API
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_dddba361ddc76dc4a28c787bbf83b2e3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:48:15Z',
'fuel_type': 'diesel',
'id': 'b73ad31d-8c23-5056-853d-605882a20d79',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC40345',
'listing': 'auction',
'location': 'ES, Palma de Mallorca',
'make': 'Audi',
'model': 'A5 Sportback',
'odometer': 128771,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b73ad31d-8c23-5056-853d-605882a20d79/b73ad31d-8c23-5056-853d-605882a20d79_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121671,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_b7462e61204a4f06caf7d42650e4cb24.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b73ad31d-8c23-5056-853d-605882a20d79/b73ad31d-8c23-5056-853d-605882a20d79_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116510,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_dddba361ddc76dc4a28c787bbf83b2e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b73ad31d-8c23-5056-853d-605882a20d79/b73ad31d-8c23-5056-853d-605882a20d79_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88071,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_93ea7d1d5569b5bab3550bf742896f44.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b73ad31d-8c23-5056-853d-605882a20d79/b73ad31d-8c23-5056-853d-605882a20d79_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83745,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_082b2106fec64a73a947e8639b51df0e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b73ad31d-8c23-5056-853d-605882a20d79/b73ad31d-8c23-5056-853d-605882a20d79_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105255,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_322113f67af14ac0a2bd353b1baf4cad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b73ad31d-8c23-5056-853d-605882a20d79/b73ad31d-8c23-5056-853d-605882a20d79_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109971,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_6f80de3e116e2af276a9354f49fc190d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b73ad31d-8c23-5056-853d-605882a20d79/b73ad31d-8c23-5056-853d-605882a20d79_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96702,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_08842590fd4b37eaff3b89c47ca7d8cd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b73ad31d-8c23-5056-853d-605882a20d79/b73ad31d-8c23-5056-853d-605882a20d79_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102223,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_6d20c3cca05f181a57dba4adbbf6f327.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b73ad31d-8c23-5056-853d-605882a20d79/b73ad31d-8c23-5056-853d-605882a20d79_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105601,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_1773ed27c585065ac8945f36e38ed2d0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b73ad31d-8c23-5056-853d-605882a20d79/b73ad31d-8c23-5056-853d-605882a20d79_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98188,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/73/0e73d011a79f4ec6c3b49a4572bf1d1e/pa/HC40345_59d809496c32a9063b0a0037dd167628.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-01-21',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A5 Sportback 2.0 TDI',
'transmission': 'manual',
'trim': '',
'year': 2015}
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HC40345%27 HTTP/1.1" 200 None
2026-03-30 11:18:13 [auto1.es] INFO: Saving data for HC40345: {'created_time': 1774869493.551524, 'last_price_update_time': 1774869493.55154, 'auction_closing_time': 1774972095.0}
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HC40345') HTTP/1.1" 204 0
2026-03-30 11:18:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a331950>
2026-03-30 11:18:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45e6050c-a98a-5f4b-a45d-3f0e1698c9f0/45e6050c-a98a-5f4b-a45d-3f0e1698c9f0_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Faa%252F59aa91c0203e1cce1ab455e14bc6cdd5%252Fpa%252FJN94907_5a71ffda2c2c14f54d129f62b3667b3b.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_5a71ffda2c2c14f54d129f62b3667b3b.jpg saved to cache
2026-03-30 11:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 45e6050c-a98a-5f4b-a45d-3f0e1698c9f0
2026-03-30 11:18:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 45e6050c-a98a-5f4b-a45d-3f0e1698c9f0, skipping ID generation
2026-03-30 11:18:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45e6050c-a98a-5f4b-a45d-3f0e1698c9f0 with scrape type 1
2026-03-30 11:18:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 45e6050c-a98a-5f4b-a45d-3f0e1698c9f0 sending to next pipeline
2026-03-30 11:18:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 45e6050c-a98a-5f4b-a45d-3f0e1698c9f0, identifier: JN94907
2026-03-30 11:18:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 45e6050c-a98a-5f4b-a45d-3f0e1698c9f0 with identifier: JN94907
2026-03-30 11:18:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 45e6050c-a98a-5f4b-a45d-3f0e1698c9f0 with identifier: JN94907
2026-03-30 11:18:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 45e6050c-a98a-5f4b-a45d-3f0e1698c9f0 with identifier: JN94907 to the API
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_5a71ffda2c2c14f54d129f62b3667b3b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:33:26Z',
'fuel_type': 'diesel',
'id': '45e6050c-a98a-5f4b-a45d-3f0e1698c9f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN94907',
'listing': 'auction',
'location': 'ES, Churra (Murcia)',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 53784,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45e6050c-a98a-5f4b-a45d-3f0e1698c9f0/45e6050c-a98a-5f4b-a45d-3f0e1698c9f0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90450,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_17f859c647f4257b80ab4d6bda7fec1b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45e6050c-a98a-5f4b-a45d-3f0e1698c9f0/45e6050c-a98a-5f4b-a45d-3f0e1698c9f0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98378,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_753b10999015f14e3bbef1cc1ed77f71.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45e6050c-a98a-5f4b-a45d-3f0e1698c9f0/45e6050c-a98a-5f4b-a45d-3f0e1698c9f0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105733,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_03a12b126eae11b3578bd2834e98c82c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45e6050c-a98a-5f4b-a45d-3f0e1698c9f0/45e6050c-a98a-5f4b-a45d-3f0e1698c9f0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81890,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_5a71ffda2c2c14f54d129f62b3667b3b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45e6050c-a98a-5f4b-a45d-3f0e1698c9f0/45e6050c-a98a-5f4b-a45d-3f0e1698c9f0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92936,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_fa3e991be586c306fed10457e93ccf75.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45e6050c-a98a-5f4b-a45d-3f0e1698c9f0/45e6050c-a98a-5f4b-a45d-3f0e1698c9f0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98317,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_b236bf5545827aef5f91f7fbaa97bf45.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45e6050c-a98a-5f4b-a45d-3f0e1698c9f0/45e6050c-a98a-5f4b-a45d-3f0e1698c9f0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78043,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_235775b7828c9bbbc9d0a46000a544b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45e6050c-a98a-5f4b-a45d-3f0e1698c9f0/45e6050c-a98a-5f4b-a45d-3f0e1698c9f0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92121,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_63fdff336eb4d102bf4e2c3cb2e75c3d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45e6050c-a98a-5f4b-a45d-3f0e1698c9f0/45e6050c-a98a-5f4b-a45d-3f0e1698c9f0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90526,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_6e63aebf0be1c7cd2bc96184d68736c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45e6050c-a98a-5f4b-a45d-3f0e1698c9f0/45e6050c-a98a-5f4b-a45d-3f0e1698c9f0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88742,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/aa/59aa91c0203e1cce1ab455e14bc6cdd5/pa/JN94907_cb9722b7d2f54a7598cd7a4193556007.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-07-12',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Advance BlueMotion Tech.',
'transmission': 'manual',
'trim': 'Advance BlueMotion Tech.',
'year': 2016}
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JN94907%27 HTTP/1.1" 200 None
2026-03-30 11:18:14 [auto1.es] INFO: Saving data for JN94907: {'created_time': 1774869494.117083, 'last_price_update_time': 1774869494.117096, 'auction_closing_time': 1774971206.0}
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JN94907') HTTP/1.1" 204 0
2026-03-30 11:18:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MJ08668> (referer: https://www.auto1.com/v1/car-details-view/MJ08668/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40be4af7-3ebd-5097-9721-72c525cae57d with identifier: MJ08668
2026-03-30 11:18:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40be4af7-3ebd-5097-9721-72c525cae57d with scrape type 1
2026-03-30 11:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 40be4af7-3ebd-5097-9721-72c525cae57d
2026-03-30 11:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F4e%252Fa84e3951f1b94fb765d33630d1450d44%252Fpa%252FMJ08668_96910998c09db66f100df333e44e0313.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/4e/a84e3951f1b94fb765d33630d1450d44/pa/MJ08668_96910998c09db66f100df333e44e0313.jpg already downloaded
2026-03-30 11:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F4e%252Fa84e3951f1b94fb765d33630d1450d44%252Fpa%252FMJ08668_69c5b9f3acfc5d88c24c4490bf1c9e28.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/4e/a84e3951f1b94fb765d33630d1450d44/pa/MJ08668_69c5b9f3acfc5d88c24c4490bf1c9e28.jpg already downloaded
2026-03-30 11:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F4e%252Fa84e3951f1b94fb765d33630d1450d44%252Fpa%252FMJ08668_a2f67a7f7d34bb000beae1138ee1aab2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/4e/a84e3951f1b94fb765d33630d1450d44/pa/MJ08668_a2f67a7f7d34bb000beae1138ee1aab2.jpg already downloaded
2026-03-30 11:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F4e%252Fa84e3951f1b94fb765d33630d1450d44%252Fpa%252FMJ08668_22b3f6417bc1368fbabec41c1bd6f12d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/4e/a84e3951f1b94fb765d33630d1450d44/pa/MJ08668_22b3f6417bc1368fbabec41c1bd6f12d.jpg already downloaded
2026-03-30 11:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F4e%252Fa84e3951f1b94fb765d33630d1450d44%252Fpa%252FMJ08668_07664a56bb9c8e25a3f6c8870867a373.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/4e/a84e3951f1b94fb765d33630d1450d44/pa/MJ08668_07664a56bb9c8e25a3f6c8870867a373.jpg already downloaded
2026-03-30 11:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F4e%252Fa84e3951f1b94fb765d33630d1450d44%252Fpa%252FMJ08668_35b888d03a2482af80c897206aeef452.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/4e/a84e3951f1b94fb765d33630d1450d44/pa/MJ08668_35b888d03a2482af80c897206aeef452.jpg already downloaded
2026-03-30 11:18:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 40be4af7-3ebd-5097-9721-72c525cae57d, identifier: MJ08668
2026-03-30 11:18:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 40be4af7-3ebd-5097-9721-72c525cae57d with identifier: MJ08668
2026-03-30 11:18:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 40be4af7-3ebd-5097-9721-72c525cae57d with identifier: MJ08668
2026-03-30 11:18:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 40be4af7-3ebd-5097-9721-72c525cae57d with identifier: MJ08668 to the API
2026-03-30 11:18:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MJ08668>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.9L',
'engine_horse_power': 105,
'expiration_date': '2026-03-31T15:12:52Z',
'fuel_type': 'diesel',
'id': '40be4af7-3ebd-5097-9721-72c525cae57d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ08668',
'listing': 'auction',
'location': 'ES, Alcalá de Henares, Madrid',
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 292959,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/imga8/4e/a84e3951f1b94fb765d33630d1450d44/pa/MJ08668_96910998c09db66f100df333e44e0313.jpg',
'https://img-pa.auto1.com/imga8/4e/a84e3951f1b94fb765d33630d1450d44/pa/MJ08668_69c5b9f3acfc5d88c24c4490bf1c9e28.jpg',
'https://img-pa.auto1.com/imga8/4e/a84e3951f1b94fb765d33630d1450d44/pa/MJ08668_a2f67a7f7d34bb000beae1138ee1aab2.jpg',
'https://img-pa.auto1.com/imga8/4e/a84e3951f1b94fb765d33630d1450d44/pa/MJ08668_22b3f6417bc1368fbabec41c1bd6f12d.jpg',
'https://img-pa.auto1.com/imga8/4e/a84e3951f1b94fb765d33630d1450d44/pa/MJ08668_07664a56bb9c8e25a3f6c8870867a373.jpg',
'https://img-pa.auto1.com/imga8/4e/a84e3951f1b94fb765d33630d1450d44/pa/MJ08668_35b888d03a2482af80c897206aeef452.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40be4af7-3ebd-5097-9721-72c525cae57d/40be4af7-3ebd-5097-9721-72c525cae57d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116620,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/4e/a84e3951f1b94fb765d33630d1450d44/pa/MJ08668_96910998c09db66f100df333e44e0313.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40be4af7-3ebd-5097-9721-72c525cae57d/40be4af7-3ebd-5097-9721-72c525cae57d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103708,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/4e/a84e3951f1b94fb765d33630d1450d44/pa/MJ08668_69c5b9f3acfc5d88c24c4490bf1c9e28.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40be4af7-3ebd-5097-9721-72c525cae57d/40be4af7-3ebd-5097-9721-72c525cae57d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78858,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/4e/a84e3951f1b94fb765d33630d1450d44/pa/MJ08668_a2f67a7f7d34bb000beae1138ee1aab2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40be4af7-3ebd-5097-9721-72c525cae57d/40be4af7-3ebd-5097-9721-72c525cae57d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90547,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/4e/a84e3951f1b94fb765d33630d1450d44/pa/MJ08668_22b3f6417bc1368fbabec41c1bd6f12d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40be4af7-3ebd-5097-9721-72c525cae57d/40be4af7-3ebd-5097-9721-72c525cae57d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104427,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/4e/a84e3951f1b94fb765d33630d1450d44/pa/MJ08668_07664a56bb9c8e25a3f6c8870867a373.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40be4af7-3ebd-5097-9721-72c525cae57d/40be4af7-3ebd-5097-9721-72c525cae57d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 123053,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/4e/a84e3951f1b94fb765d33630d1450d44/pa/MJ08668_35b888d03a2482af80c897206aeef452.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2005-03-31',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf V 1.9 TDI Sportline',
'transmission': 'automatic',
'trim': 'Sportline',
'year': 2005}
2026-03-30 11:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MJ08668%27 HTTP/1.1" 200 None
2026-03-30 11:18:15 [auto1.es] INFO: Saving data for MJ08668: {'created_time': 1774869495.95871, 'last_price_update_time': 1774869495.958721, 'auction_closing_time': 1774969972.0}
2026-03-30 11:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MJ08668') HTTP/1.1" 204 0
2026-03-30 11:18:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FD15561> (referer: https://www.auto1.com/v1/car-details-view/FD15561/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee9e17d1-5f90-5984-881b-4bd4375bc9a4 with identifier: FD15561
2026-03-30 11:18:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee9e17d1-5f90-5984-881b-4bd4375bc9a4 with scrape type 1
2026-03-30 11:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ee9e17d1-5f90-5984-881b-4bd4375bc9a4
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff3%252F25f3feda79d417e1e4e3052d69546126%252Fpa%252FFD15561_8858819c7265a3fee1e8acdb011858fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_8858819c7265a3fee1e8acdb011858fd.jpg not downloaded yet
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff3%252F25f3feda79d417e1e4e3052d69546126%252Fpa%252FFD15561_59ac9dd885dd73c8fde773569f1c9553.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_59ac9dd885dd73c8fde773569f1c9553.jpg not downloaded yet
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff3%252F25f3feda79d417e1e4e3052d69546126%252Fpa%252FFD15561_98530d133f52126fbf97f2bf0e208903.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_98530d133f52126fbf97f2bf0e208903.jpg not downloaded yet
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff3%252F25f3feda79d417e1e4e3052d69546126%252Fpa%252FFD15561_43fe865ba46143245df0adccf9ed6310.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_43fe865ba46143245df0adccf9ed6310.jpg not downloaded yet
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff3%252F25f3feda79d417e1e4e3052d69546126%252Fpa%252FFD15561_f0f4594dc575041ffd203643fe877979.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_f0f4594dc575041ffd203643fe877979.jpg not downloaded yet
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff3%252F25f3feda79d417e1e4e3052d69546126%252Fpa%252FFD15561_6f78c4b6133e5a432ab4684023bda4a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_6f78c4b6133e5a432ab4684023bda4a1.jpg not downloaded yet
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff3%252F25f3feda79d417e1e4e3052d69546126%252Fpa%252FFD15561_5bd857c2347b23a65ff85c4c0540fdf4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_5bd857c2347b23a65ff85c4c0540fdf4.jpg not downloaded yet
2026-03-30 11:18:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_8858819c7265a3fee1e8acdb011858fd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff3%252F25f3feda79d417e1e4e3052d69546126%252Fpa%252FFD15561_8de2fb29c17977e453bf83744d9b7229.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_8de2fb29c17977e453bf83744d9b7229.jpg not downloaded yet
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff3%252F25f3feda79d417e1e4e3052d69546126%252Fpa%252FFD15561_e6b92037cd8e3caa19b0dd8a8d215ed3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_e6b92037cd8e3caa19b0dd8a8d215ed3.jpg not downloaded yet
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff3%252F25f3feda79d417e1e4e3052d69546126%252Fpa%252FFD15561_60f1236d53dd3220f3c4fe2f06b71043.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_60f1236d53dd3220f3c4fe2f06b71043.jpg not downloaded yet
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05aeb1950>
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee9e17d1-5f90-5984-881b-4bd4375bc9a4/ee9e17d1-5f90-5984-881b-4bd4375bc9a4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff3%252F25f3feda79d417e1e4e3052d69546126%252Fpa%252FFD15561_8858819c7265a3fee1e8acdb011858fd.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_8858819c7265a3fee1e8acdb011858fd.jpg saved to cache
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee9e17d1-5f90-5984-881b-4bd4375bc9a4
2026-03-30 11:18:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_59ac9dd885dd73c8fde773569f1c9553.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_43fe865ba46143245df0adccf9ed6310.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_98530d133f52126fbf97f2bf0e208903.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_60f1236d53dd3220f3c4fe2f06b71043.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a468390>
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee9e17d1-5f90-5984-881b-4bd4375bc9a4/ee9e17d1-5f90-5984-881b-4bd4375bc9a4_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff3%252F25f3feda79d417e1e4e3052d69546126%252Fpa%252FFD15561_59ac9dd885dd73c8fde773569f1c9553.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_59ac9dd885dd73c8fde773569f1c9553.jpg saved to cache
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ee9e17d1-5f90-5984-881b-4bd4375bc9a4
2026-03-30 11:18:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_5bd857c2347b23a65ff85c4c0540fdf4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4d7790>
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee9e17d1-5f90-5984-881b-4bd4375bc9a4/ee9e17d1-5f90-5984-881b-4bd4375bc9a4_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff3%252F25f3feda79d417e1e4e3052d69546126%252Fpa%252FFD15561_43fe865ba46143245df0adccf9ed6310.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_43fe865ba46143245df0adccf9ed6310.jpg saved to cache
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ee9e17d1-5f90-5984-881b-4bd4375bc9a4
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a380550>
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee9e17d1-5f90-5984-881b-4bd4375bc9a4/ee9e17d1-5f90-5984-881b-4bd4375bc9a4_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff3%252F25f3feda79d417e1e4e3052d69546126%252Fpa%252FFD15561_98530d133f52126fbf97f2bf0e208903.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_98530d133f52126fbf97f2bf0e208903.jpg saved to cache
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ee9e17d1-5f90-5984-881b-4bd4375bc9a4
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3372d0>
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee9e17d1-5f90-5984-881b-4bd4375bc9a4/ee9e17d1-5f90-5984-881b-4bd4375bc9a4_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff3%252F25f3feda79d417e1e4e3052d69546126%252Fpa%252FFD15561_60f1236d53dd3220f3c4fe2f06b71043.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_60f1236d53dd3220f3c4fe2f06b71043.jpg saved to cache
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ee9e17d1-5f90-5984-881b-4bd4375bc9a4
2026-03-30 11:18:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_8de2fb29c17977e453bf83744d9b7229.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_f0f4594dc575041ffd203643fe877979.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_e6b92037cd8e3caa19b0dd8a8d215ed3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a49ed50>
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee9e17d1-5f90-5984-881b-4bd4375bc9a4/ee9e17d1-5f90-5984-881b-4bd4375bc9a4_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff3%252F25f3feda79d417e1e4e3052d69546126%252Fpa%252FFD15561_5bd857c2347b23a65ff85c4c0540fdf4.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_5bd857c2347b23a65ff85c4c0540fdf4.jpg saved to cache
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ee9e17d1-5f90-5984-881b-4bd4375bc9a4
2026-03-30 11:18:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_6f78c4b6133e5a432ab4684023bda4a1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad42e90>
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee9e17d1-5f90-5984-881b-4bd4375bc9a4/ee9e17d1-5f90-5984-881b-4bd4375bc9a4_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff3%252F25f3feda79d417e1e4e3052d69546126%252Fpa%252FFD15561_8de2fb29c17977e453bf83744d9b7229.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_8de2fb29c17977e453bf83744d9b7229.jpg saved to cache
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ee9e17d1-5f90-5984-881b-4bd4375bc9a4
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc0603fc310>
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee9e17d1-5f90-5984-881b-4bd4375bc9a4/ee9e17d1-5f90-5984-881b-4bd4375bc9a4_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff3%252F25f3feda79d417e1e4e3052d69546126%252Fpa%252FFD15561_f0f4594dc575041ffd203643fe877979.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_f0f4594dc575041ffd203643fe877979.jpg saved to cache
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ee9e17d1-5f90-5984-881b-4bd4375bc9a4
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a466090>
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee9e17d1-5f90-5984-881b-4bd4375bc9a4/ee9e17d1-5f90-5984-881b-4bd4375bc9a4_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff3%252F25f3feda79d417e1e4e3052d69546126%252Fpa%252FFD15561_e6b92037cd8e3caa19b0dd8a8d215ed3.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_e6b92037cd8e3caa19b0dd8a8d215ed3.jpg saved to cache
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ee9e17d1-5f90-5984-881b-4bd4375bc9a4
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060ff0550>
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee9e17d1-5f90-5984-881b-4bd4375bc9a4/ee9e17d1-5f90-5984-881b-4bd4375bc9a4_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff3%252F25f3feda79d417e1e4e3052d69546126%252Fpa%252FFD15561_6f78c4b6133e5a432ab4684023bda4a1.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_6f78c4b6133e5a432ab4684023bda4a1.jpg saved to cache
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ee9e17d1-5f90-5984-881b-4bd4375bc9a4
2026-03-30 11:18:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee9e17d1-5f90-5984-881b-4bd4375bc9a4, skipping ID generation
2026-03-30 11:18:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee9e17d1-5f90-5984-881b-4bd4375bc9a4 with scrape type 1
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee9e17d1-5f90-5984-881b-4bd4375bc9a4 sending to next pipeline
2026-03-30 11:18:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ee9e17d1-5f90-5984-881b-4bd4375bc9a4, identifier: FD15561
2026-03-30 11:18:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ee9e17d1-5f90-5984-881b-4bd4375bc9a4 with identifier: FD15561
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-30 11:18:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:18:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ee9e17d1-5f90-5984-881b-4bd4375bc9a4 with identifier: FD15561
2026-03-30 11:18:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ee9e17d1-5f90-5984-881b-4bd4375bc9a4 with identifier: FD15561 to the API
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_6f78c4b6133e5a432ab4684023bda4a1.jpg>
{'auction_title': '',
'c_o_2_emission_value': 87,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.8L',
'engine_horse_power': 122,
'expiration_date': '2026-03-31T15:35:17Z',
'fuel_type': 'hybrid',
'id': 'ee9e17d1-5f90-5984-881b-4bd4375bc9a4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD15561',
'listing': 'auction',
'location': 'ES, Manacor',
'make': 'Toyota',
'model': 'C-HR',
'odometer': 188995,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee9e17d1-5f90-5984-881b-4bd4375bc9a4/ee9e17d1-5f90-5984-881b-4bd4375bc9a4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115387,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_8858819c7265a3fee1e8acdb011858fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee9e17d1-5f90-5984-881b-4bd4375bc9a4/ee9e17d1-5f90-5984-881b-4bd4375bc9a4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106750,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_59ac9dd885dd73c8fde773569f1c9553.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee9e17d1-5f90-5984-881b-4bd4375bc9a4/ee9e17d1-5f90-5984-881b-4bd4375bc9a4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114628,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_98530d133f52126fbf97f2bf0e208903.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee9e17d1-5f90-5984-881b-4bd4375bc9a4/ee9e17d1-5f90-5984-881b-4bd4375bc9a4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84008,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_43fe865ba46143245df0adccf9ed6310.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee9e17d1-5f90-5984-881b-4bd4375bc9a4/ee9e17d1-5f90-5984-881b-4bd4375bc9a4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89038,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_f0f4594dc575041ffd203643fe877979.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee9e17d1-5f90-5984-881b-4bd4375bc9a4/ee9e17d1-5f90-5984-881b-4bd4375bc9a4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91403,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_6f78c4b6133e5a432ab4684023bda4a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee9e17d1-5f90-5984-881b-4bd4375bc9a4/ee9e17d1-5f90-5984-881b-4bd4375bc9a4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86872,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_5bd857c2347b23a65ff85c4c0540fdf4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee9e17d1-5f90-5984-881b-4bd4375bc9a4/ee9e17d1-5f90-5984-881b-4bd4375bc9a4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91846,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_8de2fb29c17977e453bf83744d9b7229.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee9e17d1-5f90-5984-881b-4bd4375bc9a4/ee9e17d1-5f90-5984-881b-4bd4375bc9a4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96294,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_e6b92037cd8e3caa19b0dd8a8d215ed3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee9e17d1-5f90-5984-881b-4bd4375bc9a4/ee9e17d1-5f90-5984-881b-4bd4375bc9a4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90430,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/f3/25f3feda79d417e1e4e3052d69546126/pa/FD15561_60f1236d53dd3220f3c4fe2f06b71043.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-04-09',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota C-HR 1.8 Hybrid Advance',
'transmission': 'automatic',
'trim': 'Advance',
'year': 2018}
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FD15561%27 HTTP/1.1" 200 None
2026-03-30 11:18:22 [auto1.es] INFO: Saving data for FD15561: {'created_time': 1774869502.352234, 'last_price_update_time': 1774869502.352247, 'auction_closing_time': 1774971317.0}
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FD15561') HTTP/1.1" 204 0
2026-03-30 11:18:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UR30668> (referer: https://www.auto1.com/v1/car-details-view/UR30668/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HU27637> (referer: https://www.auto1.com/v1/car-details-view/HU27637/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NG43974> (referer: https://www.auto1.com/v1/car-details-view/NG43974/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1585e549-5a32-57e8-aac1-27500cc906bc with identifier: UR30668
2026-03-30 11:18:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1585e549-5a32-57e8-aac1-27500cc906bc with scrape type 1
2026-03-30 11:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 1585e549-5a32-57e8-aac1-27500cc906bc
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fc8%252F13c8e097a451c06f0b662514ff7259df%252Fpa%252FUR30668_ac800b0ec285df5d7583397a57e5fe4d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/c8/13c8e097a451c06f0b662514ff7259df/pa/UR30668_ac800b0ec285df5d7583397a57e5fe4d.jpg already downloaded
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fc8%252F13c8e097a451c06f0b662514ff7259df%252Fpa%252FUR30668_aa6cf6dc3a85dc1316f2145c8a31adb6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/c8/13c8e097a451c06f0b662514ff7259df/pa/UR30668_aa6cf6dc3a85dc1316f2145c8a31adb6.jpg already downloaded
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fc8%252F13c8e097a451c06f0b662514ff7259df%252Fpa%252FUR30668_ad32913c2668c4a05b96f746028d762e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/c8/13c8e097a451c06f0b662514ff7259df/pa/UR30668_ad32913c2668c4a05b96f746028d762e.jpg already downloaded
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fc8%252F13c8e097a451c06f0b662514ff7259df%252Fpa%252FUR30668_fadd2cac566c40105c5d64bdc0d8d9d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/c8/13c8e097a451c06f0b662514ff7259df/pa/UR30668_fadd2cac566c40105c5d64bdc0d8d9d3.jpg already downloaded
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fc8%252F13c8e097a451c06f0b662514ff7259df%252Fpa%252FUR30668_ce89335c5c210ce4edc1b7bf9b5e55ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/c8/13c8e097a451c06f0b662514ff7259df/pa/UR30668_ce89335c5c210ce4edc1b7bf9b5e55ad.jpg already downloaded
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fc8%252F13c8e097a451c06f0b662514ff7259df%252Fpa%252FUR30668_4270834a03bd8c2d0ab8fe8b0a83f780.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/c8/13c8e097a451c06f0b662514ff7259df/pa/UR30668_4270834a03bd8c2d0ab8fe8b0a83f780.jpg already downloaded
2026-03-30 11:18:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1585e549-5a32-57e8-aac1-27500cc906bc, identifier: UR30668
2026-03-30 11:18:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1585e549-5a32-57e8-aac1-27500cc906bc with identifier: UR30668
2026-03-30 11:18:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1585e549-5a32-57e8-aac1-27500cc906bc with identifier: UR30668
2026-03-30 11:18:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1585e549-5a32-57e8-aac1-27500cc906bc with identifier: UR30668 to the API
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UR30668>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 3',
'engine': '2.1L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:10:03Z',
'fuel_type': 'diesel',
'id': '1585e549-5a32-57e8-aac1-27500cc906bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR30668',
'listing': 'auction',
'location': 'AlmerÃa',
'make': 'Peugeot',
'model': '406',
'odometer': 108715,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img13/c8/13c8e097a451c06f0b662514ff7259df/pa/UR30668_ac800b0ec285df5d7583397a57e5fe4d.jpg',
'https://img-pa.auto1.com/img13/c8/13c8e097a451c06f0b662514ff7259df/pa/UR30668_aa6cf6dc3a85dc1316f2145c8a31adb6.jpg',
'https://img-pa.auto1.com/img13/c8/13c8e097a451c06f0b662514ff7259df/pa/UR30668_ad32913c2668c4a05b96f746028d762e.jpg',
'https://img-pa.auto1.com/img13/c8/13c8e097a451c06f0b662514ff7259df/pa/UR30668_fadd2cac566c40105c5d64bdc0d8d9d3.jpg',
'https://img-pa.auto1.com/img13/c8/13c8e097a451c06f0b662514ff7259df/pa/UR30668_ce89335c5c210ce4edc1b7bf9b5e55ad.jpg',
'https://img-pa.auto1.com/img13/c8/13c8e097a451c06f0b662514ff7259df/pa/UR30668_4270834a03bd8c2d0ab8fe8b0a83f780.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1585e549-5a32-57e8-aac1-27500cc906bc/1585e549-5a32-57e8-aac1-27500cc906bc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80257,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/c8/13c8e097a451c06f0b662514ff7259df/pa/UR30668_ac800b0ec285df5d7583397a57e5fe4d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1585e549-5a32-57e8-aac1-27500cc906bc/1585e549-5a32-57e8-aac1-27500cc906bc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81860,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/c8/13c8e097a451c06f0b662514ff7259df/pa/UR30668_aa6cf6dc3a85dc1316f2145c8a31adb6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1585e549-5a32-57e8-aac1-27500cc906bc/1585e549-5a32-57e8-aac1-27500cc906bc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86589,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/c8/13c8e097a451c06f0b662514ff7259df/pa/UR30668_ad32913c2668c4a05b96f746028d762e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1585e549-5a32-57e8-aac1-27500cc906bc/1585e549-5a32-57e8-aac1-27500cc906bc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76014,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/c8/13c8e097a451c06f0b662514ff7259df/pa/UR30668_fadd2cac566c40105c5d64bdc0d8d9d3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1585e549-5a32-57e8-aac1-27500cc906bc/1585e549-5a32-57e8-aac1-27500cc906bc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96984,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/c8/13c8e097a451c06f0b662514ff7259df/pa/UR30668_ce89335c5c210ce4edc1b7bf9b5e55ad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1585e549-5a32-57e8-aac1-27500cc906bc/1585e549-5a32-57e8-aac1-27500cc906bc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 133323,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/c8/13c8e097a451c06f0b662514ff7259df/pa/UR30668_4270834a03bd8c2d0ab8fe8b0a83f780.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '1997-12-22',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 406 2.1 Turbodiesel ST DT',
'transmission': 'manual',
'trim': 'ST DT',
'year': 1997}
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UR30668%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [auto1.es] INFO: Saving data for UR30668: {'created_time': 1774869503.089797, 'last_price_update_time': 1774869503.089809, 'auction_closing_time': 1774969803.0}
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UR30668') HTTP/1.1" 204 0
2026-03-30 11:18:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b7ea0da-dcab-55b0-8bf7-5da9e341d99f with identifier: HU27637
2026-03-30 11:18:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b7ea0da-dcab-55b0-8bf7-5da9e341d99f with scrape type 1
2026-03-30 11:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 6b7ea0da-dcab-55b0-8bf7-5da9e341d99f
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fc3%252Fe8c36ea7279f7fbadac1eeb8602a169c%252Fpa%252FHU27637_c2c52eea79abc78600fbad1d719d3ae9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/c3/e8c36ea7279f7fbadac1eeb8602a169c/pa/HU27637_c2c52eea79abc78600fbad1d719d3ae9.jpg already downloaded
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fc3%252Fe8c36ea7279f7fbadac1eeb8602a169c%252Fpa%252FHU27637_90b30dbb37ad3190e0e9d8f8d9e3a680.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/c3/e8c36ea7279f7fbadac1eeb8602a169c/pa/HU27637_90b30dbb37ad3190e0e9d8f8d9e3a680.jpg already downloaded
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fc3%252Fe8c36ea7279f7fbadac1eeb8602a169c%252Fpa%252FHU27637_1345d92b8d17d35c587d696a7776f588.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/c3/e8c36ea7279f7fbadac1eeb8602a169c/pa/HU27637_1345d92b8d17d35c587d696a7776f588.jpg already downloaded
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fc3%252Fe8c36ea7279f7fbadac1eeb8602a169c%252Fpa%252FHU27637_30d4ff644b4b575b69cbc389c73aad74.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/c3/e8c36ea7279f7fbadac1eeb8602a169c/pa/HU27637_30d4ff644b4b575b69cbc389c73aad74.jpg already downloaded
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fc3%252Fe8c36ea7279f7fbadac1eeb8602a169c%252Fpa%252FHU27637_9f4d75d15be6cb965b82cf5a1c44cdad.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/c3/e8c36ea7279f7fbadac1eeb8602a169c/pa/HU27637_9f4d75d15be6cb965b82cf5a1c44cdad.jpg already downloaded
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fc3%252Fe8c36ea7279f7fbadac1eeb8602a169c%252Fpa%252FHU27637_d1a48e2e1dc5787b5e50a16b0b917e34.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/c3/e8c36ea7279f7fbadac1eeb8602a169c/pa/HU27637_d1a48e2e1dc5787b5e50a16b0b917e34.jpg already downloaded
2026-03-30 11:18:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6b7ea0da-dcab-55b0-8bf7-5da9e341d99f, identifier: HU27637
2026-03-30 11:18:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22a6abe6-feee-5128-87f1-8bd387cb793f with identifier: NG43974
2026-03-30 11:18:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22a6abe6-feee-5128-87f1-8bd387cb793f with scrape type 1
2026-03-30 11:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 22a6abe6-feee-5128-87f1-8bd387cb793f
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F1d%252F4d1d269a86a848457523070a2693e67f%252Fpa%252FNG43974_69b82468d9e4ac554262bbddf5bc6e97.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/1d/4d1d269a86a848457523070a2693e67f/pa/NG43974_69b82468d9e4ac554262bbddf5bc6e97.jpg already downloaded
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F1d%252F4d1d269a86a848457523070a2693e67f%252Fpa%252FNG43974_72525f58b7451989249444f0ae0a627b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/1d/4d1d269a86a848457523070a2693e67f/pa/NG43974_72525f58b7451989249444f0ae0a627b.jpg already downloaded
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F1d%252F4d1d269a86a848457523070a2693e67f%252Fpa%252FNG43974_891eabf16fa71d0cf7f5e60dcc130f16.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/1d/4d1d269a86a848457523070a2693e67f/pa/NG43974_891eabf16fa71d0cf7f5e60dcc130f16.jpg already downloaded
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F1d%252F4d1d269a86a848457523070a2693e67f%252Fpa%252FNG43974_079f03803723d740a8d33f826e3e4861.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/1d/4d1d269a86a848457523070a2693e67f/pa/NG43974_079f03803723d740a8d33f826e3e4861.jpg already downloaded
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F1d%252F4d1d269a86a848457523070a2693e67f%252Fpa%252FNG43974_e0de64e056201dc3ab5b20a9fc65b42e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/1d/4d1d269a86a848457523070a2693e67f/pa/NG43974_e0de64e056201dc3ab5b20a9fc65b42e.jpg already downloaded
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F1d%252F4d1d269a86a848457523070a2693e67f%252Fpa%252FNG43974_3c2ee70c41f9d23adc20015de6f2ce71.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/1d/4d1d269a86a848457523070a2693e67f/pa/NG43974_3c2ee70c41f9d23adc20015de6f2ce71.jpg already downloaded
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F1d%252F4d1d269a86a848457523070a2693e67f%252Fpa%252FNG43974_7d74206338f37762dbe306bf7e509fee.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/1d/4d1d269a86a848457523070a2693e67f/pa/NG43974_7d74206338f37762dbe306bf7e509fee.jpg already downloaded
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F1d%252F4d1d269a86a848457523070a2693e67f%252Fpa%252FNG43974_c563f22fadf79238549cb0776b80ac25.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/1d/4d1d269a86a848457523070a2693e67f/pa/NG43974_c563f22fadf79238549cb0776b80ac25.jpg already downloaded
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F1d%252F4d1d269a86a848457523070a2693e67f%252Fpa%252FNG43974_bbe4b3a5db585d0e92d3fe605c7e568c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/1d/4d1d269a86a848457523070a2693e67f/pa/NG43974_bbe4b3a5db585d0e92d3fe605c7e568c.jpg already downloaded
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F1d%252F4d1d269a86a848457523070a2693e67f%252Fpa%252FNG43974_d08ef796c4a676aaec457e7d0008fdaf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/1d/4d1d269a86a848457523070a2693e67f/pa/NG43974_d08ef796c4a676aaec457e7d0008fdaf.jpg already downloaded
2026-03-30 11:18:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 22a6abe6-feee-5128-87f1-8bd387cb793f, identifier: NG43974
2026-03-30 11:18:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6b7ea0da-dcab-55b0-8bf7-5da9e341d99f with identifier: HU27637
2026-03-30 11:18:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6b7ea0da-dcab-55b0-8bf7-5da9e341d99f with identifier: HU27637
2026-03-30 11:18:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6b7ea0da-dcab-55b0-8bf7-5da9e341d99f with identifier: HU27637 to the API
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HU27637>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 4',
'engine': '1.8L',
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:33:53Z',
'fuel_type': 'diesel',
'id': '6b7ea0da-dcab-55b0-8bf7-5da9e341d99f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU27637',
'listing': 'auction',
'location': 'ES, Aldaya',
'make': 'Ford',
'model': 'Focus',
'odometer': 136895,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/imge8/c3/e8c36ea7279f7fbadac1eeb8602a169c/pa/HU27637_c2c52eea79abc78600fbad1d719d3ae9.jpg',
'https://img-pa.auto1.com/imge8/c3/e8c36ea7279f7fbadac1eeb8602a169c/pa/HU27637_90b30dbb37ad3190e0e9d8f8d9e3a680.jpg',
'https://img-pa.auto1.com/imge8/c3/e8c36ea7279f7fbadac1eeb8602a169c/pa/HU27637_1345d92b8d17d35c587d696a7776f588.jpg',
'https://img-pa.auto1.com/imge8/c3/e8c36ea7279f7fbadac1eeb8602a169c/pa/HU27637_30d4ff644b4b575b69cbc389c73aad74.jpg',
'https://img-pa.auto1.com/imge8/c3/e8c36ea7279f7fbadac1eeb8602a169c/pa/HU27637_9f4d75d15be6cb965b82cf5a1c44cdad.jpg',
'https://img-pa.auto1.com/imge8/c3/e8c36ea7279f7fbadac1eeb8602a169c/pa/HU27637_d1a48e2e1dc5787b5e50a16b0b917e34.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b7ea0da-dcab-55b0-8bf7-5da9e341d99f/6b7ea0da-dcab-55b0-8bf7-5da9e341d99f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93118,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/c3/e8c36ea7279f7fbadac1eeb8602a169c/pa/HU27637_c2c52eea79abc78600fbad1d719d3ae9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b7ea0da-dcab-55b0-8bf7-5da9e341d99f/6b7ea0da-dcab-55b0-8bf7-5da9e341d99f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106801,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/c3/e8c36ea7279f7fbadac1eeb8602a169c/pa/HU27637_90b30dbb37ad3190e0e9d8f8d9e3a680.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b7ea0da-dcab-55b0-8bf7-5da9e341d99f/6b7ea0da-dcab-55b0-8bf7-5da9e341d99f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74634,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/c3/e8c36ea7279f7fbadac1eeb8602a169c/pa/HU27637_1345d92b8d17d35c587d696a7776f588.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b7ea0da-dcab-55b0-8bf7-5da9e341d99f/6b7ea0da-dcab-55b0-8bf7-5da9e341d99f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66503,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/c3/e8c36ea7279f7fbadac1eeb8602a169c/pa/HU27637_30d4ff644b4b575b69cbc389c73aad74.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b7ea0da-dcab-55b0-8bf7-5da9e341d99f/6b7ea0da-dcab-55b0-8bf7-5da9e341d99f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 125367,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/c3/e8c36ea7279f7fbadac1eeb8602a169c/pa/HU27637_9f4d75d15be6cb965b82cf5a1c44cdad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b7ea0da-dcab-55b0-8bf7-5da9e341d99f/6b7ea0da-dcab-55b0-8bf7-5da9e341d99f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65861,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/c3/e8c36ea7279f7fbadac1eeb8602a169c/pa/HU27637_d1a48e2e1dc5787b5e50a16b0b917e34.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2007-10-25',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 1.8 TDCi Ghia',
'transmission': 'manual',
'trim': 'Ghia',
'year': 2007}
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HU27637%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [auto1.es] INFO: Saving data for HU27637: {'created_time': 1774869503.980418, 'last_price_update_time': 1774869503.98043, 'auction_closing_time': 1774971233.0}
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HU27637') HTTP/1.1" 204 0
2026-03-30 11:18:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 22a6abe6-feee-5128-87f1-8bd387cb793f with identifier: NG43974
2026-03-30 11:18:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 22a6abe6-feee-5128-87f1-8bd387cb793f with identifier: NG43974
2026-03-30 11:18:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 22a6abe6-feee-5128-87f1-8bd387cb793f with identifier: NG43974 to the API
2026-03-30 11:18:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NG43974>
{'auction_title': '',
'c_o_2_emission_value': 93,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 102,
'expiration_date': '2026-03-31T15:12:06Z',
'fuel_type': 'diesel',
'id': '22a6abe6-feee-5128-87f1-8bd387cb793f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG43974',
'listing': 'auction',
'location': 'ES, Hellin',
'make': 'Peugeot',
'model': '2008',
'odometer': 86178,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img4d/1d/4d1d269a86a848457523070a2693e67f/pa/NG43974_69b82468d9e4ac554262bbddf5bc6e97.jpg',
'https://img-pa.auto1.com/img4d/1d/4d1d269a86a848457523070a2693e67f/pa/NG43974_72525f58b7451989249444f0ae0a627b.jpg',
'https://img-pa.auto1.com/img4d/1d/4d1d269a86a848457523070a2693e67f/pa/NG43974_891eabf16fa71d0cf7f5e60dcc130f16.jpg',
'https://img-pa.auto1.com/img4d/1d/4d1d269a86a848457523070a2693e67f/pa/NG43974_079f03803723d740a8d33f826e3e4861.jpg',
'https://img-pa.auto1.com/img4d/1d/4d1d269a86a848457523070a2693e67f/pa/NG43974_e0de64e056201dc3ab5b20a9fc65b42e.jpg',
'https://img-pa.auto1.com/img4d/1d/4d1d269a86a848457523070a2693e67f/pa/NG43974_3c2ee70c41f9d23adc20015de6f2ce71.jpg',
'https://img-pa.auto1.com/img4d/1d/4d1d269a86a848457523070a2693e67f/pa/NG43974_7d74206338f37762dbe306bf7e509fee.jpg',
'https://img-pa.auto1.com/img4d/1d/4d1d269a86a848457523070a2693e67f/pa/NG43974_c563f22fadf79238549cb0776b80ac25.jpg',
'https://img-pa.auto1.com/img4d/1d/4d1d269a86a848457523070a2693e67f/pa/NG43974_bbe4b3a5db585d0e92d3fe605c7e568c.jpg',
'https://img-pa.auto1.com/img4d/1d/4d1d269a86a848457523070a2693e67f/pa/NG43974_d08ef796c4a676aaec457e7d0008fdaf.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22a6abe6-feee-5128-87f1-8bd387cb793f/22a6abe6-feee-5128-87f1-8bd387cb793f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72874,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/1d/4d1d269a86a848457523070a2693e67f/pa/NG43974_69b82468d9e4ac554262bbddf5bc6e97.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22a6abe6-feee-5128-87f1-8bd387cb793f/22a6abe6-feee-5128-87f1-8bd387cb793f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67916,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/1d/4d1d269a86a848457523070a2693e67f/pa/NG43974_72525f58b7451989249444f0ae0a627b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22a6abe6-feee-5128-87f1-8bd387cb793f/22a6abe6-feee-5128-87f1-8bd387cb793f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62895,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/1d/4d1d269a86a848457523070a2693e67f/pa/NG43974_891eabf16fa71d0cf7f5e60dcc130f16.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22a6abe6-feee-5128-87f1-8bd387cb793f/22a6abe6-feee-5128-87f1-8bd387cb793f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54970,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/1d/4d1d269a86a848457523070a2693e67f/pa/NG43974_079f03803723d740a8d33f826e3e4861.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22a6abe6-feee-5128-87f1-8bd387cb793f/22a6abe6-feee-5128-87f1-8bd387cb793f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51347,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/1d/4d1d269a86a848457523070a2693e67f/pa/NG43974_e0de64e056201dc3ab5b20a9fc65b42e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22a6abe6-feee-5128-87f1-8bd387cb793f/22a6abe6-feee-5128-87f1-8bd387cb793f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57809,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/1d/4d1d269a86a848457523070a2693e67f/pa/NG43974_3c2ee70c41f9d23adc20015de6f2ce71.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22a6abe6-feee-5128-87f1-8bd387cb793f/22a6abe6-feee-5128-87f1-8bd387cb793f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54804,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/1d/4d1d269a86a848457523070a2693e67f/pa/NG43974_7d74206338f37762dbe306bf7e509fee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22a6abe6-feee-5128-87f1-8bd387cb793f/22a6abe6-feee-5128-87f1-8bd387cb793f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69213,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/1d/4d1d269a86a848457523070a2693e67f/pa/NG43974_c563f22fadf79238549cb0776b80ac25.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22a6abe6-feee-5128-87f1-8bd387cb793f/22a6abe6-feee-5128-87f1-8bd387cb793f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63532,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/1d/4d1d269a86a848457523070a2693e67f/pa/NG43974_bbe4b3a5db585d0e92d3fe605c7e568c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22a6abe6-feee-5128-87f1-8bd387cb793f/22a6abe6-feee-5128-87f1-8bd387cb793f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55527,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/1d/4d1d269a86a848457523070a2693e67f/pa/NG43974_d08ef796c4a676aaec457e7d0008fdaf.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-07-02',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.5 Blue-HDi Signature',
'transmission': 'manual',
'trim': 'Signature',
'year': 2019}
2026-03-30 11:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NG43974%27 HTTP/1.1" 200 None
2026-03-30 11:18:24 [auto1.es] INFO: Saving data for NG43974: {'created_time': 1774869504.371317, 'last_price_update_time': 1774869504.37133, 'auction_closing_time': 1774969926.0}
2026-03-30 11:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NG43974') HTTP/1.1" 204 0
2026-03-30 11:18:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YA78719> (referer: https://www.auto1.com/v1/car-details-view/YA78719/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c47fa53-18a1-5cb5-9770-38490e31e57f with identifier: YA78719
2026-03-30 11:18:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c47fa53-18a1-5cb5-9770-38490e31e57f with scrape type 1
2026-03-30 11:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5c47fa53-18a1-5cb5-9770-38490e31e57f
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F3b%252F8f3b9915e1d6552005f3b41ed2b514a3%252Fpa%252FYA78719_5fae843b3e7a12d7c497bb7dc2694231.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_5fae843b3e7a12d7c497bb7dc2694231.jpg not downloaded yet
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F3b%252F8f3b9915e1d6552005f3b41ed2b514a3%252Fpa%252FYA78719_8854664b96d19babb7398b640a50029e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_8854664b96d19babb7398b640a50029e.jpg not downloaded yet
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F3b%252F8f3b9915e1d6552005f3b41ed2b514a3%252Fpa%252FYA78719_33cd0038cde3ec4721efab776b91263b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_33cd0038cde3ec4721efab776b91263b.jpg not downloaded yet
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F3b%252F8f3b9915e1d6552005f3b41ed2b514a3%252Fpa%252FYA78719_7e68d122339ed3910319567833a8262b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_7e68d122339ed3910319567833a8262b.jpg not downloaded yet
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F3b%252F8f3b9915e1d6552005f3b41ed2b514a3%252Fpa%252FYA78719_cdc8291454ed69c48679a016da5c472e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_cdc8291454ed69c48679a016da5c472e.jpg not downloaded yet
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F3b%252F8f3b9915e1d6552005f3b41ed2b514a3%252Fpa%252FYA78719_779572ec06228a3410e1861980738bf3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_779572ec06228a3410e1861980738bf3.jpg not downloaded yet
2026-03-30 11:18:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_5fae843b3e7a12d7c497bb7dc2694231.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F3b%252F8f3b9915e1d6552005f3b41ed2b514a3%252Fpa%252FYA78719_f503dbca9c434d64694ee70f3117182f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_f503dbca9c434d64694ee70f3117182f.jpg not downloaded yet
2026-03-30 11:18:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_8854664b96d19babb7398b640a50029e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F3b%252F8f3b9915e1d6552005f3b41ed2b514a3%252Fpa%252FYA78719_d335dc65b3379f8c3532b1ee38ebccfe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_d335dc65b3379f8c3532b1ee38ebccfe.jpg not downloaded yet
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F3b%252F8f3b9915e1d6552005f3b41ed2b514a3%252Fpa%252FYA78719_70d659708a41b9840f4bdd6d2f4a8fb7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_70d659708a41b9840f4bdd6d2f4a8fb7.jpg not downloaded yet
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F3b%252F8f3b9915e1d6552005f3b41ed2b514a3%252Fpa%252FYA78719_6dc5e1617e19b79408e29e9ea30828f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_6dc5e1617e19b79408e29e9ea30828f9.jpg not downloaded yet
2026-03-30 11:18:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060cf9950>
2026-03-30 11:18:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c47fa53-18a1-5cb5-9770-38490e31e57f/5c47fa53-18a1-5cb5-9770-38490e31e57f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F3b%252F8f3b9915e1d6552005f3b41ed2b514a3%252Fpa%252FYA78719_5fae843b3e7a12d7c497bb7dc2694231.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_5fae843b3e7a12d7c497bb7dc2694231.jpg saved to cache
2026-03-30 11:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5c47fa53-18a1-5cb5-9770-38490e31e57f
2026-03-30 11:18:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_f503dbca9c434d64694ee70f3117182f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_33cd0038cde3ec4721efab776b91263b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_7e68d122339ed3910319567833a8262b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a457c50>
2026-03-30 11:18:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c47fa53-18a1-5cb5-9770-38490e31e57f/5c47fa53-18a1-5cb5-9770-38490e31e57f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F3b%252F8f3b9915e1d6552005f3b41ed2b514a3%252Fpa%252FYA78719_8854664b96d19babb7398b640a50029e.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_8854664b96d19babb7398b640a50029e.jpg saved to cache
2026-03-30 11:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5c47fa53-18a1-5cb5-9770-38490e31e57f
2026-03-30 11:18:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_779572ec06228a3410e1861980738bf3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_cdc8291454ed69c48679a016da5c472e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_d335dc65b3379f8c3532b1ee38ebccfe.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc0615fe710>
2026-03-30 11:18:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c47fa53-18a1-5cb5-9770-38490e31e57f/5c47fa53-18a1-5cb5-9770-38490e31e57f_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F3b%252F8f3b9915e1d6552005f3b41ed2b514a3%252Fpa%252FYA78719_f503dbca9c434d64694ee70f3117182f.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_f503dbca9c434d64694ee70f3117182f.jpg saved to cache
2026-03-30 11:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5c47fa53-18a1-5cb5-9770-38490e31e57f
2026-03-30 11:18:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05aef9890>
2026-03-30 11:18:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c47fa53-18a1-5cb5-9770-38490e31e57f/5c47fa53-18a1-5cb5-9770-38490e31e57f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F3b%252F8f3b9915e1d6552005f3b41ed2b514a3%252Fpa%252FYA78719_33cd0038cde3ec4721efab776b91263b.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_33cd0038cde3ec4721efab776b91263b.jpg saved to cache
2026-03-30 11:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5c47fa53-18a1-5cb5-9770-38490e31e57f
2026-03-30 11:18:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ada9ed0>
2026-03-30 11:18:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c47fa53-18a1-5cb5-9770-38490e31e57f/5c47fa53-18a1-5cb5-9770-38490e31e57f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F3b%252F8f3b9915e1d6552005f3b41ed2b514a3%252Fpa%252FYA78719_7e68d122339ed3910319567833a8262b.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_7e68d122339ed3910319567833a8262b.jpg saved to cache
2026-03-30 11:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5c47fa53-18a1-5cb5-9770-38490e31e57f
2026-03-30 11:18:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_70d659708a41b9840f4bdd6d2f4a8fb7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_6dc5e1617e19b79408e29e9ea30828f9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a325bd0>
2026-03-30 11:18:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c47fa53-18a1-5cb5-9770-38490e31e57f/5c47fa53-18a1-5cb5-9770-38490e31e57f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F3b%252F8f3b9915e1d6552005f3b41ed2b514a3%252Fpa%252FYA78719_779572ec06228a3410e1861980738bf3.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_779572ec06228a3410e1861980738bf3.jpg saved to cache
2026-03-30 11:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5c47fa53-18a1-5cb5-9770-38490e31e57f
2026-03-30 11:18:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05aee16d0>
2026-03-30 11:18:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c47fa53-18a1-5cb5-9770-38490e31e57f/5c47fa53-18a1-5cb5-9770-38490e31e57f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F3b%252F8f3b9915e1d6552005f3b41ed2b514a3%252Fpa%252FYA78719_cdc8291454ed69c48679a016da5c472e.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_cdc8291454ed69c48679a016da5c472e.jpg saved to cache
2026-03-30 11:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5c47fa53-18a1-5cb5-9770-38490e31e57f
2026-03-30 11:18:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad8bad0>
2026-03-30 11:18:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c47fa53-18a1-5cb5-9770-38490e31e57f/5c47fa53-18a1-5cb5-9770-38490e31e57f_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F3b%252F8f3b9915e1d6552005f3b41ed2b514a3%252Fpa%252FYA78719_d335dc65b3379f8c3532b1ee38ebccfe.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_d335dc65b3379f8c3532b1ee38ebccfe.jpg saved to cache
2026-03-30 11:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5c47fa53-18a1-5cb5-9770-38490e31e57f
2026-03-30 11:18:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4a2a50>
2026-03-30 11:18:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c47fa53-18a1-5cb5-9770-38490e31e57f/5c47fa53-18a1-5cb5-9770-38490e31e57f_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F3b%252F8f3b9915e1d6552005f3b41ed2b514a3%252Fpa%252FYA78719_70d659708a41b9840f4bdd6d2f4a8fb7.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_70d659708a41b9840f4bdd6d2f4a8fb7.jpg saved to cache
2026-03-30 11:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5c47fa53-18a1-5cb5-9770-38490e31e57f
2026-03-30 11:18:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4a4ed0>
2026-03-30 11:18:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c47fa53-18a1-5cb5-9770-38490e31e57f/5c47fa53-18a1-5cb5-9770-38490e31e57f_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F3b%252F8f3b9915e1d6552005f3b41ed2b514a3%252Fpa%252FYA78719_6dc5e1617e19b79408e29e9ea30828f9.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_6dc5e1617e19b79408e29e9ea30828f9.jpg saved to cache
2026-03-30 11:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5c47fa53-18a1-5cb5-9770-38490e31e57f
2026-03-30 11:18:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5c47fa53-18a1-5cb5-9770-38490e31e57f, skipping ID generation
2026-03-30 11:18:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c47fa53-18a1-5cb5-9770-38490e31e57f with scrape type 1
2026-03-30 11:18:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5c47fa53-18a1-5cb5-9770-38490e31e57f sending to next pipeline
2026-03-30 11:18:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5c47fa53-18a1-5cb5-9770-38490e31e57f, identifier: YA78719
2026-03-30 11:18:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5c47fa53-18a1-5cb5-9770-38490e31e57f with identifier: YA78719
2026-03-30 11:18:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5c47fa53-18a1-5cb5-9770-38490e31e57f with identifier: YA78719
2026-03-30 11:18:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5c47fa53-18a1-5cb5-9770-38490e31e57f with identifier: YA78719 to the API
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_6dc5e1617e19b79408e29e9ea30828f9.jpg>
{'auction_title': '',
'c_o_2_emission_value': 140,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:13:19Z',
'fuel_type': 'petrol',
'id': '5c47fa53-18a1-5cb5-9770-38490e31e57f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA78719',
'listing': 'auction',
'location': 'ES, Santa Ana',
'make': 'Kia',
'model': 'Venga',
'odometer': 49103,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c47fa53-18a1-5cb5-9770-38490e31e57f/5c47fa53-18a1-5cb5-9770-38490e31e57f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71244,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_5fae843b3e7a12d7c497bb7dc2694231.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c47fa53-18a1-5cb5-9770-38490e31e57f/5c47fa53-18a1-5cb5-9770-38490e31e57f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66905,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_8854664b96d19babb7398b640a50029e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c47fa53-18a1-5cb5-9770-38490e31e57f/5c47fa53-18a1-5cb5-9770-38490e31e57f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62337,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_33cd0038cde3ec4721efab776b91263b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c47fa53-18a1-5cb5-9770-38490e31e57f/5c47fa53-18a1-5cb5-9770-38490e31e57f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61956,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_7e68d122339ed3910319567833a8262b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c47fa53-18a1-5cb5-9770-38490e31e57f/5c47fa53-18a1-5cb5-9770-38490e31e57f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55574,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_cdc8291454ed69c48679a016da5c472e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c47fa53-18a1-5cb5-9770-38490e31e57f/5c47fa53-18a1-5cb5-9770-38490e31e57f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61462,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_779572ec06228a3410e1861980738bf3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c47fa53-18a1-5cb5-9770-38490e31e57f/5c47fa53-18a1-5cb5-9770-38490e31e57f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54317,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_f503dbca9c434d64694ee70f3117182f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c47fa53-18a1-5cb5-9770-38490e31e57f/5c47fa53-18a1-5cb5-9770-38490e31e57f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71522,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_d335dc65b3379f8c3532b1ee38ebccfe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c47fa53-18a1-5cb5-9770-38490e31e57f/5c47fa53-18a1-5cb5-9770-38490e31e57f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69014,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_70d659708a41b9840f4bdd6d2f4a8fb7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c47fa53-18a1-5cb5-9770-38490e31e57f/5c47fa53-18a1-5cb5-9770-38490e31e57f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55488,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/3b/8f3b9915e1d6552005f3b41ed2b514a3/pa/YA78719_6dc5e1617e19b79408e29e9ea30828f9.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-05-25',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Venga 1.4 Concept',
'transmission': 'manual',
'trim': 'Concept',
'year': 2017}
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YA78719%27 HTTP/1.1" 200 None
2026-03-30 11:18:26 [auto1.es] INFO: Saving data for YA78719: {'created_time': 1774869506.766871, 'last_price_update_time': 1774869506.766883, 'auction_closing_time': 1774969999.0}
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YA78719') HTTP/1.1" 204 0
2026-03-30 11:18:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MB90755> (referer: https://www.auto1.com/v1/car-details-view/MB90755/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PV91005/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f95056b-7942-5cef-9da4-96050d7decd0 with identifier: MB90755
2026-03-30 11:18:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f95056b-7942-5cef-9da4-96050d7decd0 with scrape type 1
2026-03-30 11:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1f95056b-7942-5cef-9da4-96050d7decd0
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F22%252Fc522f35d1ba59882e6f153a5c21fab65%252Fpa%252FMB90755_ac9b429d982a63f7dfd2b4f1ffbf80c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_ac9b429d982a63f7dfd2b4f1ffbf80c2.jpg not downloaded yet
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F22%252Fc522f35d1ba59882e6f153a5c21fab65%252Fpa%252FMB90755_f72f3b7a91c536dd138e6b429c79545a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_f72f3b7a91c536dd138e6b429c79545a.jpg not downloaded yet
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F22%252Fc522f35d1ba59882e6f153a5c21fab65%252Fpa%252FMB90755_4e4ad47e2319a5fe39baa0fead056cec.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_4e4ad47e2319a5fe39baa0fead056cec.jpg not downloaded yet
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F22%252Fc522f35d1ba59882e6f153a5c21fab65%252Fpa%252FMB90755_f9b3cb093c0e6ae30900e9377e0c6bbf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_f9b3cb093c0e6ae30900e9377e0c6bbf.jpg not downloaded yet
2026-03-30 11:18:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F22%252Fc522f35d1ba59882e6f153a5c21fab65%252Fpa%252FMB90755_ef469680b11918dd0c1b4ad98c8a2d19.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_ef469680b11918dd0c1b4ad98c8a2d19.jpg not downloaded yet
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F22%252Fc522f35d1ba59882e6f153a5c21fab65%252Fpa%252FMB90755_806e7bf0d17825c0b27ea77ce5858524.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_806e7bf0d17825c0b27ea77ce5858524.jpg not downloaded yet
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F22%252Fc522f35d1ba59882e6f153a5c21fab65%252Fpa%252FMB90755_61e9c0c22a6add7d0f98227d61ba89af.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_61e9c0c22a6add7d0f98227d61ba89af.jpg not downloaded yet
2026-03-30 11:18:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_ac9b429d982a63f7dfd2b4f1ffbf80c2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F22%252Fc522f35d1ba59882e6f153a5c21fab65%252Fpa%252FMB90755_5d5507c69cd2266cac8cc33027617a3f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_5d5507c69cd2266cac8cc33027617a3f.jpg not downloaded yet
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F22%252Fc522f35d1ba59882e6f153a5c21fab65%252Fpa%252FMB90755_df3e3ad0b2a485bd3de2a9400e9cbafe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_df3e3ad0b2a485bd3de2a9400e9cbafe.jpg not downloaded yet
2026-03-30 11:18:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_f9b3cb093c0e6ae30900e9377e0c6bbf.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_ef469680b11918dd0c1b4ad98c8a2d19.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F22%252Fc522f35d1ba59882e6f153a5c21fab65%252Fpa%252FMB90755_0b2817d893a32377db1e6afe3e161ff2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_0b2817d893a32377db1e6afe3e161ff2.jpg not downloaded yet
2026-03-30 11:18:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_df3e3ad0b2a485bd3de2a9400e9cbafe.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_806e7bf0d17825c0b27ea77ce5858524.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a344190>
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f95056b-7942-5cef-9da4-96050d7decd0/1f95056b-7942-5cef-9da4-96050d7decd0_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F22%252Fc522f35d1ba59882e6f153a5c21fab65%252Fpa%252FMB90755_ac9b429d982a63f7dfd2b4f1ffbf80c2.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_ac9b429d982a63f7dfd2b4f1ffbf80c2.jpg saved to cache
2026-03-30 11:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1f95056b-7942-5cef-9da4-96050d7decd0
2026-03-30 11:18:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_61e9c0c22a6add7d0f98227d61ba89af.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_5d5507c69cd2266cac8cc33027617a3f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_0b2817d893a32377db1e6afe3e161ff2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a367cd0>
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f95056b-7942-5cef-9da4-96050d7decd0/1f95056b-7942-5cef-9da4-96050d7decd0_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F22%252Fc522f35d1ba59882e6f153a5c21fab65%252Fpa%252FMB90755_f9b3cb093c0e6ae30900e9377e0c6bbf.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_f9b3cb093c0e6ae30900e9377e0c6bbf.jpg saved to cache
2026-03-30 11:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1f95056b-7942-5cef-9da4-96050d7decd0
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a461d50>
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f95056b-7942-5cef-9da4-96050d7decd0/1f95056b-7942-5cef-9da4-96050d7decd0_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F22%252Fc522f35d1ba59882e6f153a5c21fab65%252Fpa%252FMB90755_ef469680b11918dd0c1b4ad98c8a2d19.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_ef469680b11918dd0c1b4ad98c8a2d19.jpg saved to cache
2026-03-30 11:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1f95056b-7942-5cef-9da4-96050d7decd0
2026-03-30 11:18:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_f72f3b7a91c536dd138e6b429c79545a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_4e4ad47e2319a5fe39baa0fead056cec.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc0610f91d0>
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f95056b-7942-5cef-9da4-96050d7decd0/1f95056b-7942-5cef-9da4-96050d7decd0_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F22%252Fc522f35d1ba59882e6f153a5c21fab65%252Fpa%252FMB90755_df3e3ad0b2a485bd3de2a9400e9cbafe.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_df3e3ad0b2a485bd3de2a9400e9cbafe.jpg saved to cache
2026-03-30 11:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1f95056b-7942-5cef-9da4-96050d7decd0
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a466210>
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f95056b-7942-5cef-9da4-96050d7decd0/1f95056b-7942-5cef-9da4-96050d7decd0_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F22%252Fc522f35d1ba59882e6f153a5c21fab65%252Fpa%252FMB90755_806e7bf0d17825c0b27ea77ce5858524.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_806e7bf0d17825c0b27ea77ce5858524.jpg saved to cache
2026-03-30 11:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1f95056b-7942-5cef-9da4-96050d7decd0
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a364a50>
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f95056b-7942-5cef-9da4-96050d7decd0/1f95056b-7942-5cef-9da4-96050d7decd0_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F22%252Fc522f35d1ba59882e6f153a5c21fab65%252Fpa%252FMB90755_61e9c0c22a6add7d0f98227d61ba89af.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_61e9c0c22a6add7d0f98227d61ba89af.jpg saved to cache
2026-03-30 11:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1f95056b-7942-5cef-9da4-96050d7decd0
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4fbe50>
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f95056b-7942-5cef-9da4-96050d7decd0/1f95056b-7942-5cef-9da4-96050d7decd0_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F22%252Fc522f35d1ba59882e6f153a5c21fab65%252Fpa%252FMB90755_5d5507c69cd2266cac8cc33027617a3f.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_5d5507c69cd2266cac8cc33027617a3f.jpg saved to cache
2026-03-30 11:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1f95056b-7942-5cef-9da4-96050d7decd0
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a384950>
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f95056b-7942-5cef-9da4-96050d7decd0/1f95056b-7942-5cef-9da4-96050d7decd0_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F22%252Fc522f35d1ba59882e6f153a5c21fab65%252Fpa%252FMB90755_0b2817d893a32377db1e6afe3e161ff2.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_0b2817d893a32377db1e6afe3e161ff2.jpg saved to cache
2026-03-30 11:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1f95056b-7942-5cef-9da4-96050d7decd0
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a33f290>
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f95056b-7942-5cef-9da4-96050d7decd0/1f95056b-7942-5cef-9da4-96050d7decd0_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F22%252Fc522f35d1ba59882e6f153a5c21fab65%252Fpa%252FMB90755_f72f3b7a91c536dd138e6b429c79545a.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_f72f3b7a91c536dd138e6b429c79545a.jpg saved to cache
2026-03-30 11:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1f95056b-7942-5cef-9da4-96050d7decd0
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a387bd0>
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f95056b-7942-5cef-9da4-96050d7decd0/1f95056b-7942-5cef-9da4-96050d7decd0_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F22%252Fc522f35d1ba59882e6f153a5c21fab65%252Fpa%252FMB90755_4e4ad47e2319a5fe39baa0fead056cec.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_4e4ad47e2319a5fe39baa0fead056cec.jpg saved to cache
2026-03-30 11:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1f95056b-7942-5cef-9da4-96050d7decd0
2026-03-30 11:18:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1f95056b-7942-5cef-9da4-96050d7decd0, skipping ID generation
2026-03-30 11:18:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f95056b-7942-5cef-9da4-96050d7decd0 with scrape type 1
2026-03-30 11:18:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1f95056b-7942-5cef-9da4-96050d7decd0 sending to next pipeline
2026-03-30 11:18:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1f95056b-7942-5cef-9da4-96050d7decd0, identifier: MB90755
2026-03-30 11:18:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1f95056b-7942-5cef-9da4-96050d7decd0 with identifier: MB90755
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-30 11:18:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:18:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1f95056b-7942-5cef-9da4-96050d7decd0 with identifier: MB90755
2026-03-30 11:18:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1f95056b-7942-5cef-9da4-96050d7decd0 with identifier: MB90755 to the API
2026-03-30 11:18:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_4e4ad47e2319a5fe39baa0fead056cec.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 102,
'expiration_date': '2026-03-31T15:08:49Z',
'fuel_type': 'gas',
'id': '1f95056b-7942-5cef-9da4-96050d7decd0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB90755',
'listing': 'auction',
'location': 'ES',
'make': 'Dacia',
'model': 'Dokker Express',
'odometer': 179229,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f95056b-7942-5cef-9da4-96050d7decd0/1f95056b-7942-5cef-9da4-96050d7decd0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 126378,
'Height': 960,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_ac9b429d982a63f7dfd2b4f1ffbf80c2.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f95056b-7942-5cef-9da4-96050d7decd0/1f95056b-7942-5cef-9da4-96050d7decd0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69017,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_f72f3b7a91c536dd138e6b429c79545a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f95056b-7942-5cef-9da4-96050d7decd0/1f95056b-7942-5cef-9da4-96050d7decd0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55041,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_4e4ad47e2319a5fe39baa0fead056cec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f95056b-7942-5cef-9da4-96050d7decd0/1f95056b-7942-5cef-9da4-96050d7decd0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103637,
'Height': 960,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_f9b3cb093c0e6ae30900e9377e0c6bbf.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f95056b-7942-5cef-9da4-96050d7decd0/1f95056b-7942-5cef-9da4-96050d7decd0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71895,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_ef469680b11918dd0c1b4ad98c8a2d19.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f95056b-7942-5cef-9da4-96050d7decd0/1f95056b-7942-5cef-9da4-96050d7decd0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 139103,
'Height': 960,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_806e7bf0d17825c0b27ea77ce5858524.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f95056b-7942-5cef-9da4-96050d7decd0/1f95056b-7942-5cef-9da4-96050d7decd0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 139103,
'Height': 960,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_61e9c0c22a6add7d0f98227d61ba89af.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f95056b-7942-5cef-9da4-96050d7decd0/1f95056b-7942-5cef-9da4-96050d7decd0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 139103,
'Height': 960,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_5d5507c69cd2266cac8cc33027617a3f.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f95056b-7942-5cef-9da4-96050d7decd0/1f95056b-7942-5cef-9da4-96050d7decd0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91580,
'Height': 960,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_df3e3ad0b2a485bd3de2a9400e9cbafe.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f95056b-7942-5cef-9da4-96050d7decd0/1f95056b-7942-5cef-9da4-96050d7decd0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92103,
'Height': 960,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/22/c522f35d1ba59882e6f153a5c21fab65/pa/MB90755_0b2817d893a32377db1e6afe3e161ff2.jpg',
'Width': 1280}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-06-27',
'seats_number': 2,
'seller_name': None,
'title': 'Dacia Dokker Express 1.6 SCe Benzin / LPG Essential',
'transmission': 'manual',
'trim': 'Essential',
'year': 2019}
2026-03-30 11:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MB90755%27 HTTP/1.1" 200 None
2026-03-30 11:18:28 [auto1.es] INFO: Saving data for MB90755: {'created_time': 1774869508.257759, 'last_price_update_time': 1774869508.25777, 'auction_closing_time': 1774969729.0}
2026-03-30 11:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MB90755') HTTP/1.1" 204 0
2026-03-30 11:18:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PV91005> (referer: https://www.auto1.com/v1/car-details-view/PV91005/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e05b9d8b-c129-51e8-9691-964f3829e49e with identifier: PV91005
2026-03-30 11:18:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e05b9d8b-c129-51e8-9691-964f3829e49e with scrape type 1
2026-03-30 11:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e05b9d8b-c129-51e8-9691-964f3829e49e
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F0e%252Fd90eb7b63f05f863f88ada1aa62fe0ca%252Fpa%252FPV91005_c67e516fd6e7557c180acd95656a6669.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/0e/d90eb7b63f05f863f88ada1aa62fe0ca/pa/PV91005_c67e516fd6e7557c180acd95656a6669.jpg already downloaded
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F0e%252Fd90eb7b63f05f863f88ada1aa62fe0ca%252Fpa%252FPV91005_563cb000450e9d430f6fd90e71d5ebfd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/0e/d90eb7b63f05f863f88ada1aa62fe0ca/pa/PV91005_563cb000450e9d430f6fd90e71d5ebfd.jpg already downloaded
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F0e%252Fd90eb7b63f05f863f88ada1aa62fe0ca%252Fpa%252FPV91005_201f93f5ad06dad727934cbd323a670d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/0e/d90eb7b63f05f863f88ada1aa62fe0ca/pa/PV91005_201f93f5ad06dad727934cbd323a670d.jpg already downloaded
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F0e%252Fd90eb7b63f05f863f88ada1aa62fe0ca%252Fpa%252FPV91005_41f6df90fcfc72df76534547cc04c5a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/0e/d90eb7b63f05f863f88ada1aa62fe0ca/pa/PV91005_41f6df90fcfc72df76534547cc04c5a8.jpg already downloaded
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F0e%252Fd90eb7b63f05f863f88ada1aa62fe0ca%252Fpa%252FPV91005_8e313cbe1491cd5110c0bebcda051a87.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/0e/d90eb7b63f05f863f88ada1aa62fe0ca/pa/PV91005_8e313cbe1491cd5110c0bebcda051a87.jpg already downloaded
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F0e%252Fd90eb7b63f05f863f88ada1aa62fe0ca%252Fpa%252FPV91005_f2ad5d7ebea025a7f839ca34e95f9b75.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/0e/d90eb7b63f05f863f88ada1aa62fe0ca/pa/PV91005_f2ad5d7ebea025a7f839ca34e95f9b75.jpg already downloaded
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F0e%252Fd90eb7b63f05f863f88ada1aa62fe0ca%252Fpa%252FPV91005_2e4e101233a6db6b5340196ebe484816.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/0e/d90eb7b63f05f863f88ada1aa62fe0ca/pa/PV91005_2e4e101233a6db6b5340196ebe484816.jpg already downloaded
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F0e%252Fd90eb7b63f05f863f88ada1aa62fe0ca%252Fpa%252FPV91005_059c43fe7128dc1dfd22d3b488f9d1ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/0e/d90eb7b63f05f863f88ada1aa62fe0ca/pa/PV91005_059c43fe7128dc1dfd22d3b488f9d1ac.jpg already downloaded
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F0e%252Fd90eb7b63f05f863f88ada1aa62fe0ca%252Fpa%252FPV91005_2fb3178487ed6359ce5d95a66548b877.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/0e/d90eb7b63f05f863f88ada1aa62fe0ca/pa/PV91005_2fb3178487ed6359ce5d95a66548b877.jpg already downloaded
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F0e%252Fd90eb7b63f05f863f88ada1aa62fe0ca%252Fpa%252FPV91005_e026cfd5b9b743fe289183b0c288af3e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/0e/d90eb7b63f05f863f88ada1aa62fe0ca/pa/PV91005_e026cfd5b9b743fe289183b0c288af3e.jpg already downloaded
2026-03-30 11:18:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e05b9d8b-c129-51e8-9691-964f3829e49e, identifier: PV91005
2026-03-30 11:18:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e05b9d8b-c129-51e8-9691-964f3829e49e with identifier: PV91005
2026-03-30 11:18:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e05b9d8b-c129-51e8-9691-964f3829e49e with identifier: PV91005
2026-03-30 11:18:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e05b9d8b-c129-51e8-9691-964f3829e49e with identifier: PV91005 to the API
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PV91005>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.7L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:47:03Z',
'fuel_type': 'diesel',
'id': 'e05b9d8b-c129-51e8-9691-964f3829e49e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV91005',
'listing': 'auction',
'location': 'ES, El Prat de Llobregat (Barcelona)',
'make': 'Opel',
'model': 'Zafira',
'odometer': 63094,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgd9/0e/d90eb7b63f05f863f88ada1aa62fe0ca/pa/PV91005_c67e516fd6e7557c180acd95656a6669.jpg',
'https://img-pa.auto1.com/imgd9/0e/d90eb7b63f05f863f88ada1aa62fe0ca/pa/PV91005_563cb000450e9d430f6fd90e71d5ebfd.jpg',
'https://img-pa.auto1.com/imgd9/0e/d90eb7b63f05f863f88ada1aa62fe0ca/pa/PV91005_201f93f5ad06dad727934cbd323a670d.jpg',
'https://img-pa.auto1.com/imgd9/0e/d90eb7b63f05f863f88ada1aa62fe0ca/pa/PV91005_41f6df90fcfc72df76534547cc04c5a8.jpg',
'https://img-pa.auto1.com/imgd9/0e/d90eb7b63f05f863f88ada1aa62fe0ca/pa/PV91005_8e313cbe1491cd5110c0bebcda051a87.jpg',
'https://img-pa.auto1.com/imgd9/0e/d90eb7b63f05f863f88ada1aa62fe0ca/pa/PV91005_f2ad5d7ebea025a7f839ca34e95f9b75.jpg',
'https://img-pa.auto1.com/imgd9/0e/d90eb7b63f05f863f88ada1aa62fe0ca/pa/PV91005_2e4e101233a6db6b5340196ebe484816.jpg',
'https://img-pa.auto1.com/imgd9/0e/d90eb7b63f05f863f88ada1aa62fe0ca/pa/PV91005_059c43fe7128dc1dfd22d3b488f9d1ac.jpg',
'https://img-pa.auto1.com/imgd9/0e/d90eb7b63f05f863f88ada1aa62fe0ca/pa/PV91005_2fb3178487ed6359ce5d95a66548b877.jpg',
'https://img-pa.auto1.com/imgd9/0e/d90eb7b63f05f863f88ada1aa62fe0ca/pa/PV91005_e026cfd5b9b743fe289183b0c288af3e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e05b9d8b-c129-51e8-9691-964f3829e49e/e05b9d8b-c129-51e8-9691-964f3829e49e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60943,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/imgd9/0e/d90eb7b63f05f863f88ada1aa62fe0ca/pa/PV91005_c67e516fd6e7557c180acd95656a6669.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e05b9d8b-c129-51e8-9691-964f3829e49e/e05b9d8b-c129-51e8-9691-964f3829e49e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58731,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/imgd9/0e/d90eb7b63f05f863f88ada1aa62fe0ca/pa/PV91005_563cb000450e9d430f6fd90e71d5ebfd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e05b9d8b-c129-51e8-9691-964f3829e49e/e05b9d8b-c129-51e8-9691-964f3829e49e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54538,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/imgd9/0e/d90eb7b63f05f863f88ada1aa62fe0ca/pa/PV91005_201f93f5ad06dad727934cbd323a670d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e05b9d8b-c129-51e8-9691-964f3829e49e/e05b9d8b-c129-51e8-9691-964f3829e49e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46952,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/imgd9/0e/d90eb7b63f05f863f88ada1aa62fe0ca/pa/PV91005_41f6df90fcfc72df76534547cc04c5a8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e05b9d8b-c129-51e8-9691-964f3829e49e/e05b9d8b-c129-51e8-9691-964f3829e49e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45553,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/imgd9/0e/d90eb7b63f05f863f88ada1aa62fe0ca/pa/PV91005_8e313cbe1491cd5110c0bebcda051a87.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e05b9d8b-c129-51e8-9691-964f3829e49e/e05b9d8b-c129-51e8-9691-964f3829e49e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52653,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/imgd9/0e/d90eb7b63f05f863f88ada1aa62fe0ca/pa/PV91005_f2ad5d7ebea025a7f839ca34e95f9b75.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e05b9d8b-c129-51e8-9691-964f3829e49e/e05b9d8b-c129-51e8-9691-964f3829e49e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61316,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/imgd9/0e/d90eb7b63f05f863f88ada1aa62fe0ca/pa/PV91005_2e4e101233a6db6b5340196ebe484816.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e05b9d8b-c129-51e8-9691-964f3829e49e/e05b9d8b-c129-51e8-9691-964f3829e49e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65411,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/imgd9/0e/d90eb7b63f05f863f88ada1aa62fe0ca/pa/PV91005_059c43fe7128dc1dfd22d3b488f9d1ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e05b9d8b-c129-51e8-9691-964f3829e49e/e05b9d8b-c129-51e8-9691-964f3829e49e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55160,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/imgd9/0e/d90eb7b63f05f863f88ada1aa62fe0ca/pa/PV91005_2fb3178487ed6359ce5d95a66548b877.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e05b9d8b-c129-51e8-9691-964f3829e49e/e05b9d8b-c129-51e8-9691-964f3829e49e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60524,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd9/0e/d90eb7b63f05f863f88ada1aa62fe0ca/pa/PV91005_e026cfd5b9b743fe289183b0c288af3e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-09-28',
'seats_number': 7,
'seller_name': None,
'title': 'Opel Zafira 1.7 CDTI Family',
'transmission': 'manual',
'trim': 'Family',
'year': 2014}
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PV91005%27 HTTP/1.1" 200 None
2026-03-30 11:18:29 [auto1.es] INFO: Saving data for PV91005: {'created_time': 1774869509.881833, 'last_price_update_time': 1774869509.881849, 'auction_closing_time': 1774972023.0}
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PV91005') HTTP/1.1" 204 0
2026-03-30 11:18:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:32 [auto1.es] INFO: Channel: 24h | Page: 3 | totalHits: 2211 | hits on page: 40
2026-03-30 11:18:32 [auto1.es] INFO: Found listing with ID: LA52472
2026-03-30 11:18:32 [auto1.es] INFO: Found listing with ID: JN94907
2026-03-30 11:18:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JN94907%27 HTTP/1.1" 200 None
2026-03-30 11:18:32 [auto1.es] INFO: Scrape type for JN94907: 0
2026-03-30 11:18:32 [auto1.es] INFO: Found listing with ID: YP32131
2026-03-30 11:18:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YP32131%27 HTTP/1.1" 200 None
2026-03-30 11:18:32 [auto1.es] INFO: Scrape type for YP32131: 0
2026-03-30 11:18:32 [auto1.es] INFO: Found listing with ID: UR30668
2026-03-30 11:18:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UR30668%27 HTTP/1.1" 200 None
2026-03-30 11:18:32 [auto1.es] INFO: Scrape type for UR30668: 0
2026-03-30 11:18:32 [auto1.es] INFO: Found listing with ID: KV96950
2026-03-30 11:18:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KV96950%27 HTTP/1.1" 200 None
2026-03-30 11:18:32 [auto1.es] INFO: Scrape type for KV96950: 1
2026-03-30 11:18:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:32 [auto1.es] INFO: Found listing with ID: VH67145
2026-03-30 11:18:32 [auto1.es] INFO: Found listing with ID: VY38329
2026-03-30 11:18:32 [auto1.es] INFO: Found listing with ID: NF65765
2026-03-30 11:18:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NF65765%27 HTTP/1.1" 200 None
2026-03-30 11:18:32 [auto1.es] INFO: Scrape type for NF65765: 2
2026-03-30 11:18:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9cc5aea-714d-5d93-9898-58a475685c4a with identifier: NF65765
2026-03-30 11:18:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9cc5aea-714d-5d93-9898-58a475685c4a with scrape type 2
2026-03-30 11:18:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9cc5aea-714d-5d93-9898-58a475685c4a with scrape type 2
2026-03-30 11:18:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f9cc5aea-714d-5d93-9898-58a475685c4a, identifier: NF65765
2026-03-30 11:18:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f9cc5aea-714d-5d93-9898-58a475685c4a with identifier: NF65765
2026-03-30 11:18:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f9cc5aea-714d-5d93-9898-58a475685c4a with identifier: NF65765
2026-03-30 11:18:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f9cc5aea-714d-5d93-9898-58a475685c4a with identifier: NF65765 to the API
2026-03-30 11:18:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:14:11Z',
'fuel_type': 'diesel',
'id': 'f9cc5aea-714d-5d93-9898-58a475685c4a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF65765',
'listing': 'auction',
'make': 'Fiat',
'model': '500X',
'odometer': 170057,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-27',
'seller_name': None,
'title': 'Fiat 500X 1.6 JTDM Pop Star',
'transmission': 'manual',
'trim': 'Pop Star',
'year': 2016}
2026-03-30 11:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NF65765%27 HTTP/1.1" 200 None
2026-03-30 11:18:33 [auto1.es] INFO: Saving data for NF65765: {'auction_closing_time': 1774970051.0, 'created_time': 1773131354.944547, 'last_price_update_time': 1774869513.684271}
2026-03-30 11:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NF65765') HTTP/1.1" 204 0
2026-03-30 11:18:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:33 [auto1.es] INFO: Found listing with ID: GR53173
2026-03-30 11:18:33 [auto1.es] INFO: Found listing with ID: JU92139
2026-03-30 11:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JU92139%27 HTTP/1.1" 200 None
2026-03-30 11:18:33 [auto1.es] INFO: Scrape type for JU92139: 1
2026-03-30 11:18:33 [auto1.es] INFO: Found listing with ID: ZW32185
2026-03-30 11:18:33 [auto1.es] INFO: Found listing with ID: JZ24217
2026-03-30 11:18:33 [auto1.es] INFO: Found listing with ID: RZ14437
2026-03-30 11:18:33 [auto1.es] INFO: Found listing with ID: EG30412
2026-03-30 11:18:33 [auto1.es] INFO: Found listing with ID: VR33132
2026-03-30 11:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VR33132%27 HTTP/1.1" 200 None
2026-03-30 11:18:33 [auto1.es] INFO: Scrape type for VR33132: 1
2026-03-30 11:18:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:33 [auto1.es] INFO: Found listing with ID: PH66754
2026-03-30 11:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PH66754%27 HTTP/1.1" 200 None
2026-03-30 11:18:33 [auto1.es] INFO: Scrape type for PH66754: 1
2026-03-30 11:18:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:33 [auto1.es] INFO: Found listing with ID: NF19160
2026-03-30 11:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NF19160%27 HTTP/1.1" 200 None
2026-03-30 11:18:33 [auto1.es] INFO: Scrape type for NF19160: 2
2026-03-30 11:18:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 114c4a6e-cf08-53eb-bdb1-b7a27f7393f1 with identifier: NF19160
2026-03-30 11:18:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 114c4a6e-cf08-53eb-bdb1-b7a27f7393f1 with scrape type 2
2026-03-30 11:18:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 114c4a6e-cf08-53eb-bdb1-b7a27f7393f1 with scrape type 2
2026-03-30 11:18:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 114c4a6e-cf08-53eb-bdb1-b7a27f7393f1, identifier: NF19160
2026-03-30 11:18:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 114c4a6e-cf08-53eb-bdb1-b7a27f7393f1 with identifier: NF19160
2026-03-30 11:18:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 114c4a6e-cf08-53eb-bdb1-b7a27f7393f1 with identifier: NF19160
2026-03-30 11:18:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 114c4a6e-cf08-53eb-bdb1-b7a27f7393f1 with identifier: NF19160 to the API
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:55:52Z',
'fuel_type': 'diesel',
'id': '114c4a6e-cf08-53eb-bdb1-b7a27f7393f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF19160',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 165533,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-29',
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2011}
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NF19160%27 HTTP/1.1" 200 None
2026-03-30 11:18:34 [auto1.es] INFO: Saving data for NF19160: {'auction_closing_time': 1774972552.0, 'created_time': 1773295398.106973, 'last_price_update_time': 1774869514.599027}
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NF19160') HTTP/1.1" 204 0
2026-03-30 11:18:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:34 [auto1.es] INFO: Found listing with ID: AM93012
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AM93012%27 HTTP/1.1" 200 None
2026-03-30 11:18:34 [auto1.es] INFO: Scrape type for AM93012: 2
2026-03-30 11:18:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a65452c9-4c15-5469-ad9e-3b9e655f2ce1 with identifier: AM93012
2026-03-30 11:18:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a65452c9-4c15-5469-ad9e-3b9e655f2ce1 with scrape type 2
2026-03-30 11:18:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a65452c9-4c15-5469-ad9e-3b9e655f2ce1 with scrape type 2
2026-03-30 11:18:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a65452c9-4c15-5469-ad9e-3b9e655f2ce1, identifier: AM93012
2026-03-30 11:18:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a65452c9-4c15-5469-ad9e-3b9e655f2ce1 with identifier: AM93012
2026-03-30 11:18:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a65452c9-4c15-5469-ad9e-3b9e655f2ce1 with identifier: AM93012
2026-03-30 11:18:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a65452c9-4c15-5469-ad9e-3b9e655f2ce1 with identifier: AM93012 to the API
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:27:21Z',
'fuel_type': 'diesel',
'id': 'a65452c9-4c15-5469-ad9e-3b9e655f2ce1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM93012',
'listing': 'auction',
'make': 'Toyota',
'model': 'Corolla Verso',
'odometer': 269863,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-09-20',
'seller_name': None,
'title': 'Toyota Corolla Verso 2.0 D-4D Luna',
'transmission': 'manual',
'trim': 'Luna',
'year': 2004}
2026-03-30 11:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AM93012%27 HTTP/1.1" 200 None
2026-03-30 11:18:35 [auto1.es] INFO: Saving data for AM93012: {'auction_closing_time': 1774970841.0, 'created_time': 1773132876.056737, 'last_price_update_time': 1774869515.366509}
2026-03-30 11:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AM93012') HTTP/1.1" 204 0
2026-03-30 11:18:35 [auto1.es] INFO: Found listing with ID: JN23347
2026-03-30 11:18:35 [auto1.es] INFO: Found listing with ID: JZ66468
2026-03-30 11:18:35 [auto1.es] INFO: Found listing with ID: BN28456
2026-03-30 11:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BN28456%27 HTTP/1.1" 200 None
2026-03-30 11:18:35 [auto1.es] INFO: Scrape type for BN28456: 1
2026-03-30 11:18:35 [auto1.es] INFO: Found listing with ID: WU48327
2026-03-30 11:18:35 [auto1.es] INFO: Found listing with ID: FG26244
2026-03-30 11:18:35 [auto1.es] INFO: Found listing with ID: VC05835
2026-03-30 11:18:35 [auto1.es] INFO: Found listing with ID: YF63614
2026-03-30 11:18:35 [auto1.es] INFO: Found listing with ID: GC12558
2026-03-30 11:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GC12558%27 HTTP/1.1" 200 None
2026-03-30 11:18:35 [auto1.es] INFO: Scrape type for GC12558: 2
2026-03-30 11:18:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b62d5c4-b957-585d-94d9-7a220c58d2cd with identifier: GC12558
2026-03-30 11:18:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b62d5c4-b957-585d-94d9-7a220c58d2cd with scrape type 2
2026-03-30 11:18:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b62d5c4-b957-585d-94d9-7a220c58d2cd with scrape type 2
2026-03-30 11:18:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5b62d5c4-b957-585d-94d9-7a220c58d2cd, identifier: GC12558
2026-03-30 11:18:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5b62d5c4-b957-585d-94d9-7a220c58d2cd with identifier: GC12558
2026-03-30 11:18:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5b62d5c4-b957-585d-94d9-7a220c58d2cd with identifier: GC12558
2026-03-30 11:18:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5b62d5c4-b957-585d-94d9-7a220c58d2cd with identifier: GC12558 to the API
2026-03-30 11:18:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:27:48Z',
'fuel_type': 'diesel',
'id': '5b62d5c4-b957-585d-94d9-7a220c58d2cd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC12558',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Boxer',
'odometer': 220748,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-16',
'seller_name': None,
'title': 'Peugeot Boxer 2.0 Blue-HDi 335 L3H2 Pro BlueHDi 130',
'transmission': 'manual',
'trim': '335 L3H2 Pro BlueHDi 130',
'year': 2019}
2026-03-30 11:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GC12558%27 HTTP/1.1" 200 None
2026-03-30 11:18:35 [auto1.es] INFO: Saving data for GC12558: {'auction_closing_time': 1774970868.0, 'created_time': 1774471124.057586, 'last_price_update_time': 1774869515.90345}
2026-03-30 11:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GC12558') HTTP/1.1" 204 0
2026-03-30 11:18:35 [auto1.es] INFO: Found listing with ID: JF50007
2026-03-30 11:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JF50007%27 HTTP/1.1" 200 None
2026-03-30 11:18:35 [auto1.es] INFO: Scrape type for JF50007: 2
2026-03-30 11:18:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 903967ec-c12c-507a-93d7-954fcd44a10f with identifier: JF50007
2026-03-30 11:18:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 903967ec-c12c-507a-93d7-954fcd44a10f with scrape type 2
2026-03-30 11:18:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 903967ec-c12c-507a-93d7-954fcd44a10f with scrape type 2
2026-03-30 11:18:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 903967ec-c12c-507a-93d7-954fcd44a10f, identifier: JF50007
2026-03-30 11:18:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 903967ec-c12c-507a-93d7-954fcd44a10f with identifier: JF50007
2026-03-30 11:18:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:18:36 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-30 11:18:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:18:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 903967ec-c12c-507a-93d7-954fcd44a10f with identifier: JF50007
2026-03-30 11:18:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 903967ec-c12c-507a-93d7-954fcd44a10f with identifier: JF50007 to the API
2026-03-30 11:18:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:43:38Z',
'fuel_type': 'petrol',
'id': '903967ec-c12c-507a-93d7-954fcd44a10f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF50007',
'listing': 'auction',
'make': 'Citroen',
'model': 'Xsara',
'odometer': 189294,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-06-16',
'seller_name': None,
'title': 'Citroen Xsara 1.6 Satisfaction',
'transmission': 'manual',
'trim': 'Satisfaction',
'year': 2004}
2026-03-30 11:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JF50007%27 HTTP/1.1" 200 None
2026-03-30 11:18:36 [auto1.es] INFO: Saving data for JF50007: {'auction_closing_time': 1774971818.0, 'created_time': 1774534004.186828, 'last_price_update_time': 1774869516.623783}
2026-03-30 11:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JF50007') HTTP/1.1" 204 0
2026-03-30 11:18:36 [auto1.es] INFO: Found listing with ID: HJ95484
2026-03-30 11:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HJ95484%27 HTTP/1.1" 200 None
2026-03-30 11:18:36 [auto1.es] INFO: Scrape type for HJ95484: 1
2026-03-30 11:18:36 [auto1.es] INFO: Found listing with ID: VR74696
2026-03-30 11:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VR74696%27 HTTP/1.1" 200 None
2026-03-30 11:18:36 [auto1.es] INFO: Scrape type for VR74696: 2
2026-03-30 11:18:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3caac38-0d6c-51b5-8d64-094ce52f0205 with identifier: VR74696
2026-03-30 11:18:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3caac38-0d6c-51b5-8d64-094ce52f0205 with scrape type 2
2026-03-30 11:18:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3caac38-0d6c-51b5-8d64-094ce52f0205 with scrape type 2
2026-03-30 11:18:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a3caac38-0d6c-51b5-8d64-094ce52f0205, identifier: VR74696
2026-03-30 11:18:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a3caac38-0d6c-51b5-8d64-094ce52f0205 with identifier: VR74696
2026-03-30 11:18:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a3caac38-0d6c-51b5-8d64-094ce52f0205 with identifier: VR74696
2026-03-30 11:18:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a3caac38-0d6c-51b5-8d64-094ce52f0205 with identifier: VR74696 to the API
2026-03-30 11:18:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 510,
'expiration_date': '2026-03-31T15:42:38Z',
'fuel_type': 'petrol',
'id': 'a3caac38-0d6c-51b5-8d64-094ce52f0205',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR74696',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 77541,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-14',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 63 AMG S Edition 1',
'transmission': 'automatic',
'trim': 'S Edition 1',
'year': 2017}
2026-03-30 11:18:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VR74696%27 HTTP/1.1" 200 None
2026-03-30 11:18:37 [auto1.es] INFO: Saving data for VR74696: {'auction_closing_time': 1774971758.0, 'created_time': 1774382878.712923, 'last_price_update_time': 1774869517.96502}
2026-03-30 11:18:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VR74696') HTTP/1.1" 204 0
2026-03-30 11:18:38 [auto1.es] INFO: Found listing with ID: ZU15820
2026-03-30 11:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZU15820%27 HTTP/1.1" 200 None
2026-03-30 11:18:38 [auto1.es] INFO: Scrape type for ZU15820: 1
2026-03-30 11:18:38 [auto1.es] INFO: Found listing with ID: JN80482
2026-03-30 11:18:38 [auto1.es] INFO: Found listing with ID: KE39848
2026-03-30 11:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KE39848%27 HTTP/1.1" 200 None
2026-03-30 11:18:38 [auto1.es] INFO: Scrape type for KE39848: 2
2026-03-30 11:18:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f173c685-86d5-5248-b21a-1a790b2cdef9 with identifier: KE39848
2026-03-30 11:18:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f173c685-86d5-5248-b21a-1a790b2cdef9 with scrape type 2
2026-03-30 11:18:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f173c685-86d5-5248-b21a-1a790b2cdef9 with scrape type 2
2026-03-30 11:18:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f173c685-86d5-5248-b21a-1a790b2cdef9, identifier: KE39848
2026-03-30 11:18:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f173c685-86d5-5248-b21a-1a790b2cdef9 with identifier: KE39848
2026-03-30 11:18:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f173c685-86d5-5248-b21a-1a790b2cdef9 with identifier: KE39848
2026-03-30 11:18:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f173c685-86d5-5248-b21a-1a790b2cdef9 with identifier: KE39848 to the API
2026-03-30 11:18:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 355,
'expiration_date': '2026-03-31T15:45:40Z',
'fuel_type': 'petrol',
'id': 'f173c685-86d5-5248-b21a-1a790b2cdef9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE39848',
'listing': 'auction',
'make': 'Audi',
'model': 'S5',
'odometer': 25972,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-08-07',
'seller_name': None,
'title': 'Audi S5 3.0 V6 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2017}
2026-03-30 11:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KE39848%27 HTTP/1.1" 200 None
2026-03-30 11:18:38 [auto1.es] INFO: Saving data for KE39848: {'auction_closing_time': 1774971940.0, 'created_time': 1774471037.363284, 'last_price_update_time': 1774869518.556931}
2026-03-30 11:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KE39848') HTTP/1.1" 204 0
2026-03-30 11:18:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:38 [auto1.es] INFO: Found listing with ID: ZF17550
2026-03-30 11:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZF17550%27 HTTP/1.1" 200 None
2026-03-30 11:18:38 [auto1.es] INFO: Scrape type for ZF17550: 2
2026-03-30 11:18:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b1b7db0-d933-583a-bd9e-de3ace161434 with identifier: ZF17550
2026-03-30 11:18:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b1b7db0-d933-583a-bd9e-de3ace161434 with scrape type 2
2026-03-30 11:18:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b1b7db0-d933-583a-bd9e-de3ace161434 with scrape type 2
2026-03-30 11:18:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6b1b7db0-d933-583a-bd9e-de3ace161434, identifier: ZF17550
2026-03-30 11:18:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6b1b7db0-d933-583a-bd9e-de3ace161434 with identifier: ZF17550
2026-03-30 11:18:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6b1b7db0-d933-583a-bd9e-de3ace161434 with identifier: ZF17550
2026-03-30 11:18:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6b1b7db0-d933-583a-bd9e-de3ace161434 with identifier: ZF17550 to the API
2026-03-30 11:18:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:36:28Z',
'fuel_type': 'petrol',
'id': '6b1b7db0-d933-583a-bd9e-de3ace161434',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF17550',
'listing': 'auction',
'make': 'Suzuki',
'model': 'SX4',
'odometer': 206179,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-05-23',
'seller_name': None,
'title': 'Suzuki SX4 1.6 GL',
'transmission': 'manual',
'trim': 'GL',
'year': 2012}
2026-03-30 11:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZF17550%27 HTTP/1.1" 200 None
2026-03-30 11:18:39 [auto1.es] INFO: Saving data for ZF17550: {'auction_closing_time': 1774971388.0, 'created_time': 1773130249.601645, 'last_price_update_time': 1774869519.101298}
2026-03-30 11:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZF17550') HTTP/1.1" 204 0
2026-03-30 11:18:39 [auto1.es] INFO: Found listing with ID: FN30855
2026-03-30 11:18:39 [auto1.es] INFO: Found listing with ID: XA30952
2026-03-30 11:18:39 [auto1.es] INFO: Found listing with ID: CY31479
2026-03-30 11:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CY31479%27 HTTP/1.1" 200 None
2026-03-30 11:18:39 [auto1.es] INFO: Scrape type for CY31479: 1
2026-03-30 11:18:39 [auto1.es] INFO: Channel: 24h | Page: 4 | totalHits: 2211 | hits on page: 40
2026-03-30 11:18:39 [auto1.es] INFO: Found listing with ID: ZM68351
2026-03-30 11:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZM68351%27 HTTP/1.1" 200 None
2026-03-30 11:18:39 [auto1.es] INFO: Scrape type for ZM68351: 2
2026-03-30 11:18:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1b2f28e-ff07-53b8-9adf-7e716b173802 with identifier: ZM68351
2026-03-30 11:18:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1b2f28e-ff07-53b8-9adf-7e716b173802 with scrape type 2
2026-03-30 11:18:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1b2f28e-ff07-53b8-9adf-7e716b173802 with scrape type 2
2026-03-30 11:18:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b1b2f28e-ff07-53b8-9adf-7e716b173802, identifier: ZM68351
2026-03-30 11:18:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b1b2f28e-ff07-53b8-9adf-7e716b173802 with identifier: ZM68351
2026-03-30 11:18:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b1b2f28e-ff07-53b8-9adf-7e716b173802 with identifier: ZM68351
2026-03-30 11:18:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b1b2f28e-ff07-53b8-9adf-7e716b173802 with identifier: ZM68351 to the API
2026-03-30 11:18:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 95,
'expiration_date': '2026-03-31T15:23:12Z',
'fuel_type': 'diesel',
'id': 'b1b2f28e-ff07-53b8-9adf-7e716b173802',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM68351',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit',
'odometer': 192382,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-11',
'seller_name': None,
'title': 'Ford Transit 1.5 TDCi Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2018}
2026-03-30 11:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZM68351%27 HTTP/1.1" 200 None
2026-03-30 11:18:39 [auto1.es] INFO: Saving data for ZM68351: {'auction_closing_time': 1774970592.0, 'created_time': 1773133723.569124, 'last_price_update_time': 1774869519.801443}
2026-03-30 11:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZM68351') HTTP/1.1" 204 0
2026-03-30 11:18:39 [auto1.es] INFO: Found listing with ID: DE85844
2026-03-30 11:18:39 [auto1.es] INFO: Found listing with ID: CN83416
2026-03-30 11:18:39 [auto1.es] INFO: Found listing with ID: RA16154
2026-03-30 11:18:39 [auto1.es] INFO: Found listing with ID: FT58474
2026-03-30 11:18:39 [auto1.es] INFO: Found listing with ID: CP61201
2026-03-30 11:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CP61201%27 HTTP/1.1" 200 None
2026-03-30 11:18:39 [auto1.es] INFO: Scrape type for CP61201: 1
2026-03-30 11:18:39 [auto1.es] INFO: Found listing with ID: FH27641
2026-03-30 11:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FH27641%27 HTTP/1.1" 200 None
2026-03-30 11:18:39 [auto1.es] INFO: Scrape type for FH27641: 2
2026-03-30 11:18:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a358af5-11d1-5e0c-bd3e-91f2d8bddb64 with identifier: FH27641
2026-03-30 11:18:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a358af5-11d1-5e0c-bd3e-91f2d8bddb64 with scrape type 2
2026-03-30 11:18:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a358af5-11d1-5e0c-bd3e-91f2d8bddb64 with scrape type 2
2026-03-30 11:18:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8a358af5-11d1-5e0c-bd3e-91f2d8bddb64, identifier: FH27641
2026-03-30 11:18:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8a358af5-11d1-5e0c-bd3e-91f2d8bddb64 with identifier: FH27641
2026-03-30 11:18:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8a358af5-11d1-5e0c-bd3e-91f2d8bddb64 with identifier: FH27641
2026-03-30 11:18:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8a358af5-11d1-5e0c-bd3e-91f2d8bddb64 with identifier: FH27641 to the API
2026-03-30 11:18:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:48:25Z',
'fuel_type': 'diesel',
'id': '8a358af5-11d1-5e0c-bd3e-91f2d8bddb64',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH27641',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 21421,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-21',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2021}
2026-03-30 11:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FH27641%27 HTTP/1.1" 200 None
2026-03-30 11:18:40 [auto1.es] INFO: Saving data for FH27641: {'auction_closing_time': 1774972105.0, 'created_time': 1774642032.100043, 'last_price_update_time': 1774869520.353167}
2026-03-30 11:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FH27641') HTTP/1.1" 204 0
2026-03-30 11:18:40 [auto1.es] INFO: Found listing with ID: AV19978
2026-03-30 11:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AV19978%27 HTTP/1.1" 200 None
2026-03-30 11:18:40 [auto1.es] INFO: Scrape type for AV19978: 2
2026-03-30 11:18:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: add44a05-0f0c-52e8-814a-6fc8185e0aed with identifier: AV19978
2026-03-30 11:18:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item add44a05-0f0c-52e8-814a-6fc8185e0aed with scrape type 2
2026-03-30 11:18:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item add44a05-0f0c-52e8-814a-6fc8185e0aed with scrape type 2
2026-03-30 11:18:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: add44a05-0f0c-52e8-814a-6fc8185e0aed, identifier: AV19978
2026-03-30 11:18:40 [auto1.es] INFO: Found listing with ID: VF55417
2026-03-30 11:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VF55417%27 HTTP/1.1" 200 None
2026-03-30 11:18:40 [auto1.es] INFO: Scrape type for VF55417: 1
2026-03-30 11:18:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: add44a05-0f0c-52e8-814a-6fc8185e0aed with identifier: AV19978
2026-03-30 11:18:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: add44a05-0f0c-52e8-814a-6fc8185e0aed with identifier: AV19978
2026-03-30 11:18:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: add44a05-0f0c-52e8-814a-6fc8185e0aed with identifier: AV19978 to the API
2026-03-30 11:18:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-31T15:27:01Z',
'fuel_type': 'diesel',
'id': 'add44a05-0f0c-52e8-814a-6fc8185e0aed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV19978',
'listing': 'auction',
'make': 'Audi',
'model': 'Q2',
'odometer': 241227,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-29',
'seller_name': None,
'title': 'Audi Q2 1.6 TDI Design',
'transmission': 'manual',
'trim': 'Design',
'year': 2019}
2026-03-30 11:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AV19978%27 HTTP/1.1" 200 None
2026-03-30 11:18:40 [auto1.es] INFO: Saving data for AV19978: {'auction_closing_time': 1774970821.0, 'created_time': 1773669962.775162, 'last_price_update_time': 1774869520.96371}
2026-03-30 11:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AV19978') HTTP/1.1" 204 0
2026-03-30 11:18:40 [auto1.es] INFO: Found listing with ID: PD13056
2026-03-30 11:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD13056%27 HTTP/1.1" 200 None
2026-03-30 11:18:41 [auto1.es] INFO: Scrape type for PD13056: 2
2026-03-30 11:18:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44bc869e-1cc2-5ae2-ae17-0ea6cb0cff3c with identifier: PD13056
2026-03-30 11:18:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44bc869e-1cc2-5ae2-ae17-0ea6cb0cff3c with scrape type 2
2026-03-30 11:18:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44bc869e-1cc2-5ae2-ae17-0ea6cb0cff3c with scrape type 2
2026-03-30 11:18:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 44bc869e-1cc2-5ae2-ae17-0ea6cb0cff3c, identifier: PD13056
2026-03-30 11:18:41 [auto1.es] INFO: Found listing with ID: ML73302
2026-03-30 11:18:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 44bc869e-1cc2-5ae2-ae17-0ea6cb0cff3c with identifier: PD13056
2026-03-30 11:18:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:18:41 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-30 11:18:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:18:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:18:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 44bc869e-1cc2-5ae2-ae17-0ea6cb0cff3c with identifier: PD13056
2026-03-30 11:18:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 44bc869e-1cc2-5ae2-ae17-0ea6cb0cff3c with identifier: PD13056 to the API
2026-03-30 11:18:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:56:15Z',
'fuel_type': 'diesel',
'id': '44bc869e-1cc2-5ae2-ae17-0ea6cb0cff3c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD13056',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 382617,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-09-22',
'seller_name': None,
'title': 'Seat Leon 1.9 TDI Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2003}
2026-03-30 11:18:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD13056%27 HTTP/1.1" 200 None
2026-03-30 11:18:41 [auto1.es] INFO: Saving data for PD13056: {'auction_closing_time': 1774972575.0, 'created_time': 1773691660.620372, 'last_price_update_time': 1774869521.563117}
2026-03-30 11:18:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PD13056') HTTP/1.1" 204 0
2026-03-30 11:18:41 [auto1.es] INFO: Found listing with ID: GZ41866
2026-03-30 11:18:41 [auto1.es] INFO: Found listing with ID: RA30082
2026-03-30 11:18:41 [auto1.es] INFO: Found listing with ID: ZL14108
2026-03-30 11:18:41 [auto1.es] INFO: Found listing with ID: EN27378
2026-03-30 11:18:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN27378%27 HTTP/1.1" 200 None
2026-03-30 11:18:41 [auto1.es] INFO: Scrape type for EN27378: 1
2026-03-30 11:18:41 [auto1.es] INFO: Found listing with ID: JG71892
2026-03-30 11:18:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG71892%27 HTTP/1.1" 200 None
2026-03-30 11:18:41 [auto1.es] INFO: Scrape type for JG71892: 1
2026-03-30 11:18:41 [auto1.es] INFO: Found listing with ID: WY74843
2026-03-30 11:18:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WY74843%27 HTTP/1.1" 200 None
2026-03-30 11:18:41 [auto1.es] INFO: Scrape type for WY74843: 1
2026-03-30 11:18:41 [auto1.es] INFO: Found listing with ID: JE22210
2026-03-30 11:18:41 [auto1.es] INFO: Found listing with ID: PF71575
2026-03-30 11:18:41 [auto1.es] INFO: Found listing with ID: AL71492
2026-03-30 11:18:41 [auto1.es] INFO: Found listing with ID: JM59673
2026-03-30 11:18:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JM59673%27 HTTP/1.1" 200 None
2026-03-30 11:18:41 [auto1.es] INFO: Scrape type for JM59673: 2
2026-03-30 11:18:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 942b41c7-bf38-59b4-8e68-148081097202 with identifier: JM59673
2026-03-30 11:18:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 942b41c7-bf38-59b4-8e68-148081097202 with scrape type 2
2026-03-30 11:18:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 942b41c7-bf38-59b4-8e68-148081097202 with scrape type 2
2026-03-30 11:18:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 942b41c7-bf38-59b4-8e68-148081097202, identifier: JM59673
2026-03-30 11:18:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 942b41c7-bf38-59b4-8e68-148081097202 with identifier: JM59673
2026-03-30 11:18:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 942b41c7-bf38-59b4-8e68-148081097202 with identifier: JM59673
2026-03-30 11:18:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 942b41c7-bf38-59b4-8e68-148081097202 with identifier: JM59673 to the API
2026-03-30 11:18:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:48:01Z',
'fuel_type': 'diesel',
'id': '942b41c7-bf38-59b4-8e68-148081097202',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM59673',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 123007,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-29',
'seller_name': None,
'title': 'Peugeot 308 1.5 Blue-HDi Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2022}
2026-03-30 11:18:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JM59673%27 HTTP/1.1" 200 None
2026-03-30 11:18:42 [auto1.es] INFO: Saving data for JM59673: {'auction_closing_time': 1774972081.0, 'created_time': 1774620417.764249, 'last_price_update_time': 1774869522.13618}
2026-03-30 11:18:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JM59673') HTTP/1.1" 204 0
2026-03-30 11:18:42 [auto1.es] INFO: Found listing with ID: FK36826
2026-03-30 11:18:42 [auto1.es] INFO: Found listing with ID: EH47401
2026-03-30 11:18:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EH47401%27 HTTP/1.1" 200 None
2026-03-30 11:18:42 [auto1.es] INFO: Scrape type for EH47401: 1
2026-03-30 11:18:42 [auto1.es] INFO: Found listing with ID: CS58212
2026-03-30 11:18:42 [auto1.es] INFO: Found listing with ID: XF92968
2026-03-30 11:18:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XF92968%27 HTTP/1.1" 200 None
2026-03-30 11:18:42 [auto1.es] INFO: Scrape type for XF92968: 2
2026-03-30 11:18:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35217692-bb05-5ae7-b7f2-79a21e187c7a with identifier: XF92968
2026-03-30 11:18:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35217692-bb05-5ae7-b7f2-79a21e187c7a with scrape type 2
2026-03-30 11:18:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35217692-bb05-5ae7-b7f2-79a21e187c7a with scrape type 2
2026-03-30 11:18:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 35217692-bb05-5ae7-b7f2-79a21e187c7a, identifier: XF92968
2026-03-30 11:18:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 35217692-bb05-5ae7-b7f2-79a21e187c7a with identifier: XF92968
2026-03-30 11:18:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 35217692-bb05-5ae7-b7f2-79a21e187c7a with identifier: XF92968
2026-03-30 11:18:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 35217692-bb05-5ae7-b7f2-79a21e187c7a with identifier: XF92968 to the API
2026-03-30 11:18:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-31T15:36:17Z',
'fuel_type': 'diesel',
'id': '35217692-bb05-5ae7-b7f2-79a21e187c7a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF92968',
'listing': 'auction',
'make': 'Renault',
'model': 'Scenic',
'odometer': 234268,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-07-13',
'seller_name': None,
'title': 'Renault Scenic 1.5 dCi Dynamique',
'transmission': 'manual',
'trim': 'Dynamique',
'year': 2009}
2026-03-30 11:18:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XF92968%27 HTTP/1.1" 200 None
2026-03-30 11:18:42 [auto1.es] INFO: Saving data for XF92968: {'auction_closing_time': 1774971377.0, 'created_time': 1774253126.477671, 'last_price_update_time': 1774869522.703913}
2026-03-30 11:18:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XF92968') HTTP/1.1" 204 0
2026-03-30 11:18:42 [auto1.es] INFO: Found listing with ID: UF98716
2026-03-30 11:18:42 [auto1.es] INFO: Found listing with ID: DS99682
2026-03-30 11:18:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DS99682%27 HTTP/1.1" 200 None
2026-03-30 11:18:42 [auto1.es] INFO: Scrape type for DS99682: 2
2026-03-30 11:18:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52731a26-54bf-5de2-81fb-ace63a735d98 with identifier: DS99682
2026-03-30 11:18:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52731a26-54bf-5de2-81fb-ace63a735d98 with scrape type 2
2026-03-30 11:18:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52731a26-54bf-5de2-81fb-ace63a735d98 with scrape type 2
2026-03-30 11:18:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 52731a26-54bf-5de2-81fb-ace63a735d98, identifier: DS99682
2026-03-30 11:18:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 52731a26-54bf-5de2-81fb-ace63a735d98 with identifier: DS99682
2026-03-30 11:18:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 52731a26-54bf-5de2-81fb-ace63a735d98 with identifier: DS99682
2026-03-30 11:18:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 52731a26-54bf-5de2-81fb-ace63a735d98 with identifier: DS99682 to the API
2026-03-30 11:18:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:05:11Z',
'fuel_type': 'diesel',
'id': '52731a26-54bf-5de2-81fb-ace63a735d98',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS99682',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 135901,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-18',
'seller_name': None,
'title': 'Peugeot 308 1.5 Blue-HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2022}
2026-03-30 11:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DS99682%27 HTTP/1.1" 200 None
2026-03-30 11:18:43 [auto1.es] INFO: Saving data for DS99682: {'auction_closing_time': 1774969511.0, 'created_time': 1774642133.991011, 'last_price_update_time': 1774869523.777021}
2026-03-30 11:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DS99682') HTTP/1.1" 204 0
2026-03-30 11:18:43 [auto1.es] INFO: Found listing with ID: PY38886
2026-03-30 11:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PY38886%27 HTTP/1.1" 200 None
2026-03-30 11:18:43 [auto1.es] INFO: Scrape type for PY38886: 1
2026-03-30 11:18:43 [auto1.es] INFO: Found listing with ID: VY22217
2026-03-30 11:18:43 [auto1.es] INFO: Found listing with ID: JB22846
2026-03-30 11:18:43 [auto1.es] INFO: Found listing with ID: YJ60609
2026-03-30 11:18:43 [auto1.es] INFO: Found listing with ID: FK69974
2026-03-30 11:18:43 [auto1.es] INFO: Found listing with ID: UJ95411
2026-03-30 11:18:43 [auto1.es] INFO: Found listing with ID: TB20827
2026-03-30 11:18:43 [auto1.es] INFO: Found listing with ID: ZX94868
2026-03-30 11:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZX94868%27 HTTP/1.1" 200 None
2026-03-30 11:18:43 [auto1.es] INFO: Scrape type for ZX94868: 2
2026-03-30 11:18:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0fe5b3f-28ba-5af6-b9a3-25e970e48e7e with identifier: ZX94868
2026-03-30 11:18:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0fe5b3f-28ba-5af6-b9a3-25e970e48e7e with scrape type 2
2026-03-30 11:18:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0fe5b3f-28ba-5af6-b9a3-25e970e48e7e with scrape type 2
2026-03-30 11:18:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e0fe5b3f-28ba-5af6-b9a3-25e970e48e7e, identifier: ZX94868
2026-03-30 11:18:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PH66754/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e0fe5b3f-28ba-5af6-b9a3-25e970e48e7e with identifier: ZX94868
2026-03-30 11:18:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e0fe5b3f-28ba-5af6-b9a3-25e970e48e7e with identifier: ZX94868
2026-03-30 11:18:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e0fe5b3f-28ba-5af6-b9a3-25e970e48e7e with identifier: ZX94868 to the API
2026-03-30 11:18:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-31T15:42:51Z',
'fuel_type': 'diesel',
'id': 'e0fe5b3f-28ba-5af6-b9a3-25e970e48e7e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX94868',
'listing': 'auction',
'make': 'Ssangyong',
'model': 'Rodius',
'odometer': 130563,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-11-27',
'seller_name': None,
'title': 'Ssangyong Rodius 270 Xdi',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-30 11:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZX94868%27 HTTP/1.1" 200 None
2026-03-30 11:18:44 [auto1.es] INFO: Saving data for ZX94868: {'auction_closing_time': 1774971771.0, 'created_time': 1774274823.660286, 'last_price_update_time': 1774869524.247919}
2026-03-30 11:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZX94868') HTTP/1.1" 204 0
2026-03-30 11:18:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:44 [auto1.es] INFO: Found listing with ID: JR41621
2026-03-30 11:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JR41621%27 HTTP/1.1" 200 None
2026-03-30 11:18:44 [auto1.es] INFO: Scrape type for JR41621: 2
2026-03-30 11:18:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46d43870-c297-5968-ae10-3d82640ccb01 with identifier: JR41621
2026-03-30 11:18:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46d43870-c297-5968-ae10-3d82640ccb01 with scrape type 2
2026-03-30 11:18:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46d43870-c297-5968-ae10-3d82640ccb01 with scrape type 2
2026-03-30 11:18:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 46d43870-c297-5968-ae10-3d82640ccb01, identifier: JR41621
2026-03-30 11:18:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 46d43870-c297-5968-ae10-3d82640ccb01 with identifier: JR41621
2026-03-30 11:18:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 46d43870-c297-5968-ae10-3d82640ccb01 with identifier: JR41621
2026-03-30 11:18:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 46d43870-c297-5968-ae10-3d82640ccb01 with identifier: JR41621 to the API
2026-03-30 11:18:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-31T15:00:03Z',
'fuel_type': 'petrol',
'id': '46d43870-c297-5968-ae10-3d82640ccb01',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR41621',
'listing': 'auction',
'make': 'Jeep',
'model': 'Avenger',
'odometer': 27251,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-12-02',
'seller_name': None,
'title': 'Jeep Avenger 1.2 T-GDI Altitude',
'transmission': 'manual',
'trim': 'Altitude',
'year': 2024}
2026-03-30 11:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JR41621%27 HTTP/1.1" 200 None
2026-03-30 11:18:44 [auto1.es] INFO: Saving data for JR41621: {'auction_closing_time': 1774969203.0, 'created_time': 1773432546.32981, 'last_price_update_time': 1774869524.777568}
2026-03-30 11:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JR41621') HTTP/1.1" 204 0
2026-03-30 11:18:44 [auto1.es] INFO: Found listing with ID: HC78450
2026-03-30 11:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HC78450%27 HTTP/1.1" 200 None
2026-03-30 11:18:44 [auto1.es] INFO: Scrape type for HC78450: 2
2026-03-30 11:18:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2735546-4c24-5c32-ae24-5744e0e24686 with identifier: HC78450
2026-03-30 11:18:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2735546-4c24-5c32-ae24-5744e0e24686 with scrape type 2
2026-03-30 11:18:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2735546-4c24-5c32-ae24-5744e0e24686 with scrape type 2
2026-03-30 11:18:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a2735546-4c24-5c32-ae24-5744e0e24686, identifier: HC78450
2026-03-30 11:18:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a2735546-4c24-5c32-ae24-5744e0e24686 with identifier: HC78450
2026-03-30 11:18:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:18:44 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-30 11:18:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:18:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a2735546-4c24-5c32-ae24-5744e0e24686 with identifier: HC78450
2026-03-30 11:18:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a2735546-4c24-5c32-ae24-5744e0e24686 with identifier: HC78450 to the API
2026-03-30 11:18:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 228,
'expiration_date': '2026-03-31T15:04:48Z',
'fuel_type': 'electro',
'id': 'a2735546-4c24-5c32-ae24-5744e0e24686',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC78450',
'listing': 'auction',
'make': 'Kia',
'model': 'EV6',
'odometer': 67972,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-10-30',
'seller_name': None,
'title': 'Kia EV6 electric drive 168 kW GT Line 2WD',
'transmission': 'automatic',
'trim': 'GT Line 2WD',
'year': 2023}
2026-03-30 11:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HC78450%27 HTTP/1.1" 200 None
2026-03-30 11:18:45 [auto1.es] INFO: Saving data for HC78450: {'auction_closing_time': 1774969488.0, 'created_time': 1773432613.753767, 'last_price_update_time': 1774869525.814964}
2026-03-30 11:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HC78450') HTTP/1.1" 204 0
2026-03-30 11:18:45 [auto1.es] INFO: Found listing with ID: EW77707
2026-03-30 11:18:45 [auto1.es] INFO: Found listing with ID: VE86539
2026-03-30 11:18:45 [auto1.es] INFO: Found listing with ID: GH64040
2026-03-30 11:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH64040%27 HTTP/1.1" 200 None
2026-03-30 11:18:45 [auto1.es] INFO: Scrape type for GH64040: 2
2026-03-30 11:18:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34b80c60-e920-5060-a239-50686d931131 with identifier: GH64040
2026-03-30 11:18:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34b80c60-e920-5060-a239-50686d931131 with scrape type 2
2026-03-30 11:18:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34b80c60-e920-5060-a239-50686d931131 with scrape type 2
2026-03-30 11:18:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 34b80c60-e920-5060-a239-50686d931131, identifier: GH64040
2026-03-30 11:18:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 34b80c60-e920-5060-a239-50686d931131 with identifier: GH64040
2026-03-30 11:18:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 34b80c60-e920-5060-a239-50686d931131 with identifier: GH64040
2026-03-30 11:18:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 34b80c60-e920-5060-a239-50686d931131 with identifier: GH64040 to the API
2026-03-30 11:18:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:28:02Z',
'fuel_type': 'diesel',
'id': '34b80c60-e920-5060-a239-50686d931131',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH64040',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 81689,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-11',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2021}
2026-03-30 11:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH64040%27 HTTP/1.1" 200 None
2026-03-30 11:18:46 [auto1.es] INFO: Saving data for GH64040: {'auction_closing_time': 1774970882.0, 'created_time': 1773432611.193054, 'last_price_update_time': 1774869526.567992}
2026-03-30 11:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GH64040') HTTP/1.1" 204 0
2026-03-30 11:18:46 [auto1.es] INFO: Found listing with ID: AP30441
2026-03-30 11:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AP30441%27 HTTP/1.1" 200 None
2026-03-30 11:18:46 [auto1.es] INFO: Scrape type for AP30441: 1
2026-03-30 11:18:46 [auto1.es] INFO: Found listing with ID: FK17944
2026-03-30 11:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK17944%27 HTTP/1.1" 200 None
2026-03-30 11:18:46 [auto1.es] INFO: Scrape type for FK17944: 1
2026-03-30 11:18:46 [auto1.es] INFO: Found listing with ID: US21221
2026-03-30 11:18:46 [auto1.es] INFO: Found listing with ID: SB85910
2026-03-30 11:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SB85910%27 HTTP/1.1" 200 None
2026-03-30 11:18:46 [auto1.es] INFO: Scrape type for SB85910: 2
2026-03-30 11:18:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca33a5c8-6ab9-51e0-8d1c-50ca0f6964ff with identifier: SB85910
2026-03-30 11:18:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca33a5c8-6ab9-51e0-8d1c-50ca0f6964ff with scrape type 2
2026-03-30 11:18:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca33a5c8-6ab9-51e0-8d1c-50ca0f6964ff with scrape type 2
2026-03-30 11:18:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ca33a5c8-6ab9-51e0-8d1c-50ca0f6964ff, identifier: SB85910
2026-03-30 11:18:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ca33a5c8-6ab9-51e0-8d1c-50ca0f6964ff with identifier: SB85910
2026-03-30 11:18:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ca33a5c8-6ab9-51e0-8d1c-50ca0f6964ff with identifier: SB85910
2026-03-30 11:18:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ca33a5c8-6ab9-51e0-8d1c-50ca0f6964ff with identifier: SB85910 to the API
2026-03-30 11:18:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:02:17Z',
'fuel_type': 'diesel',
'id': 'ca33a5c8-6ab9-51e0-8d1c-50ca0f6964ff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB85910',
'listing': 'auction',
'make': 'Skoda',
'model': 'Kodiaq',
'odometer': 49335,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-26',
'seller_name': None,
'title': 'Skoda Kodiaq 2.0 TDI Sportline',
'transmission': 'automatic',
'trim': 'Sportline',
'year': 2022}
2026-03-30 11:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SB85910%27 HTTP/1.1" 200 None
2026-03-30 11:18:47 [auto1.es] INFO: Saving data for SB85910: {'auction_closing_time': 1774969337.0, 'created_time': 1773346061.295607, 'last_price_update_time': 1774869527.146813}
2026-03-30 11:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SB85910') HTTP/1.1" 204 0
2026-03-30 11:18:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BN28456/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZV81401> (referer: https://www.auto1.com/v1/car-details-view/ZV81401/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c6a321c-549c-5231-9c18-f8e36df55d15 with identifier: ZV81401
2026-03-30 11:18:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c6a321c-549c-5231-9c18-f8e36df55d15 with scrape type 1
2026-03-30 11:18:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7c6a321c-549c-5231-9c18-f8e36df55d15
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F86%252F708661a42a8987a1bfdc64777b15cbb1%252Fpa%252FZV81401_8e7e8257a2a336aadda827826a7f5505.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_8e7e8257a2a336aadda827826a7f5505.jpg not downloaded yet
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F86%252F708661a42a8987a1bfdc64777b15cbb1%252Fpa%252FZV81401_c4ae4bb5d94f32a3497c69aa94b6fe7c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_c4ae4bb5d94f32a3497c69aa94b6fe7c.jpg not downloaded yet
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F86%252F708661a42a8987a1bfdc64777b15cbb1%252Fpa%252FZV81401_fed165d72cfab1d79930f241846b5ffe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_fed165d72cfab1d79930f241846b5ffe.jpg not downloaded yet
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F86%252F708661a42a8987a1bfdc64777b15cbb1%252Fpa%252FZV81401_d624b426902567eb42b7872ea0e2a747.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_d624b426902567eb42b7872ea0e2a747.jpg not downloaded yet
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F86%252F708661a42a8987a1bfdc64777b15cbb1%252Fpa%252FZV81401_0c881f9a7e444a4b19c65d25ebba5c12.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_0c881f9a7e444a4b19c65d25ebba5c12.jpg not downloaded yet
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F86%252F708661a42a8987a1bfdc64777b15cbb1%252Fpa%252FZV81401_a952a3e12f7bd44e2b0889655f748ba6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_a952a3e12f7bd44e2b0889655f748ba6.jpg not downloaded yet
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F86%252F708661a42a8987a1bfdc64777b15cbb1%252Fpa%252FZV81401_566eb98f2bf91e361714a1276ea3ca21.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_566eb98f2bf91e361714a1276ea3ca21.jpg not downloaded yet
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F86%252F708661a42a8987a1bfdc64777b15cbb1%252Fpa%252FZV81401_efbb3e5052bca35d78253c81af9a04c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_efbb3e5052bca35d78253c81af9a04c1.jpg not downloaded yet
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F86%252F708661a42a8987a1bfdc64777b15cbb1%252Fpa%252FZV81401_89d9523d0aca16fdb4faddde863fba89.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_89d9523d0aca16fdb4faddde863fba89.jpg not downloaded yet
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F86%252F708661a42a8987a1bfdc64777b15cbb1%252Fpa%252FZV81401_54fbafc39593d60f8a5f1b27b9ecc640.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_54fbafc39593d60f8a5f1b27b9ecc640.jpg not downloaded yet
2026-03-30 11:18:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JU25572> (referer: https://www.auto1.com/v1/car-details-view/JU25572/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_54fbafc39593d60f8a5f1b27b9ecc640.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 266b95a0-a408-55be-b8a1-cecfb401bf59 with identifier: JU25572
2026-03-30 11:18:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 266b95a0-a408-55be-b8a1-cecfb401bf59 with scrape type 1
2026-03-30 11:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 266b95a0-a408-55be-b8a1-cecfb401bf59
2026-03-30 11:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F9e%252F859ec2f18a9bd851075369c266ac05d3%252Fpa%252FJU25572_9fbbe66c728d088257776d8bba1dea60.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_9fbbe66c728d088257776d8bba1dea60.jpg not downloaded yet
2026-03-30 11:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F9e%252F859ec2f18a9bd851075369c266ac05d3%252Fpa%252FJU25572_700f56a360e6c0cea3cc7932ad34ed65.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_700f56a360e6c0cea3cc7932ad34ed65.jpg not downloaded yet
2026-03-30 11:18:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_efbb3e5052bca35d78253c81af9a04c1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_89d9523d0aca16fdb4faddde863fba89.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F9e%252F859ec2f18a9bd851075369c266ac05d3%252Fpa%252FJU25572_f5b94ea954ef828184aa7f1c2198292e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_f5b94ea954ef828184aa7f1c2198292e.jpg not downloaded yet
2026-03-30 11:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F9e%252F859ec2f18a9bd851075369c266ac05d3%252Fpa%252FJU25572_3f56dce997dd7ef49ad53e90a11bdcf3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_3f56dce997dd7ef49ad53e90a11bdcf3.jpg not downloaded yet
2026-03-30 11:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F9e%252F859ec2f18a9bd851075369c266ac05d3%252Fpa%252FJU25572_77d3b79aec8156326b06fbe9ca01a210.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_77d3b79aec8156326b06fbe9ca01a210.jpg not downloaded yet
2026-03-30 11:18:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060cf9950>
2026-03-30 11:18:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c6a321c-549c-5231-9c18-f8e36df55d15/7c6a321c-549c-5231-9c18-f8e36df55d15_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F86%252F708661a42a8987a1bfdc64777b15cbb1%252Fpa%252FZV81401_54fbafc39593d60f8a5f1b27b9ecc640.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_54fbafc39593d60f8a5f1b27b9ecc640.jpg saved to cache
2026-03-30 11:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7c6a321c-549c-5231-9c18-f8e36df55d15
2026-03-30 11:18:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_9fbbe66c728d088257776d8bba1dea60.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F9e%252F859ec2f18a9bd851075369c266ac05d3%252Fpa%252FJU25572_4d9b5af74f3801ddfcf7d326f1721016.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_4d9b5af74f3801ddfcf7d326f1721016.jpg not downloaded yet
2026-03-30 11:18:49 [auto1.es] INFO: Channel: 24h | Page: 5 | totalHits: 2211 | hits on page: 40
2026-03-30 11:18:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_700f56a360e6c0cea3cc7932ad34ed65.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F9e%252F859ec2f18a9bd851075369c266ac05d3%252Fpa%252FJU25572_34bfdc6054dc8349c9e6c733ca9f07ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_34bfdc6054dc8349c9e6c733ca9f07ea.jpg not downloaded yet
2026-03-30 11:18:49 [auto1.es] INFO: Found listing with ID: FW08254
2026-03-30 11:18:49 [auto1.es] INFO: Found listing with ID: XG11186
2026-03-30 11:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XG11186%27 HTTP/1.1" 200 None
2026-03-30 11:18:49 [auto1.es] INFO: Scrape type for XG11186: 2
2026-03-30 11:18:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 830b426a-447f-5ca6-aca1-86a91b4d66df with identifier: XG11186
2026-03-30 11:18:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 830b426a-447f-5ca6-aca1-86a91b4d66df with scrape type 2
2026-03-30 11:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 830b426a-447f-5ca6-aca1-86a91b4d66df with scrape type 2
2026-03-30 11:18:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 830b426a-447f-5ca6-aca1-86a91b4d66df, identifier: XG11186
2026-03-30 11:18:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4a7e50>
2026-03-30 11:18:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c6a321c-549c-5231-9c18-f8e36df55d15/7c6a321c-549c-5231-9c18-f8e36df55d15_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F86%252F708661a42a8987a1bfdc64777b15cbb1%252Fpa%252FZV81401_efbb3e5052bca35d78253c81af9a04c1.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_efbb3e5052bca35d78253c81af9a04c1.jpg saved to cache
2026-03-30 11:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7c6a321c-549c-5231-9c18-f8e36df55d15
2026-03-30 11:18:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05aed7e10>
2026-03-30 11:18:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c6a321c-549c-5231-9c18-f8e36df55d15/7c6a321c-549c-5231-9c18-f8e36df55d15_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F86%252F708661a42a8987a1bfdc64777b15cbb1%252Fpa%252FZV81401_89d9523d0aca16fdb4faddde863fba89.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_89d9523d0aca16fdb4faddde863fba89.jpg saved to cache
2026-03-30 11:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7c6a321c-549c-5231-9c18-f8e36df55d15
2026-03-30 11:18:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 830b426a-447f-5ca6-aca1-86a91b4d66df with identifier: XG11186
2026-03-30 11:18:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 830b426a-447f-5ca6-aca1-86a91b4d66df with identifier: XG11186
2026-03-30 11:18:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 830b426a-447f-5ca6-aca1-86a91b4d66df with identifier: XG11186 to the API
2026-03-30 11:18:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:54:23Z',
'fuel_type': 'diesel',
'id': '830b426a-447f-5ca6-aca1-86a91b4d66df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG11186',
'listing': 'auction',
'make': 'Volvo',
'model': 'V40',
'odometer': 119392,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-09',
'seller_name': None,
'title': 'Volvo V40 2.0 D3 Momentum',
'transmission': 'manual',
'trim': 'Momentum',
'year': 2015}
2026-03-30 11:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XG11186%27 HTTP/1.1" 200 None
2026-03-30 11:18:50 [auto1.es] INFO: Saving data for XG11186: {'auction_closing_time': 1774972463.0, 'created_time': 1773778120.544829, 'last_price_update_time': 1774869530.974378}
2026-03-30 11:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XG11186') HTTP/1.1" 204 0
2026-03-30 11:18:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_77d3b79aec8156326b06fbe9ca01a210.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F9e%252F859ec2f18a9bd851075369c266ac05d3%252Fpa%252FJU25572_dd11da9fe7567a8369714271a79598ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_dd11da9fe7567a8369714271a79598ba.jpg not downloaded yet
2026-03-30 11:18:51 [auto1.es] INFO: Found listing with ID: PK70837
2026-03-30 11:18:51 [auto1.es] INFO: Found listing with ID: ND38455
2026-03-30 11:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ND38455%27 HTTP/1.1" 200 None
2026-03-30 11:18:51 [auto1.es] INFO: Scrape type for ND38455: 2
2026-03-30 11:18:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a08589a5-a0eb-5373-aab9-294637dbefc3 with identifier: ND38455
2026-03-30 11:18:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a08589a5-a0eb-5373-aab9-294637dbefc3 with scrape type 2
2026-03-30 11:18:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a08589a5-a0eb-5373-aab9-294637dbefc3 with scrape type 2
2026-03-30 11:18:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a08589a5-a0eb-5373-aab9-294637dbefc3, identifier: ND38455
2026-03-30 11:18:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_3f56dce997dd7ef49ad53e90a11bdcf3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a08589a5-a0eb-5373-aab9-294637dbefc3 with identifier: ND38455
2026-03-30 11:18:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a08589a5-a0eb-5373-aab9-294637dbefc3 with identifier: ND38455
2026-03-30 11:18:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a08589a5-a0eb-5373-aab9-294637dbefc3 with identifier: ND38455 to the API
2026-03-30 11:18:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:23:07Z',
'fuel_type': 'petrol',
'id': 'a08589a5-a0eb-5373-aab9-294637dbefc3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND38455',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 135816,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-03',
'seller_name': None,
'title': 'Smart fortwo 0.9 Turbo Basis passion',
'transmission': 'automatic',
'trim': 'Basis passion',
'year': 2016}
2026-03-30 11:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ND38455%27 HTTP/1.1" 200 None
2026-03-30 11:18:51 [auto1.es] INFO: Saving data for ND38455: {'auction_closing_time': 1774970587.0, 'created_time': 1773670467.844672, 'last_price_update_time': 1774869531.574675}
2026-03-30 11:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ND38455') HTTP/1.1" 204 0
2026-03-30 11:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F9e%252F859ec2f18a9bd851075369c266ac05d3%252Fpa%252FJU25572_31344b9c0dbb978082651802e75c397f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_31344b9c0dbb978082651802e75c397f.jpg not downloaded yet
2026-03-30 11:18:51 [auto1.es] INFO: Found listing with ID: EG02791
2026-03-30 11:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG02791%27 HTTP/1.1" 200 None
2026-03-30 11:18:51 [auto1.es] INFO: Scrape type for EG02791: 2
2026-03-30 11:18:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4c88bbe-b2a2-579b-ae10-f19ad25dcccc with identifier: EG02791
2026-03-30 11:18:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4c88bbe-b2a2-579b-ae10-f19ad25dcccc with scrape type 2
2026-03-30 11:18:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4c88bbe-b2a2-579b-ae10-f19ad25dcccc with scrape type 2
2026-03-30 11:18:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a4c88bbe-b2a2-579b-ae10-f19ad25dcccc, identifier: EG02791
2026-03-30 11:18:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZU15820/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a4c88bbe-b2a2-579b-ae10-f19ad25dcccc with identifier: EG02791
2026-03-30 11:18:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a4c88bbe-b2a2-579b-ae10-f19ad25dcccc with identifier: EG02791
2026-03-30 11:18:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a4c88bbe-b2a2-579b-ae10-f19ad25dcccc with identifier: EG02791 to the API
2026-03-30 11:18:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-31T15:39:29Z',
'fuel_type': 'petrol',
'id': 'a4c88bbe-b2a2-579b-ae10-f19ad25dcccc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG02791',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30 Fastback',
'odometer': 9854,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-11-07',
'seller_name': None,
'title': 'Hyundai i30 Fastback 1.0 T-GDI N Line',
'transmission': 'manual',
'trim': 'N Line',
'year': 2024}
2026-03-30 11:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG02791%27 HTTP/1.1" 200 None
2026-03-30 11:18:52 [auto1.es] INFO: Saving data for EG02791: {'auction_closing_time': 1774971569.0, 'created_time': 1773346128.22533, 'last_price_update_time': 1774869532.08291}
2026-03-30 11:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EG02791') HTTP/1.1" 204 0
2026-03-30 11:18:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a377310>
2026-03-30 11:18:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_266b95a0-a408-55be-b8a1-cecfb401bf59/266b95a0-a408-55be-b8a1-cecfb401bf59_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F9e%252F859ec2f18a9bd851075369c266ac05d3%252Fpa%252FJU25572_9fbbe66c728d088257776d8bba1dea60.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_9fbbe66c728d088257776d8bba1dea60.jpg saved to cache
2026-03-30 11:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 266b95a0-a408-55be-b8a1-cecfb401bf59
2026-03-30 11:18:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4ae4d0>
2026-03-30 11:18:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_266b95a0-a408-55be-b8a1-cecfb401bf59/266b95a0-a408-55be-b8a1-cecfb401bf59_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F9e%252F859ec2f18a9bd851075369c266ac05d3%252Fpa%252FJU25572_700f56a360e6c0cea3cc7932ad34ed65.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_700f56a360e6c0cea3cc7932ad34ed65.jpg saved to cache
2026-03-30 11:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 266b95a0-a408-55be-b8a1-cecfb401bf59
2026-03-30 11:18:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a47ebd0>
2026-03-30 11:18:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_266b95a0-a408-55be-b8a1-cecfb401bf59/266b95a0-a408-55be-b8a1-cecfb401bf59_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F9e%252F859ec2f18a9bd851075369c266ac05d3%252Fpa%252FJU25572_77d3b79aec8156326b06fbe9ca01a210.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_77d3b79aec8156326b06fbe9ca01a210.jpg saved to cache
2026-03-30 11:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 266b95a0-a408-55be-b8a1-cecfb401bf59
2026-03-30 11:18:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_34bfdc6054dc8349c9e6c733ca9f07ea.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F9e%252F859ec2f18a9bd851075369c266ac05d3%252Fpa%252FJU25572_d53001e49633e5b78d017c22701d452c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_d53001e49633e5b78d017c22701d452c.jpg not downloaded yet
2026-03-30 11:18:52 [auto1.es] INFO: Found listing with ID: JA56838
2026-03-30 11:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JA56838%27 HTTP/1.1" 200 None
2026-03-30 11:18:52 [auto1.es] INFO: Scrape type for JA56838: 2
2026-03-30 11:18:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f29398a-a858-592b-8ec6-21ea942478f6 with identifier: JA56838
2026-03-30 11:18:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f29398a-a858-592b-8ec6-21ea942478f6 with scrape type 2
2026-03-30 11:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f29398a-a858-592b-8ec6-21ea942478f6 with scrape type 2
2026-03-30 11:18:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6f29398a-a858-592b-8ec6-21ea942478f6, identifier: JA56838
2026-03-30 11:18:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6f29398a-a858-592b-8ec6-21ea942478f6 with identifier: JA56838
2026-03-30 11:18:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6f29398a-a858-592b-8ec6-21ea942478f6 with identifier: JA56838
2026-03-30 11:18:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6f29398a-a858-592b-8ec6-21ea942478f6 with identifier: JA56838 to the API
2026-03-30 11:18:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:29:48Z',
'fuel_type': 'petrol',
'id': '6f29398a-a858-592b-8ec6-21ea942478f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA56838',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30',
'odometer': 63705,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-10',
'seller_name': None,
'title': 'Hyundai i30 1.4 TDGI go!+',
'transmission': 'manual',
'trim': 'go!+',
'year': 2019}
2026-03-30 11:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JA56838%27 HTTP/1.1" 200 None
2026-03-30 11:18:52 [auto1.es] INFO: Saving data for JA56838: {'auction_closing_time': 1774970988.0, 'created_time': 1773659767.757197, 'last_price_update_time': 1774869532.843363}
2026-03-30 11:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JA56838') HTTP/1.1" 204 0
2026-03-30 11:18:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3c97d0>
2026-03-30 11:18:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_266b95a0-a408-55be-b8a1-cecfb401bf59/266b95a0-a408-55be-b8a1-cecfb401bf59_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F9e%252F859ec2f18a9bd851075369c266ac05d3%252Fpa%252FJU25572_3f56dce997dd7ef49ad53e90a11bdcf3.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_3f56dce997dd7ef49ad53e90a11bdcf3.jpg saved to cache
2026-03-30 11:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 266b95a0-a408-55be-b8a1-cecfb401bf59
2026-03-30 11:18:52 [auto1.es] INFO: Found listing with ID: BB57842
2026-03-30 11:18:52 [auto1.es] INFO: Found listing with ID: XJ12820
2026-03-30 11:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XJ12820%27 HTTP/1.1" 200 None
2026-03-30 11:18:52 [auto1.es] INFO: Scrape type for XJ12820: 2
2026-03-30 11:18:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5d63914-929e-5e2f-8f95-1713aedf76ce with identifier: XJ12820
2026-03-30 11:18:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5d63914-929e-5e2f-8f95-1713aedf76ce with scrape type 2
2026-03-30 11:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5d63914-929e-5e2f-8f95-1713aedf76ce with scrape type 2
2026-03-30 11:18:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e5d63914-929e-5e2f-8f95-1713aedf76ce, identifier: XJ12820
2026-03-30 11:18:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_dd11da9fe7567a8369714271a79598ba.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e5d63914-929e-5e2f-8f95-1713aedf76ce with identifier: XJ12820
2026-03-30 11:18:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e5d63914-929e-5e2f-8f95-1713aedf76ce with identifier: XJ12820
2026-03-30 11:18:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e5d63914-929e-5e2f-8f95-1713aedf76ce with identifier: XJ12820 to the API
2026-03-30 11:18:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 118,
'expiration_date': '2026-03-31T15:02:49Z',
'fuel_type': 'electro',
'id': 'e5d63914-929e-5e2f-8f95-1713aedf76ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ12820',
'listing': 'auction',
'make': 'Fiat',
'model': '500e',
'odometer': 71249,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-26',
'seller_name': None,
'title': 'Fiat 500e electric drive 87 kW Icon',
'transmission': 'automatic',
'trim': 'Icon',
'year': 2022}
2026-03-30 11:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XJ12820%27 HTTP/1.1" 200 None
2026-03-30 11:18:53 [auto1.es] INFO: Saving data for XJ12820: {'auction_closing_time': 1774969369.0, 'created_time': 1774523182.048374, 'last_price_update_time': 1774869533.431911}
2026-03-30 11:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XJ12820') HTTP/1.1" 204 0
2026-03-30 11:18:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_31344b9c0dbb978082651802e75c397f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:53 [auto1.es] INFO: Found listing with ID: XS07722
2026-03-30 11:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XS07722%27 HTTP/1.1" 200 None
2026-03-30 11:18:53 [auto1.es] INFO: Scrape type for XS07722: 2
2026-03-30 11:18:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57755c3c-cbe8-500e-b6b1-93308049e358 with identifier: XS07722
2026-03-30 11:18:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57755c3c-cbe8-500e-b6b1-93308049e358 with scrape type 2
2026-03-30 11:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57755c3c-cbe8-500e-b6b1-93308049e358 with scrape type 2
2026-03-30 11:18:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 57755c3c-cbe8-500e-b6b1-93308049e358, identifier: XS07722
2026-03-30 11:18:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4a29d0>
2026-03-30 11:18:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_266b95a0-a408-55be-b8a1-cecfb401bf59/266b95a0-a408-55be-b8a1-cecfb401bf59_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F9e%252F859ec2f18a9bd851075369c266ac05d3%252Fpa%252FJU25572_34bfdc6054dc8349c9e6c733ca9f07ea.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_34bfdc6054dc8349c9e6c733ca9f07ea.jpg saved to cache
2026-03-30 11:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 266b95a0-a408-55be-b8a1-cecfb401bf59
2026-03-30 11:18:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 57755c3c-cbe8-500e-b6b1-93308049e358 with identifier: XS07722
2026-03-30 11:18:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 57755c3c-cbe8-500e-b6b1-93308049e358 with identifier: XS07722
2026-03-30 11:18:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 57755c3c-cbe8-500e-b6b1-93308049e358 with identifier: XS07722 to the API
2026-03-30 11:18:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 299,
'expiration_date': '2026-03-31T15:59:31Z',
'fuel_type': 'hybrid',
'id': '57755c3c-cbe8-500e-b6b1-93308049e358',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS07722',
'listing': 'auction',
'make': 'DS Automobiles',
'model': 'DS7 Crossback',
'odometer': 76970,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-10',
'seller_name': None,
'title': 'DS Automobiles DS7 Crossback 1.6 E-Tense Hybrid 4x4 Rivoli +',
'transmission': 'automatic',
'trim': '4x4 Rivoli +',
'year': 2022}
2026-03-30 11:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XS07722%27 HTTP/1.1" 200 None
2026-03-30 11:18:54 [auto1.es] INFO: Saving data for XS07722: {'auction_closing_time': 1774972771.0, 'created_time': 1773130764.721538, 'last_price_update_time': 1774869534.005149}
2026-03-30 11:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XS07722') HTTP/1.1" 204 0
2026-03-30 11:18:54 [auto1.es] INFO: Found listing with ID: CS18860
2026-03-30 11:18:54 [auto1.es] INFO: Found listing with ID: XJ95833
2026-03-30 11:18:54 [auto1.es] INFO: Found listing with ID: AM60182
2026-03-30 11:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AM60182%27 HTTP/1.1" 200 None
2026-03-30 11:18:54 [auto1.es] INFO: Scrape type for AM60182: 2
2026-03-30 11:18:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95cf9c3c-7474-5da4-8acf-2e678bf6da59 with identifier: AM60182
2026-03-30 11:18:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95cf9c3c-7474-5da4-8acf-2e678bf6da59 with scrape type 2
2026-03-30 11:18:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95cf9c3c-7474-5da4-8acf-2e678bf6da59 with scrape type 2
2026-03-30 11:18:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 95cf9c3c-7474-5da4-8acf-2e678bf6da59, identifier: AM60182
2026-03-30 11:18:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CY31479/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 95cf9c3c-7474-5da4-8acf-2e678bf6da59 with identifier: AM60182
2026-03-30 11:18:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 95cf9c3c-7474-5da4-8acf-2e678bf6da59 with identifier: AM60182
2026-03-30 11:18:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 95cf9c3c-7474-5da4-8acf-2e678bf6da59 with identifier: AM60182 to the API
2026-03-30 11:18:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 299,
'expiration_date': '2026-03-31T15:08:46Z',
'fuel_type': 'hybrid',
'id': '95cf9c3c-7474-5da4-8acf-2e678bf6da59',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM60182',
'listing': 'auction',
'make': 'DS Automobiles',
'model': 'DS7',
'odometer': 29839,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-26',
'seller_name': None,
'title': 'DS Automobiles DS7 1.6 E-Tense Hybrid 4x4 Rivoli',
'transmission': 'automatic',
'trim': '4x4 Rivoli',
'year': 2022}
2026-03-30 11:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AM60182%27 HTTP/1.1" 200 None
2026-03-30 11:18:54 [auto1.es] INFO: Saving data for AM60182: {'auction_closing_time': 1774969726.0, 'created_time': 1773130806.429879, 'last_price_update_time': 1774869534.50852}
2026-03-30 11:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AM60182') HTTP/1.1" 204 0
2026-03-30 11:18:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a332150>
2026-03-30 11:18:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_266b95a0-a408-55be-b8a1-cecfb401bf59/266b95a0-a408-55be-b8a1-cecfb401bf59_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F9e%252F859ec2f18a9bd851075369c266ac05d3%252Fpa%252FJU25572_dd11da9fe7567a8369714271a79598ba.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_dd11da9fe7567a8369714271a79598ba.jpg saved to cache
2026-03-30 11:18:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 266b95a0-a408-55be-b8a1-cecfb401bf59
2026-03-30 11:18:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3cff10>
2026-03-30 11:18:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_266b95a0-a408-55be-b8a1-cecfb401bf59/266b95a0-a408-55be-b8a1-cecfb401bf59_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F9e%252F859ec2f18a9bd851075369c266ac05d3%252Fpa%252FJU25572_31344b9c0dbb978082651802e75c397f.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_31344b9c0dbb978082651802e75c397f.jpg saved to cache
2026-03-30 11:18:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 266b95a0-a408-55be-b8a1-cecfb401bf59
2026-03-30 11:18:54 [auto1.es] INFO: Found listing with ID: XB79448
2026-03-30 11:18:54 [auto1.es] INFO: Found listing with ID: YU50461
2026-03-30 11:18:54 [auto1.es] INFO: Found listing with ID: DA85741
2026-03-30 11:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DA85741%27 HTTP/1.1" 200 None
2026-03-30 11:18:54 [auto1.es] INFO: Scrape type for DA85741: 1
2026-03-30 11:18:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_d53001e49633e5b78d017c22701d452c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:54 [auto1.es] INFO: Found listing with ID: ME14626
2026-03-30 11:18:54 [auto1.es] INFO: Found listing with ID: CF60022
2026-03-30 11:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CF60022%27 HTTP/1.1" 200 None
2026-03-30 11:18:54 [auto1.es] INFO: Scrape type for CF60022: 2
2026-03-30 11:18:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f413e7ad-beb9-5193-9ba5-f6f8a2306bb0 with identifier: CF60022
2026-03-30 11:18:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f413e7ad-beb9-5193-9ba5-f6f8a2306bb0 with scrape type 2
2026-03-30 11:18:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f413e7ad-beb9-5193-9ba5-f6f8a2306bb0 with scrape type 2
2026-03-30 11:18:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f413e7ad-beb9-5193-9ba5-f6f8a2306bb0, identifier: CF60022
2026-03-30 11:18:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f413e7ad-beb9-5193-9ba5-f6f8a2306bb0 with identifier: CF60022
2026-03-30 11:18:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f413e7ad-beb9-5193-9ba5-f6f8a2306bb0 with identifier: CF60022
2026-03-30 11:18:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f413e7ad-beb9-5193-9ba5-f6f8a2306bb0 with identifier: CF60022 to the API
2026-03-30 11:18:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 224,
'expiration_date': '2026-03-31T15:33:56Z',
'fuel_type': 'hybrid',
'id': 'f413e7ad-beb9-5193-9ba5-f6f8a2306bb0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF60022',
'listing': 'auction',
'make': 'DS Automobiles',
'model': 'DS4',
'odometer': 19494,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-02-25',
'seller_name': None,
'title': 'DS Automobiles DS4 1.6 E-Tense Hybrid Performance Line',
'transmission': 'automatic',
'trim': 'Performance Line',
'year': 2024}
2026-03-30 11:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CF60022%27 HTTP/1.1" 200 None
2026-03-30 11:18:55 [auto1.es] INFO: Saving data for CF60022: {'auction_closing_time': 1774971236.0, 'created_time': 1773130804.189858, 'last_price_update_time': 1774869535.165836}
2026-03-30 11:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CF60022') HTTP/1.1" 204 0
2026-03-30 11:18:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_4d9b5af74f3801ddfcf7d326f1721016.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:55 [auto1.es] INFO: Found listing with ID: FW49739
2026-03-30 11:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FW49739%27 HTTP/1.1" 200 None
2026-03-30 11:18:55 [auto1.es] INFO: Scrape type for FW49739: 1
2026-03-30 11:18:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_f5b94ea954ef828184aa7f1c2198292e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HJ95484/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:55 [auto1.es] INFO: Found listing with ID: US78299
2026-03-30 11:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US78299%27 HTTP/1.1" 200 None
2026-03-30 11:18:55 [auto1.es] INFO: Scrape type for US78299: 1
2026-03-30 11:18:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060d04e50>
2026-03-30 11:18:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_266b95a0-a408-55be-b8a1-cecfb401bf59/266b95a0-a408-55be-b8a1-cecfb401bf59_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F9e%252F859ec2f18a9bd851075369c266ac05d3%252Fpa%252FJU25572_d53001e49633e5b78d017c22701d452c.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_d53001e49633e5b78d017c22701d452c.jpg saved to cache
2026-03-30 11:18:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 266b95a0-a408-55be-b8a1-cecfb401bf59
2026-03-30 11:18:55 [auto1.es] INFO: Found listing with ID: HF43157
2026-03-30 11:18:55 [auto1.es] INFO: Found listing with ID: WS41958
2026-03-30 11:18:55 [auto1.es] INFO: Found listing with ID: RD87944
2026-03-30 11:18:55 [auto1.es] INFO: Found listing with ID: TW64158
2026-03-30 11:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW64158%27 HTTP/1.1" 200 None
2026-03-30 11:18:55 [auto1.es] INFO: Scrape type for TW64158: 2
2026-03-30 11:18:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00c28f65-be75-55ad-a859-0dd7d95af6bf with identifier: TW64158
2026-03-30 11:18:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00c28f65-be75-55ad-a859-0dd7d95af6bf with scrape type 2
2026-03-30 11:18:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00c28f65-be75-55ad-a859-0dd7d95af6bf with scrape type 2
2026-03-30 11:18:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 00c28f65-be75-55ad-a859-0dd7d95af6bf, identifier: TW64158
2026-03-30 11:18:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 00c28f65-be75-55ad-a859-0dd7d95af6bf with identifier: TW64158
2026-03-30 11:18:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 00c28f65-be75-55ad-a859-0dd7d95af6bf with identifier: TW64158
2026-03-30 11:18:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 00c28f65-be75-55ad-a859-0dd7d95af6bf with identifier: TW64158 to the API
2026-03-30 11:18:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 77,
'expiration_date': '2026-03-31T15:15:56Z',
'fuel_type': 'electro',
'id': '00c28f65-be75-55ad-a859-0dd7d95af6bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW64158',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 94119,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-24',
'seller_name': None,
'title': 'Peugeot 2008 electric drive 57 kW e Active',
'transmission': 'automatic',
'trim': 'e Active',
'year': 2021}
2026-03-30 11:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW64158%27 HTTP/1.1" 200 None
2026-03-30 11:18:55 [auto1.es] INFO: Saving data for TW64158: {'auction_closing_time': 1774970156.0, 'created_time': 1773130917.963237, 'last_price_update_time': 1774869535.979749}
2026-03-30 11:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TW64158') HTTP/1.1" 204 0
2026-03-30 11:18:56 [auto1.es] INFO: Found listing with ID: JZ31691
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JZ31691%27 HTTP/1.1" 200 None
2026-03-30 11:18:56 [auto1.es] INFO: Scrape type for JZ31691: 1
2026-03-30 11:18:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CP61201/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:56 [auto1.es] INFO: Found listing with ID: FG19732
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG19732%27 HTTP/1.1" 200 None
2026-03-30 11:18:56 [auto1.es] INFO: Scrape type for FG19732: 2
2026-03-30 11:18:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33e82dae-3fb8-524b-ab8f-672401617265 with identifier: FG19732
2026-03-30 11:18:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33e82dae-3fb8-524b-ab8f-672401617265 with scrape type 2
2026-03-30 11:18:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33e82dae-3fb8-524b-ab8f-672401617265 with scrape type 2
2026-03-30 11:18:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 33e82dae-3fb8-524b-ab8f-672401617265, identifier: FG19732
2026-03-30 11:18:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a32fd50>
2026-03-30 11:18:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_266b95a0-a408-55be-b8a1-cecfb401bf59/266b95a0-a408-55be-b8a1-cecfb401bf59_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F9e%252F859ec2f18a9bd851075369c266ac05d3%252Fpa%252FJU25572_4d9b5af74f3801ddfcf7d326f1721016.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_4d9b5af74f3801ddfcf7d326f1721016.jpg saved to cache
2026-03-30 11:18:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 266b95a0-a408-55be-b8a1-cecfb401bf59
2026-03-30 11:18:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a346dd0>
2026-03-30 11:18:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_266b95a0-a408-55be-b8a1-cecfb401bf59/266b95a0-a408-55be-b8a1-cecfb401bf59_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F9e%252F859ec2f18a9bd851075369c266ac05d3%252Fpa%252FJU25572_f5b94ea954ef828184aa7f1c2198292e.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_f5b94ea954ef828184aa7f1c2198292e.jpg saved to cache
2026-03-30 11:18:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 266b95a0-a408-55be-b8a1-cecfb401bf59
2026-03-30 11:18:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 266b95a0-a408-55be-b8a1-cecfb401bf59, skipping ID generation
2026-03-30 11:18:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 266b95a0-a408-55be-b8a1-cecfb401bf59 with scrape type 1
2026-03-30 11:18:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 266b95a0-a408-55be-b8a1-cecfb401bf59 sending to next pipeline
2026-03-30 11:18:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 266b95a0-a408-55be-b8a1-cecfb401bf59, identifier: JU25572
2026-03-30 11:18:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 33e82dae-3fb8-524b-ab8f-672401617265 with identifier: FG19732
2026-03-30 11:18:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 33e82dae-3fb8-524b-ab8f-672401617265 with identifier: FG19732
2026-03-30 11:18:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 33e82dae-3fb8-524b-ab8f-672401617265 with identifier: FG19732 to the API
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-31T15:24:51Z',
'fuel_type': 'diesel',
'id': '33e82dae-3fb8-524b-ab8f-672401617265',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG19732',
'listing': 'auction',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 155754,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-25',
'seller_name': None,
'title': 'Citroen Berlingo 1.5 Blue-HDi Live Pack Business M',
'transmission': 'manual',
'trim': 'Live Pack Business M',
'year': 2022}
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG19732%27 HTTP/1.1" 200 None
2026-03-30 11:18:56 [auto1.es] INFO: Saving data for FG19732: {'auction_closing_time': 1774970691.0, 'created_time': 1773130896.729942, 'last_price_update_time': 1774869536.833464}
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FG19732') HTTP/1.1" 204 0
2026-03-30 11:18:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 266b95a0-a408-55be-b8a1-cecfb401bf59 with identifier: JU25572
2026-03-30 11:18:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 266b95a0-a408-55be-b8a1-cecfb401bf59 with identifier: JU25572
2026-03-30 11:18:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 266b95a0-a408-55be-b8a1-cecfb401bf59 with identifier: JU25572 to the API
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_f5b94ea954ef828184aa7f1c2198292e.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'engine_horse_power': 113,
'expiration_date': '2026-03-31T15:46:50Z',
'fuel_type': 'diesel',
'id': '266b95a0-a408-55be-b8a1-cecfb401bf59',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU25572',
'listing': 'auction',
'location': 'ES, Cornellà de Llobregat',
'make': 'Hyundai',
'model': 'Santa Fe',
'odometer': 105450,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_266b95a0-a408-55be-b8a1-cecfb401bf59/266b95a0-a408-55be-b8a1-cecfb401bf59_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63622,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_9fbbe66c728d088257776d8bba1dea60.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_266b95a0-a408-55be-b8a1-cecfb401bf59/266b95a0-a408-55be-b8a1-cecfb401bf59_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66012,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_700f56a360e6c0cea3cc7932ad34ed65.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_266b95a0-a408-55be-b8a1-cecfb401bf59/266b95a0-a408-55be-b8a1-cecfb401bf59_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58110,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_f5b94ea954ef828184aa7f1c2198292e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_266b95a0-a408-55be-b8a1-cecfb401bf59/266b95a0-a408-55be-b8a1-cecfb401bf59_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54885,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_3f56dce997dd7ef49ad53e90a11bdcf3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_266b95a0-a408-55be-b8a1-cecfb401bf59/266b95a0-a408-55be-b8a1-cecfb401bf59_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54044,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_77d3b79aec8156326b06fbe9ca01a210.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_266b95a0-a408-55be-b8a1-cecfb401bf59/266b95a0-a408-55be-b8a1-cecfb401bf59_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58354,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_4d9b5af74f3801ddfcf7d326f1721016.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_266b95a0-a408-55be-b8a1-cecfb401bf59/266b95a0-a408-55be-b8a1-cecfb401bf59_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55220,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_34bfdc6054dc8349c9e6c733ca9f07ea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_266b95a0-a408-55be-b8a1-cecfb401bf59/266b95a0-a408-55be-b8a1-cecfb401bf59_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63921,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_dd11da9fe7567a8369714271a79598ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_266b95a0-a408-55be-b8a1-cecfb401bf59/266b95a0-a408-55be-b8a1-cecfb401bf59_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59001,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_31344b9c0dbb978082651802e75c397f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_266b95a0-a408-55be-b8a1-cecfb401bf59/266b95a0-a408-55be-b8a1-cecfb401bf59_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60564,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/9e/859ec2f18a9bd851075369c266ac05d3/pa/JU25572_d53001e49633e5b78d017c22701d452c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2003-04-27',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai Santa Fe 2.0 CRDi GLS CRDI',
'transmission': 'manual',
'trim': 'GLS CRDI',
'year': 2003}
2026-03-30 11:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JU25572%27 HTTP/1.1" 200 None
2026-03-30 11:18:57 [auto1.es] INFO: Saving data for JU25572: {'created_time': 1774869537.257904, 'last_price_update_time': 1774869537.257916, 'auction_closing_time': 1774972010.0}
2026-03-30 11:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JU25572') HTTP/1.1" 204 0
2026-03-30 11:18:57 [auto1.es] INFO: Found listing with ID: VG19882
2026-03-30 11:18:57 [auto1.es] INFO: Found listing with ID: PX05110
2026-03-30 11:18:57 [auto1.es] INFO: Found listing with ID: PM42549
2026-03-30 11:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PM42549%27 HTTP/1.1" 200 None
2026-03-30 11:18:57 [auto1.es] INFO: Scrape type for PM42549: 2
2026-03-30 11:18:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb92b0fc-748c-5159-9890-a8e4b420eba8 with identifier: PM42549
2026-03-30 11:18:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb92b0fc-748c-5159-9890-a8e4b420eba8 with scrape type 2
2026-03-30 11:18:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb92b0fc-748c-5159-9890-a8e4b420eba8 with scrape type 2
2026-03-30 11:18:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fb92b0fc-748c-5159-9890-a8e4b420eba8, identifier: PM42549
2026-03-30 11:18:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fb92b0fc-748c-5159-9890-a8e4b420eba8 with identifier: PM42549
2026-03-30 11:18:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fb92b0fc-748c-5159-9890-a8e4b420eba8 with identifier: PM42549
2026-03-30 11:18:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fb92b0fc-748c-5159-9890-a8e4b420eba8 with identifier: PM42549 to the API
2026-03-30 11:18:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 170,
'expiration_date': '2026-03-31T15:26:54Z',
'fuel_type': 'petrol',
'id': 'fb92b0fc-748c-5159-9890-a8e4b420eba8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM42549',
'listing': 'auction',
'make': 'Alfa Romeo',
'model': 'MiTo',
'odometer': 188494,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-10-28',
'seller_name': None,
'title': 'Alfa Romeo MiTo 1.4 Turbo Quadrifoglio Verde',
'transmission': 'manual',
'trim': 'Quadrifoglio Verde',
'year': 2010}
2026-03-30 11:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PM42549%27 HTTP/1.1" 200 None
2026-03-30 11:18:57 [auto1.es] INFO: Saving data for PM42549: {'auction_closing_time': 1774970814.0, 'created_time': 1773144332.072223, 'last_price_update_time': 1774869537.735928}
2026-03-30 11:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PM42549') HTTP/1.1" 204 0
2026-03-30 11:18:57 [auto1.es] INFO: Found listing with ID: VK69645
2026-03-30 11:18:57 [auto1.es] INFO: Found listing with ID: YT36266
2026-03-30 11:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YT36266%27 HTTP/1.1" 200 None
2026-03-30 11:18:57 [auto1.es] INFO: Scrape type for YT36266: 2
2026-03-30 11:18:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42948e3f-99bc-5b31-8bf1-d92fb726475a with identifier: YT36266
2026-03-30 11:18:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42948e3f-99bc-5b31-8bf1-d92fb726475a with scrape type 2
2026-03-30 11:18:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42948e3f-99bc-5b31-8bf1-d92fb726475a with scrape type 2
2026-03-30 11:18:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 42948e3f-99bc-5b31-8bf1-d92fb726475a, identifier: YT36266
2026-03-30 11:18:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 42948e3f-99bc-5b31-8bf1-d92fb726475a with identifier: YT36266
2026-03-30 11:18:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 42948e3f-99bc-5b31-8bf1-d92fb726475a with identifier: YT36266
2026-03-30 11:18:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 42948e3f-99bc-5b31-8bf1-d92fb726475a with identifier: YT36266 to the API
2026-03-30 11:18:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-31T15:05:29Z',
'fuel_type': 'diesel',
'id': '42948e3f-99bc-5b31-8bf1-d92fb726475a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT36266',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 89363,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-13',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 200 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2019}
2026-03-30 11:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YT36266%27 HTTP/1.1" 200 None
2026-03-30 11:18:58 [auto1.es] INFO: Saving data for YT36266: {'auction_closing_time': 1774969529.0, 'created_time': 1773130934.249131, 'last_price_update_time': 1774869538.31763}
2026-03-30 11:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YT36266') HTTP/1.1" 204 0
2026-03-30 11:18:58 [auto1.es] INFO: Found listing with ID: NN28025
2026-03-30 11:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NN28025%27 HTTP/1.1" 200 None
2026-03-30 11:18:58 [auto1.es] INFO: Scrape type for NN28025: 1
2026-03-30 11:18:58 [auto1.es] INFO: Found listing with ID: EN32990
2026-03-30 11:18:58 [auto1.es] INFO: Found listing with ID: YJ05760
2026-03-30 11:18:58 [auto1.es] INFO: Found listing with ID: JF13229
2026-03-30 11:18:58 [auto1.es] INFO: Found listing with ID: HT92160
2026-03-30 11:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HT92160%27 HTTP/1.1" 200 None
2026-03-30 11:18:58 [auto1.es] INFO: Scrape type for HT92160: 2
2026-03-30 11:18:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94bf749b-2de1-50b9-87b6-975bad72910b with identifier: HT92160
2026-03-30 11:18:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94bf749b-2de1-50b9-87b6-975bad72910b with scrape type 2
2026-03-30 11:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94bf749b-2de1-50b9-87b6-975bad72910b with scrape type 2
2026-03-30 11:18:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 94bf749b-2de1-50b9-87b6-975bad72910b, identifier: HT92160
2026-03-30 11:18:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 94bf749b-2de1-50b9-87b6-975bad72910b with identifier: HT92160
2026-03-30 11:18:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 94bf749b-2de1-50b9-87b6-975bad72910b with identifier: HT92160
2026-03-30 11:18:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 94bf749b-2de1-50b9-87b6-975bad72910b with identifier: HT92160 to the API
2026-03-30 11:18:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:42:18Z',
'fuel_type': 'diesel',
'id': '94bf749b-2de1-50b9-87b6-975bad72910b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT92160',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 Caravelle',
'odometer': 85235,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-02',
'seller_name': None,
'title': 'Volkswagen T6 Caravelle 2.0 TDI Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2019}
2026-03-30 11:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HT92160%27 HTTP/1.1" 200 None
2026-03-30 11:18:58 [auto1.es] INFO: Saving data for HT92160: {'auction_closing_time': 1774971738.0, 'created_time': 1773691539.211191, 'last_price_update_time': 1774869538.82882}
2026-03-30 11:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HT92160') HTTP/1.1" 204 0
2026-03-30 11:18:58 [auto1.es] INFO: Found listing with ID: WR66787
2026-03-30 11:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WR66787%27 HTTP/1.1" 200 None
2026-03-30 11:18:58 [auto1.es] INFO: Scrape type for WR66787: 1
2026-03-30 11:18:58 [auto1.es] INFO: Found listing with ID: SL49556
2026-03-30 11:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL49556%27 HTTP/1.1" 200 None
2026-03-30 11:18:58 [auto1.es] INFO: Scrape type for SL49556: 2
2026-03-30 11:18:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fc6a6ea-554a-59aa-b47a-7e41c24af371 with identifier: SL49556
2026-03-30 11:18:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fc6a6ea-554a-59aa-b47a-7e41c24af371 with scrape type 2
2026-03-30 11:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9fc6a6ea-554a-59aa-b47a-7e41c24af371 with scrape type 2
2026-03-30 11:18:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9fc6a6ea-554a-59aa-b47a-7e41c24af371, identifier: SL49556
2026-03-30 11:18:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EN27378/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9fc6a6ea-554a-59aa-b47a-7e41c24af371 with identifier: SL49556
2026-03-30 11:18:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9fc6a6ea-554a-59aa-b47a-7e41c24af371 with identifier: SL49556
2026-03-30 11:18:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9fc6a6ea-554a-59aa-b47a-7e41c24af371 with identifier: SL49556 to the API
2026-03-30 11:18:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-31T15:27:25Z',
'fuel_type': 'diesel',
'id': '9fc6a6ea-554a-59aa-b47a-7e41c24af371',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL49556',
'listing': 'auction',
'make': 'Jaguar',
'model': 'E-Pace',
'odometer': 133505,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-13',
'seller_name': None,
'title': 'Jaguar E-Pace D180 S AWD',
'transmission': 'automatic',
'trim': 'S AWD',
'year': 2019}
2026-03-30 11:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL49556%27 HTTP/1.1" 200 None
2026-03-30 11:18:59 [auto1.es] INFO: Saving data for SL49556: {'auction_closing_time': 1774970845.0, 'created_time': 1773126766.217855, 'last_price_update_time': 1774869539.310539}
2026-03-30 11:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SL49556') HTTP/1.1" 204 0
2026-03-30 11:18:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:59 [auto1.es] INFO: Found listing with ID: VG08708
2026-03-30 11:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VG08708%27 HTTP/1.1" 200 None
2026-03-30 11:18:59 [auto1.es] INFO: Scrape type for VG08708: 2
2026-03-30 11:18:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b46f3d0d-c8d2-57ed-a783-5f6d8ba33379 with identifier: VG08708
2026-03-30 11:18:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b46f3d0d-c8d2-57ed-a783-5f6d8ba33379 with scrape type 2
2026-03-30 11:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b46f3d0d-c8d2-57ed-a783-5f6d8ba33379 with scrape type 2
2026-03-30 11:18:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b46f3d0d-c8d2-57ed-a783-5f6d8ba33379, identifier: VG08708
2026-03-30 11:18:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b46f3d0d-c8d2-57ed-a783-5f6d8ba33379 with identifier: VG08708
2026-03-30 11:18:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b46f3d0d-c8d2-57ed-a783-5f6d8ba33379 with identifier: VG08708
2026-03-30 11:18:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b46f3d0d-c8d2-57ed-a783-5f6d8ba33379 with identifier: VG08708 to the API
2026-03-30 11:18:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-31T15:54:19Z',
'fuel_type': 'diesel',
'id': 'b46f3d0d-c8d2-57ed-a783-5f6d8ba33379',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG08708',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 216438,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-02-25',
'seller_name': None,
'title': 'Volvo XC60 2.0 D3 Momentum 2WD',
'transmission': 'automatic',
'trim': 'Momentum 2WD',
'year': 2014}
2026-03-30 11:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VG08708%27 HTTP/1.1" 200 None
2026-03-30 11:18:59 [auto1.es] INFO: Saving data for VG08708: {'auction_closing_time': 1774972459.0, 'created_time': 1772704940.718748, 'last_price_update_time': 1774869539.766949}
2026-03-30 11:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VG08708') HTTP/1.1" 204 0
2026-03-30 11:18:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PY38886/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:59 [auto1.es] INFO: Found listing with ID: HD72469
2026-03-30 11:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HD72469%27 HTTP/1.1" 200 None
2026-03-30 11:18:59 [auto1.es] INFO: Scrape type for HD72469: 2
2026-03-30 11:18:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 156b6629-aeee-58bd-9c92-fa238d779bc0 with identifier: HD72469
2026-03-30 11:18:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 156b6629-aeee-58bd-9c92-fa238d779bc0 with scrape type 2
2026-03-30 11:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 156b6629-aeee-58bd-9c92-fa238d779bc0 with scrape type 2
2026-03-30 11:18:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 156b6629-aeee-58bd-9c92-fa238d779bc0, identifier: HD72469
2026-03-30 11:18:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 156b6629-aeee-58bd-9c92-fa238d779bc0 with identifier: HD72469
2026-03-30 11:18:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 156b6629-aeee-58bd-9c92-fa238d779bc0 with identifier: HD72469
2026-03-30 11:18:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 156b6629-aeee-58bd-9c92-fa238d779bc0 with identifier: HD72469 to the API
2026-03-30 11:18:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:19:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:19:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:43:12Z',
'fuel_type': 'diesel',
'id': '156b6629-aeee-58bd-9c92-fa238d779bc0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD72469',
'listing': 'auction',
'make': 'Nissan',
'model': 'Juke',
'odometer': 179599,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-26',
'seller_name': None,
'title': 'Nissan Juke 1.5 dCi Bose Personal Edition',
'transmission': 'manual',
'trim': 'Bose Personal Edition',
'year': 2019}
2026-03-30 11:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HD72469%27 HTTP/1.1" 200 None
2026-03-30 11:19:00 [auto1.es] INFO: Saving data for HD72469: {'auction_closing_time': 1774971792.0, 'created_time': 1773133204.197851, 'last_price_update_time': 1774869540.301564}
2026-03-30 11:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HD72469') HTTP/1.1" 204 0
2026-03-30 11:19:00 [auto1.es] INFO: Found listing with ID: LH46678
2026-03-30 11:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LH46678%27 HTTP/1.1" 200 None
2026-03-30 11:19:00 [auto1.es] INFO: Scrape type for LH46678: 1
2026-03-30 11:19:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VF55417/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:19:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:19:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:19:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:19:03 [auto1.es] INFO: Channel: 24h | Page: 6 | totalHits: 2213 | hits on page: 40
2026-03-30 11:19:03 [auto1.es] INFO: Found listing with ID: HD72469
2026-03-30 11:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HD72469%27 HTTP/1.1" 200 None
2026-03-30 11:19:03 [auto1.es] INFO: Scrape type for HD72469: 0
2026-03-30 11:19:03 [auto1.es] INFO: Found listing with ID: LH46678
2026-03-30 11:19:03 [auto1.es] INFO: Found listing with ID: FV43676
2026-03-30 11:19:03 [auto1.es] INFO: Found listing with ID: LP52549
2026-03-30 11:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LP52549%27 HTTP/1.1" 200 None
2026-03-30 11:19:03 [auto1.es] INFO: Scrape type for LP52549: 1
2026-03-30 11:19:03 [auto1.es] INFO: Found listing with ID: YF71759
2026-03-30 11:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YF71759%27 HTTP/1.1" 200 None
2026-03-30 11:19:03 [auto1.es] INFO: Scrape type for YF71759: 2
2026-03-30 11:19:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d56be79-024c-5e93-ac29-a982df34edb1 with identifier: YF71759
2026-03-30 11:19:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d56be79-024c-5e93-ac29-a982df34edb1 with scrape type 2
2026-03-30 11:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d56be79-024c-5e93-ac29-a982df34edb1 with scrape type 2
2026-03-30 11:19:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5d56be79-024c-5e93-ac29-a982df34edb1, identifier: YF71759
2026-03-30 11:19:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5d56be79-024c-5e93-ac29-a982df34edb1 with identifier: YF71759
2026-03-30 11:19:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5d56be79-024c-5e93-ac29-a982df34edb1 with identifier: YF71759
2026-03-30 11:19:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5d56be79-024c-5e93-ac29-a982df34edb1 with identifier: YF71759 to the API
2026-03-30 11:19:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:19:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:19:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-31T15:40:27Z',
'fuel_type': 'hybrid',
'id': '5d56be79-024c-5e93-ac29-a982df34edb1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF71759',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Vitara',
'odometer': 65165,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-30',
'seller_name': None,
'title': 'Suzuki Vitara 1.5 Dualjet Hybrid Comfort 4x4',
'transmission': 'automatic',
'trim': 'Comfort 4x4',
'year': 2022}
2026-03-30 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YF71759%27 HTTP/1.1" 200 None
2026-03-30 11:19:04 [auto1.es] INFO: Saving data for YF71759: {'auction_closing_time': 1774971627.0, 'created_time': 1773130413.30341, 'last_price_update_time': 1774869544.937332}
2026-03-30 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YF71759') HTTP/1.1" 204 0
2026-03-30 11:19:04 [auto1.es] INFO: Found listing with ID: HH14310
2026-03-30 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HH14310%27 HTTP/1.1" 200 None
2026-03-30 11:19:04 [auto1.es] INFO: Scrape type for HH14310: 1
2026-03-30 11:19:04 [scrapy.extensions.logstats] INFO: Crawled 73 pages (at 23 pages/min), scraped 74 items (at 51 items/min)
2026-03-30 11:19:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 161MiB
2026-03-30 11:19:04 [auto1.es] INFO: Found listing with ID: GW76343
2026-03-30 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GW76343%27 HTTP/1.1" 200 None
2026-03-30 11:19:05 [auto1.es] INFO: Scrape type for GW76343: 1
2026-03-30 11:19:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JG71892/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:19:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:19:05 [auto1.es] INFO: Found listing with ID: HL09237
2026-03-30 11:19:05 [auto1.es] INFO: Found listing with ID: HC82421
2026-03-30 11:19:05 [auto1.es] INFO: Found listing with ID: AC34566
2026-03-30 11:19:05 [auto1.es] INFO: Found listing with ID: VX61508
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VX61508%27 HTTP/1.1" 200 None
2026-03-30 11:19:05 [auto1.es] INFO: Scrape type for VX61508: 1
2026-03-30 11:19:05 [auto1.es] INFO: Found listing with ID: GV99509
2026-03-30 11:19:05 [auto1.es] INFO: Found listing with ID: SV63508
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SV63508%27 HTTP/1.1" 200 None
2026-03-30 11:19:05 [auto1.es] INFO: Scrape type for SV63508: 2
2026-03-30 11:19:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c7767de-c6b4-5eb4-8dd1-337737fbe1b2 with identifier: SV63508
2026-03-30 11:19:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c7767de-c6b4-5eb4-8dd1-337737fbe1b2 with scrape type 2
2026-03-30 11:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c7767de-c6b4-5eb4-8dd1-337737fbe1b2 with scrape type 2
2026-03-30 11:19:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5c7767de-c6b4-5eb4-8dd1-337737fbe1b2, identifier: SV63508
2026-03-30 11:19:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5c7767de-c6b4-5eb4-8dd1-337737fbe1b2 with identifier: SV63508
2026-03-30 11:19:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5c7767de-c6b4-5eb4-8dd1-337737fbe1b2 with identifier: SV63508
2026-03-30 11:19:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5c7767de-c6b4-5eb4-8dd1-337737fbe1b2 with identifier: SV63508 to the API
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:19:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:18:06Z',
'fuel_type': 'diesel',
'id': '5c7767de-c6b4-5eb4-8dd1-337737fbe1b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV63508',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLB-Klasse',
'odometer': 159298,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-05',
'seller_name': None,
'title': 'Mercedes-Benz GLB-Klasse GLB 200 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2021}
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SV63508%27 HTTP/1.1" 200 None
2026-03-30 11:19:05 [auto1.es] INFO: Saving data for SV63508: {'auction_closing_time': 1774970286.0, 'created_time': 1773131082.712723, 'last_price_update_time': 1774869545.497111}
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SV63508') HTTP/1.1" 204 0
2026-03-30 11:19:05 [auto1.es] INFO: Found listing with ID: UT64547
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT64547%27 HTTP/1.1" 200 None
2026-03-30 11:19:05 [auto1.es] INFO: Scrape type for UT64547: 2
2026-03-30 11:19:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf7ff2ce-1a4b-528b-8454-8bf88e99724e with identifier: UT64547
2026-03-30 11:19:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf7ff2ce-1a4b-528b-8454-8bf88e99724e with scrape type 2
2026-03-30 11:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf7ff2ce-1a4b-528b-8454-8bf88e99724e with scrape type 2
2026-03-30 11:19:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cf7ff2ce-1a4b-528b-8454-8bf88e99724e, identifier: UT64547
2026-03-30 11:19:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cf7ff2ce-1a4b-528b-8454-8bf88e99724e with identifier: UT64547
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-30 11:19:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:19:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cf7ff2ce-1a4b-528b-8454-8bf88e99724e with identifier: UT64547
2026-03-30 11:19:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cf7ff2ce-1a4b-528b-8454-8bf88e99724e with identifier: UT64547 to the API
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:19:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:44:18Z',
'fuel_type': 'diesel',
'id': 'cf7ff2ce-1a4b-528b-8454-8bf88e99724e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT64547',
'listing': 'auction',
'make': 'Ford',
'model': 'C-Max',
'odometer': 252178,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-03-14',
'seller_name': None,
'title': 'Ford C-Max 1.8 TDCi Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2007}
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT64547%27 HTTP/1.1" 200 None
2026-03-30 11:19:06 [auto1.es] INFO: Saving data for UT64547: {'auction_closing_time': 1774971858.0, 'created_time': 1773128943.046642, 'last_price_update_time': 1774869546.313549}
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UT64547') HTTP/1.1" 204 0
2026-03-30 11:19:06 [auto1.es] INFO: Found listing with ID: JF84968
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JF84968%27 HTTP/1.1" 200 None
2026-03-30 11:19:06 [auto1.es] INFO: Scrape type for JF84968: 2
2026-03-30 11:19:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12fee069-b204-5660-8b65-3e1acb86e9f9 with identifier: JF84968
2026-03-30 11:19:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12fee069-b204-5660-8b65-3e1acb86e9f9 with scrape type 2
2026-03-30 11:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12fee069-b204-5660-8b65-3e1acb86e9f9 with scrape type 2
2026-03-30 11:19:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 12fee069-b204-5660-8b65-3e1acb86e9f9, identifier: JF84968
2026-03-30 11:19:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 12fee069-b204-5660-8b65-3e1acb86e9f9 with identifier: JF84968
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-30 11:19:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:19:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 12fee069-b204-5660-8b65-3e1acb86e9f9 with identifier: JF84968
2026-03-30 11:19:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 12fee069-b204-5660-8b65-3e1acb86e9f9 with identifier: JF84968 to the API
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:19:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 197,
'expiration_date': '2026-03-31T15:33:23Z',
'fuel_type': 'diesel',
'id': '12fee069-b204-5660-8b65-3e1acb86e9f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF84968',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 90247,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-14',
'seller_name': None,
'title': 'Volvo XC60 2.0 B4 Mild-Hybrid R Design 2WD',
'transmission': 'automatic',
'trim': 'R Design 2WD',
'year': 2020}
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JF84968%27 HTTP/1.1" 200 None
2026-03-30 11:19:06 [auto1.es] INFO: Saving data for JF84968: {'auction_closing_time': 1774971203.0, 'created_time': 1773133098.753838, 'last_price_update_time': 1774869546.972393}
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JF84968') HTTP/1.1" 204 0
2026-03-30 11:19:06 [auto1.es] INFO: Found listing with ID: HK56314
2026-03-30 11:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HK56314%27 HTTP/1.1" 200 None
2026-03-30 11:19:07 [auto1.es] INFO: Scrape type for HK56314: 2
2026-03-30 11:19:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bb77edb-3e76-56ef-a12f-ad7a4ab15e55 with identifier: HK56314
2026-03-30 11:19:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bb77edb-3e76-56ef-a12f-ad7a4ab15e55 with scrape type 2
2026-03-30 11:19:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bb77edb-3e76-56ef-a12f-ad7a4ab15e55 with scrape type 2
2026-03-30 11:19:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7bb77edb-3e76-56ef-a12f-ad7a4ab15e55, identifier: HK56314
2026-03-30 11:19:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZU15820> (referer: https://www.auto1.com/v1/car-details-view/ZU15820/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:19:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7bb77edb-3e76-56ef-a12f-ad7a4ab15e55 with identifier: HK56314
2026-03-30 11:19:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7bb77edb-3e76-56ef-a12f-ad7a4ab15e55 with identifier: HK56314
2026-03-30 11:19:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7bb77edb-3e76-56ef-a12f-ad7a4ab15e55 with identifier: HK56314 to the API
2026-03-30 11:19:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:19:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:19:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-31T15:26:30Z',
'fuel_type': 'diesel',
'id': '7bb77edb-3e76-56ef-a12f-ad7a4ab15e55',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK56314',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 165786,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-03',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 220 d Urban',
'transmission': 'automatic',
'trim': 'Urban',
'year': 2015}
2026-03-30 11:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HK56314%27 HTTP/1.1" 200 None
2026-03-30 11:19:07 [auto1.es] INFO: Saving data for HK56314: {'auction_closing_time': 1774970790.0, 'created_time': 1774296464.104316, 'last_price_update_time': 1774869547.457364}
2026-03-30 11:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HK56314') HTTP/1.1" 204 0
2026-03-30 11:19:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:19:07 [auto1.es] INFO: Found listing with ID: XR63585
2026-03-30 11:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XR63585%27 HTTP/1.1" 200 None
2026-03-30 11:19:07 [auto1.es] INFO: Scrape type for XR63585: 2
2026-03-30 11:19:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e0efc9b-3af4-5c15-a2b0-2410cef67347 with identifier: XR63585
2026-03-30 11:19:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e0efc9b-3af4-5c15-a2b0-2410cef67347 with scrape type 2
2026-03-30 11:19:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e0efc9b-3af4-5c15-a2b0-2410cef67347 with scrape type 2
2026-03-30 11:19:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4e0efc9b-3af4-5c15-a2b0-2410cef67347, identifier: XR63585
2026-03-30 11:19:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4e0efc9b-3af4-5c15-a2b0-2410cef67347 with identifier: XR63585
2026-03-30 11:19:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4e0efc9b-3af4-5c15-a2b0-2410cef67347 with identifier: XR63585
2026-03-30 11:19:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4e0efc9b-3af4-5c15-a2b0-2410cef67347 with identifier: XR63585 to the API
2026-03-30 11:19:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:19:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:19:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:00:39Z',
'fuel_type': 'diesel',
'id': '4e0efc9b-3af4-5c15-a2b0-2410cef67347',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR63585',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Expert',
'odometer': 76648,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-26',
'seller_name': None,
'title': 'Peugeot Expert 1.5 Blue-HDi L3',
'transmission': 'manual',
'trim': 'L3',
'year': 2020}
2026-03-30 11:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XR63585%27 HTTP/1.1" 200 None
2026-03-30 11:19:07 [auto1.es] INFO: Saving data for XR63585: {'auction_closing_time': 1774969239.0, 'created_time': 1773131050.212013, 'last_price_update_time': 1774869547.962899}
2026-03-30 11:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XR63585') HTTP/1.1" 204 0
2026-03-30 11:19:07 [auto1.es] INFO: Found listing with ID: SY68664
2026-03-30 11:19:07 [auto1.es] INFO: Found listing with ID: DX71922
2026-03-30 11:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DX71922%27 HTTP/1.1" 200 None
2026-03-30 11:19:08 [auto1.es] INFO: Scrape type for DX71922: 1
2026-03-30 11:19:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55c527b0-6d02-59cb-aad4-e4034acfa757 with identifier: ZU15820
2026-03-30 11:19:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55c527b0-6d02-59cb-aad4-e4034acfa757 with scrape type 1
2026-03-30 11:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 55c527b0-6d02-59cb-aad4-e4034acfa757
2026-03-30 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F02%252F340215b9f18f806bddeb21e9179ec587%252Fpa%252FZU15820_f66b6ba1b5643c9ee2921afe63f1ddbd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_f66b6ba1b5643c9ee2921afe63f1ddbd.jpg not downloaded yet
2026-03-30 11:19:08 [auto1.es] INFO: Found listing with ID: EE39278
2026-03-30 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EE39278%27 HTTP/1.1" 200 None
2026-03-30 11:19:08 [auto1.es] INFO: Scrape type for EE39278: 2
2026-03-30 11:19:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bedb3d25-8a71-5807-8532-e6f7896b5496 with identifier: EE39278
2026-03-30 11:19:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bedb3d25-8a71-5807-8532-e6f7896b5496 with scrape type 2
2026-03-30 11:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bedb3d25-8a71-5807-8532-e6f7896b5496 with scrape type 2
2026-03-30 11:19:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bedb3d25-8a71-5807-8532-e6f7896b5496, identifier: EE39278
2026-03-30 11:19:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bedb3d25-8a71-5807-8532-e6f7896b5496 with identifier: EE39278
2026-03-30 11:19:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bedb3d25-8a71-5807-8532-e6f7896b5496 with identifier: EE39278
2026-03-30 11:19:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bedb3d25-8a71-5807-8532-e6f7896b5496 with identifier: EE39278 to the API
2026-03-30 11:19:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:19:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:19:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:10:11Z',
'fuel_type': 'diesel',
'id': 'bedb3d25-8a71-5807-8532-e6f7896b5496',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE39278',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 Transporter',
'odometer': 129108,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-04',
'seller_name': None,
'title': 'Volkswagen T6 Transporter 2.0 TDI Kasten 4Motion',
'transmission': 'automatic',
'trim': 'Kasten 4Motion',
'year': 2022}
2026-03-30 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EE39278%27 HTTP/1.1" 200 None
2026-03-30 11:19:08 [auto1.es] INFO: Saving data for EE39278: {'auction_closing_time': 1774969811.0, 'created_time': 1773131055.665962, 'last_price_update_time': 1774869548.77057}
2026-03-30 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EE39278') HTTP/1.1" 204 0
2026-03-30 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F02%252F340215b9f18f806bddeb21e9179ec587%252Fpa%252FZU15820_d7c9312ef8d27609eecb4fce5e47f8dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_d7c9312ef8d27609eecb4fce5e47f8dc.jpg not downloaded yet
2026-03-30 11:19:08 [auto1.es] INFO: Found listing with ID: AT55590
2026-03-30 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AT55590%27 HTTP/1.1" 200 None
2026-03-30 11:19:08 [auto1.es] INFO: Scrape type for AT55590: 1
2026-03-30 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F02%252F340215b9f18f806bddeb21e9179ec587%252Fpa%252FZU15820_2d8ccafca82c189cd71c39290b5c01b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_2d8ccafca82c189cd71c39290b5c01b2.jpg not downloaded yet
2026-03-30 11:19:08 [auto1.es] INFO: Found listing with ID: WA42706
2026-03-30 11:19:08 [auto1.es] INFO: Found listing with ID: UJ02953
2026-03-30 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UJ02953%27 HTTP/1.1" 200 None
2026-03-30 11:19:08 [auto1.es] INFO: Scrape type for UJ02953: 2
2026-03-30 11:19:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61007845-e139-53b9-8686-09988d89e67a with identifier: UJ02953
2026-03-30 11:19:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61007845-e139-53b9-8686-09988d89e67a with scrape type 2
2026-03-30 11:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61007845-e139-53b9-8686-09988d89e67a with scrape type 2
2026-03-30 11:19:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 61007845-e139-53b9-8686-09988d89e67a, identifier: UJ02953
2026-03-30 11:19:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 61007845-e139-53b9-8686-09988d89e67a with identifier: UJ02953
2026-03-30 11:19:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 61007845-e139-53b9-8686-09988d89e67a with identifier: UJ02953
2026-03-30 11:19:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 61007845-e139-53b9-8686-09988d89e67a with identifier: UJ02953 to the API
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:19:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 299,
'expiration_date': '2026-03-31T15:47:51Z',
'fuel_type': 'hybrid',
'id': '61007845-e139-53b9-8686-09988d89e67a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ02953',
'listing': 'auction',
'make': 'DS Automobiles',
'model': 'DS7 Crossback',
'odometer': 99557,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-14',
'seller_name': None,
'title': 'DS Automobiles DS7 Crossback 1.6 E-Tense Hybrid 4x4 Louvre',
'transmission': 'automatic',
'trim': '4x4 Louvre',
'year': 2022}
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UJ02953%27 HTTP/1.1" 200 None
2026-03-30 11:19:09 [auto1.es] INFO: Saving data for UJ02953: {'auction_closing_time': 1774972071.0, 'created_time': 1773130928.004529, 'last_price_update_time': 1774869549.56532}
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UJ02953') HTTP/1.1" 204 0
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F02%252F340215b9f18f806bddeb21e9179ec587%252Fpa%252FZU15820_0959eb0b48d162739fc46e49af8cf929.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_0959eb0b48d162739fc46e49af8cf929.jpg not downloaded yet
2026-03-30 11:19:09 [auto1.es] INFO: Found listing with ID: ZZ48834
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZZ48834%27 HTTP/1.1" 200 None
2026-03-30 11:19:09 [auto1.es] INFO: Scrape type for ZZ48834: 2
2026-03-30 11:19:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd65536e-74de-587b-8292-50695c584229 with identifier: ZZ48834
2026-03-30 11:19:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd65536e-74de-587b-8292-50695c584229 with scrape type 2
2026-03-30 11:19:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd65536e-74de-587b-8292-50695c584229 with scrape type 2
2026-03-30 11:19:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fd65536e-74de-587b-8292-50695c584229, identifier: ZZ48834
2026-03-30 11:19:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fd65536e-74de-587b-8292-50695c584229 with identifier: ZZ48834
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-30 11:19:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:19:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fd65536e-74de-587b-8292-50695c584229 with identifier: ZZ48834
2026-03-30 11:19:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fd65536e-74de-587b-8292-50695c584229 with identifier: ZZ48834 to the API
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:19:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-31T15:39:43Z',
'fuel_type': 'diesel',
'id': 'fd65536e-74de-587b-8292-50695c584229',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ48834',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLB-Klasse',
'odometer': 124598,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-18',
'seller_name': None,
'title': 'Mercedes-Benz GLB-Klasse GLB 220 d 4Matic Progressive',
'transmission': 'automatic',
'trim': '4Matic Progressive',
'year': 2022}
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZZ48834%27 HTTP/1.1" 200 None
2026-03-30 11:19:10 [auto1.es] INFO: Saving data for ZZ48834: {'auction_closing_time': 1774971583.0, 'created_time': 1773130641.189495, 'last_price_update_time': 1774869550.45292}
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZZ48834') HTTP/1.1" 204 0
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F02%252F340215b9f18f806bddeb21e9179ec587%252Fpa%252FZU15820_1a83981d50ad65cba3a89329c9ab38c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_1a83981d50ad65cba3a89329c9ab38c2.jpg not downloaded yet
2026-03-30 11:19:10 [auto1.es] INFO: Found listing with ID: XH14423
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH14423%27 HTTP/1.1" 200 None
2026-03-30 11:19:10 [auto1.es] INFO: Scrape type for XH14423: 2
2026-03-30 11:19:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92d96bbd-5a02-5eb8-96a9-84104e380fe0 with identifier: XH14423
2026-03-30 11:19:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92d96bbd-5a02-5eb8-96a9-84104e380fe0 with scrape type 2
2026-03-30 11:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92d96bbd-5a02-5eb8-96a9-84104e380fe0 with scrape type 2
2026-03-30 11:19:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 92d96bbd-5a02-5eb8-96a9-84104e380fe0, identifier: XH14423
2026-03-30 11:19:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 92d96bbd-5a02-5eb8-96a9-84104e380fe0 with identifier: XH14423
2026-03-30 11:19:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 92d96bbd-5a02-5eb8-96a9-84104e380fe0 with identifier: XH14423
2026-03-30 11:19:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 92d96bbd-5a02-5eb8-96a9-84104e380fe0 with identifier: XH14423 to the API
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:19:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:19:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:11:36Z',
'fuel_type': 'petrol',
'id': '92d96bbd-5a02-5eb8-96a9-84104e380fe0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH14423',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Kona',
'odometer': 27271,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-27',
'seller_name': None,
'title': 'Hyundai Kona 1.0 T-GDI N Line 30 Aniversario 2WD',
'transmission': 'manual',
'trim': 'N Line 30 Aniversario 2WD',
'year': 2023}
2026-03-30 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH14423%27 HTTP/1.1" 200 None
2026-03-30 11:19:11 [auto1.es] INFO: Saving data for XH14423: {'auction_closing_time': 1774969896.0, 'created_time': 1773130625.783663, 'last_price_update_time': 1774869551.156833}
2026-03-30 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XH14423') HTTP/1.1" 204 0
2026-03-30 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F02%252F340215b9f18f806bddeb21e9179ec587%252Fpa%252FZU15820_15e543e5eb2cc81ce46f8e8eae84dabc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_15e543e5eb2cc81ce46f8e8eae84dabc.jpg not downloaded yet
2026-03-30 11:19:11 [auto1.es] INFO: Found listing with ID: XW97577
2026-03-30 11:19:11 [auto1.es] INFO: Found listing with ID: LX18680
2026-03-30 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LX18680%27 HTTP/1.1" 200 None
2026-03-30 11:19:11 [auto1.es] INFO: Scrape type for LX18680: 2
2026-03-30 11:19:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7596ba36-50ea-5345-a05a-538da8f5e5c1 with identifier: LX18680
2026-03-30 11:19:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7596ba36-50ea-5345-a05a-538da8f5e5c1 with scrape type 2
2026-03-30 11:19:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7596ba36-50ea-5345-a05a-538da8f5e5c1 with scrape type 2
2026-03-30 11:19:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7596ba36-50ea-5345-a05a-538da8f5e5c1, identifier: LX18680
2026-03-30 11:19:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7596ba36-50ea-5345-a05a-538da8f5e5c1 with identifier: LX18680
2026-03-30 11:19:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7596ba36-50ea-5345-a05a-538da8f5e5c1 with identifier: LX18680
2026-03-30 11:19:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7596ba36-50ea-5345-a05a-538da8f5e5c1 with identifier: LX18680 to the API
2026-03-30 11:19:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:19:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:19:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-31T15:13:12Z',
'fuel_type': 'petrol',
'id': '7596ba36-50ea-5345-a05a-538da8f5e5c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX18680',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 111580,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-21',
'seller_name': None,
'title': 'Volkswagen Golf Plus 1.4 TSI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2011}
2026-03-30 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LX18680%27 HTTP/1.1" 200 None
2026-03-30 11:19:14 [auto1.es] INFO: Saving data for LX18680: {'auction_closing_time': 1774969992.0, 'created_time': 1773691578.172667, 'last_price_update_time': 1774869554.043021}
2026-03-30 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LX18680') HTTP/1.1" 204 0
2026-03-30 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F02%252F340215b9f18f806bddeb21e9179ec587%252Fpa%252FZU15820_886ccb4e806302c4eaebece640c54437.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_886ccb4e806302c4eaebece640c54437.jpg not downloaded yet
2026-03-30 11:19:14 [auto1.es] INFO: Found listing with ID: EG85848
2026-03-30 11:19:14 [auto1.es] INFO: Found listing with ID: WA83651
2026-03-30 11:19:14 [auto1.es] INFO: Found listing with ID: WL52368
2026-03-30 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WL52368%27 HTTP/1.1" 200 None
2026-03-30 11:19:14 [auto1.es] INFO: Scrape type for WL52368: 2
2026-03-30 11:19:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b492d3f8-02a5-508e-8b5b-0379fc7516b2 with identifier: WL52368
2026-03-30 11:19:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b492d3f8-02a5-508e-8b5b-0379fc7516b2 with scrape type 2
2026-03-30 11:19:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b492d3f8-02a5-508e-8b5b-0379fc7516b2 with scrape type 2
2026-03-30 11:19:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b492d3f8-02a5-508e-8b5b-0379fc7516b2, identifier: WL52368
2026-03-30 11:19:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b492d3f8-02a5-508e-8b5b-0379fc7516b2 with identifier: WL52368
2026-03-30 11:19:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b492d3f8-02a5-508e-8b5b-0379fc7516b2 with identifier: WL52368
2026-03-30 11:19:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b492d3f8-02a5-508e-8b5b-0379fc7516b2 with identifier: WL52368 to the API
2026-03-30 11:19:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:19:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:19:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-31T15:39:41Z',
'fuel_type': 'diesel',
'id': 'b492d3f8-02a5-508e-8b5b-0379fc7516b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL52368',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLB-Klasse',
'odometer': 99917,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-30',
'seller_name': None,
'title': 'Mercedes-Benz GLB-Klasse GLB 220 d 4Matic Progressive',
'transmission': 'automatic',
'trim': '4Matic Progressive',
'year': 2022}
2026-03-30 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WL52368%27 HTTP/1.1" 200 None
2026-03-30 11:19:14 [auto1.es] INFO: Saving data for WL52368: {'auction_closing_time': 1774971581.0, 'created_time': 1774642037.157907, 'last_price_update_time': 1774869554.560663}
2026-03-30 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WL52368') HTTP/1.1" 204 0
2026-03-30 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F02%252F340215b9f18f806bddeb21e9179ec587%252Fpa%252FZU15820_2cb2b8416dc7bfec3fe58e83a4305318.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_2cb2b8416dc7bfec3fe58e83a4305318.jpg not downloaded yet
2026-03-30 11:19:14 [auto1.es] INFO: Found listing with ID: BX88029
2026-03-30 11:19:14 [auto1.es] INFO: Found listing with ID: UZ66881
2026-03-30 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UZ66881%27 HTTP/1.1" 200 None
2026-03-30 11:19:14 [auto1.es] INFO: Scrape type for UZ66881: 2
2026-03-30 11:19:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f719be1-5e7e-5870-ad32-ee4f5ab65331 with identifier: UZ66881
2026-03-30 11:19:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f719be1-5e7e-5870-ad32-ee4f5ab65331 with scrape type 2
2026-03-30 11:19:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f719be1-5e7e-5870-ad32-ee4f5ab65331 with scrape type 2
2026-03-30 11:19:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3f719be1-5e7e-5870-ad32-ee4f5ab65331, identifier: UZ66881
2026-03-30 11:19:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3f719be1-5e7e-5870-ad32-ee4f5ab65331 with identifier: UZ66881
2026-03-30 11:19:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3f719be1-5e7e-5870-ad32-ee4f5ab65331 with identifier: UZ66881
2026-03-30 11:19:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3f719be1-5e7e-5870-ad32-ee4f5ab65331 with identifier: UZ66881 to the API
2026-03-30 11:19:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:19:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:19:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:45:53Z',
'fuel_type': 'diesel',
'id': '3f719be1-5e7e-5870-ad32-ee4f5ab65331',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ66881',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLB-Klasse',
'odometer': 77394,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-04',
'seller_name': None,
'title': 'Mercedes-Benz GLB-Klasse GLB 200 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2022}
2026-03-30 11:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UZ66881%27 HTTP/1.1" 200 None
2026-03-30 11:19:15 [auto1.es] INFO: Saving data for UZ66881: {'auction_closing_time': 1774971953.0, 'created_time': 1773130442.807556, 'last_price_update_time': 1774869555.093336}
2026-03-30 11:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UZ66881') HTTP/1.1" 204 0
2026-03-30 11:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F02%252F340215b9f18f806bddeb21e9179ec587%252Fpa%252FZU15820_3b08caeccb5646eaf681e333f80088fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_3b08caeccb5646eaf681e333f80088fb.jpg not downloaded yet
2026-03-30 11:19:15 [auto1.es] INFO: Found listing with ID: BL63813
2026-03-30 11:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BL63813%27 HTTP/1.1" 200 None
2026-03-30 11:19:15 [auto1.es] INFO: Scrape type for BL63813: 2
2026-03-30 11:19:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f7ec2c3-549e-5211-b583-f9e108e525bd with identifier: BL63813
2026-03-30 11:19:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f7ec2c3-549e-5211-b583-f9e108e525bd with scrape type 2
2026-03-30 11:19:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f7ec2c3-549e-5211-b583-f9e108e525bd with scrape type 2
2026-03-30 11:19:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7f7ec2c3-549e-5211-b583-f9e108e525bd, identifier: BL63813
2026-03-30 11:19:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7f7ec2c3-549e-5211-b583-f9e108e525bd with identifier: BL63813
2026-03-30 11:19:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7f7ec2c3-549e-5211-b583-f9e108e525bd with identifier: BL63813
2026-03-30 11:19:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7f7ec2c3-549e-5211-b583-f9e108e525bd with identifier: BL63813 to the API
2026-03-30 11:19:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:19:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:19:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 224,
'expiration_date': '2026-03-31T15:33:20Z',
'fuel_type': 'hybrid',
'id': '7f7ec2c3-549e-5211-b583-f9e108e525bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL63813',
'listing': 'auction',
'make': 'DS Automobiles',
'model': 'DS4',
'odometer': 9611,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-02-26',
'seller_name': None,
'title': 'DS Automobiles DS4 1.6 E-Tense Hybrid Performance Line',
'transmission': 'automatic',
'trim': 'Performance Line',
'year': 2024}
2026-03-30 11:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BL63813%27 HTTP/1.1" 200 None
2026-03-30 11:19:15 [auto1.es] INFO: Saving data for BL63813: {'auction_closing_time': 1774971200.0, 'created_time': 1773130593.758618, 'last_price_update_time': 1774869555.61327}
2026-03-30 11:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BL63813') HTTP/1.1" 204 0
2026-03-30 11:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F02%252F340215b9f18f806bddeb21e9179ec587%252Fpa%252FZU15820_6b05723abd857dc20fc563768578383e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_6b05723abd857dc20fc563768578383e.jpg not downloaded yet
2026-03-30 11:19:15 [auto1.es] INFO: Found listing with ID: TU33340
2026-03-30 11:19:15 [auto1.es] INFO: Found listing with ID: DV32133
2026-03-30 11:19:15 [auto1.es] INFO: Found listing with ID: ZE12212
2026-03-30 11:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZE12212%27 HTTP/1.1" 200 None
2026-03-30 11:19:15 [auto1.es] INFO: Scrape type for ZE12212: 1
2026-03-30 11:19:15 [auto1.es] INFO: Found listing with ID: RX15442
2026-03-30 11:19:15 [auto1.es] INFO: Found listing with ID: ER99924
2026-03-30 11:19:15 [auto1.es] INFO: Found listing with ID: KW14097
2026-03-30 11:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KW14097%27 HTTP/1.1" 200 None
2026-03-30 11:19:15 [auto1.es] INFO: Scrape type for KW14097: 2
2026-03-30 11:19:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f91f10fb-e694-5e41-b57a-e04caf11fa2f with identifier: KW14097
2026-03-30 11:19:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f91f10fb-e694-5e41-b57a-e04caf11fa2f with scrape type 2
2026-03-30 11:19:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f91f10fb-e694-5e41-b57a-e04caf11fa2f with scrape type 2
2026-03-30 11:19:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f91f10fb-e694-5e41-b57a-e04caf11fa2f, identifier: KW14097
2026-03-30 11:19:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f91f10fb-e694-5e41-b57a-e04caf11fa2f with identifier: KW14097
2026-03-30 11:19:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f91f10fb-e694-5e41-b57a-e04caf11fa2f with identifier: KW14097
2026-03-30 11:19:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f91f10fb-e694-5e41-b57a-e04caf11fa2f with identifier: KW14097 to the API
2026-03-30 11:19:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:19:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:19:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:57:28Z',
'fuel_type': 'petrol',
'id': 'f91f10fb-e694-5e41-b57a-e04caf11fa2f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW14097',
'listing': 'auction',
'make': 'Kia',
'model': 'XCeed',
'odometer': 25308,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-13',
'seller_name': None,
'title': 'Kia XCeed 1.5 TGDI Mild-Hybrid Tech',
'transmission': 'automatic',
'trim': 'Tech',
'year': 2023}
2026-03-30 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KW14097%27 HTTP/1.1" 200 None
2026-03-30 11:19:16 [auto1.es] INFO: Saving data for KW14097: {'auction_closing_time': 1774972648.0, 'created_time': 1773130900.801868, 'last_price_update_time': 1774869556.522162}
2026-03-30 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KW14097') HTTP/1.1" 204 0
2026-03-30 11:19:16 [auto1.es] INFO: Found listing with ID: VE04719
2026-03-30 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VE04719%27 HTTP/1.1" 200 None
2026-03-30 11:19:16 [auto1.es] INFO: Scrape type for VE04719: 2
2026-03-30 11:19:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d49f5c77-59d6-519a-ae1b-52e51ef55b19 with identifier: VE04719
2026-03-30 11:19:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d49f5c77-59d6-519a-ae1b-52e51ef55b19 with scrape type 2
2026-03-30 11:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d49f5c77-59d6-519a-ae1b-52e51ef55b19 with scrape type 2
2026-03-30 11:19:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d49f5c77-59d6-519a-ae1b-52e51ef55b19, identifier: VE04719
2026-03-30 11:19:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d49f5c77-59d6-519a-ae1b-52e51ef55b19 with identifier: VE04719
2026-03-30 11:19:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d49f5c77-59d6-519a-ae1b-52e51ef55b19 with identifier: VE04719
2026-03-30 11:19:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d49f5c77-59d6-519a-ae1b-52e51ef55b19 with identifier: VE04719 to the API
2026-03-30 11:19:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:19:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 408,
'expiration_date': '2026-03-31T15:39:41Z',
'fuel_type': 'hybrid',
'id': 'd49f5c77-59d6-519a-ae1b-52e51ef55b19',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE04719',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 245757,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-27',
'seller_name': None,
'title': 'Volvo XC60 2.0 T6 Plug-in Hybrid Inscription AWD',
'transmission': 'automatic',
'trim': 'Inscription AWD',
'year': 2018}
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VE04719%27 HTTP/1.1" 200 None
2026-03-30 11:19:17 [auto1.es] INFO: Saving data for VE04719: {'auction_closing_time': 1774971581.0, 'created_time': 1773501298.39607, 'last_price_update_time': 1774869557.160747}
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VE04719') HTTP/1.1" 204 0
2026-03-30 11:19:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BN28456> (referer: https://www.auto1.com/v1/car-details-view/BN28456/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:19:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:19:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85f3c0c4-1bcf-57a4-a074-d6d0241115b1 with identifier: BN28456
2026-03-30 11:19:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85f3c0c4-1bcf-57a4-a074-d6d0241115b1 with scrape type 1
2026-03-30 11:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 85f3c0c4-1bcf-57a4-a074-d6d0241115b1
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F26%252Fb5260ac92663e8d98f2b2ca8b8c9f43e%252Fpa%252FBN28456_ca3037ef9e83ba850821f28bec25b804.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/26/b5260ac92663e8d98f2b2ca8b8c9f43e/pa/BN28456_ca3037ef9e83ba850821f28bec25b804.jpg not downloaded yet
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F26%252Fb5260ac92663e8d98f2b2ca8b8c9f43e%252Fpa%252FBN28456_7fac7a1e61f79cf6aa307502738beed5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/26/b5260ac92663e8d98f2b2ca8b8c9f43e/pa/BN28456_7fac7a1e61f79cf6aa307502738beed5.jpg already downloaded
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F26%252Fb5260ac92663e8d98f2b2ca8b8c9f43e%252Fpa%252FBN28456_79771acb4980d42d3530a269e975e2c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/26/b5260ac92663e8d98f2b2ca8b8c9f43e/pa/BN28456_79771acb4980d42d3530a269e975e2c4.jpg already downloaded
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F26%252Fb5260ac92663e8d98f2b2ca8b8c9f43e%252Fpa%252FBN28456_0d9fe8eb7462a548fb0622555e3c61ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/26/b5260ac92663e8d98f2b2ca8b8c9f43e/pa/BN28456_0d9fe8eb7462a548fb0622555e3c61ce.jpg not downloaded yet
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F26%252Fb5260ac92663e8d98f2b2ca8b8c9f43e%252Fpa%252FBN28456_94d40fcaf9e97a99adced6d1893394ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/26/b5260ac92663e8d98f2b2ca8b8c9f43e/pa/BN28456_94d40fcaf9e97a99adced6d1893394ce.jpg not downloaded yet
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F26%252Fb5260ac92663e8d98f2b2ca8b8c9f43e%252Fpa%252FBN28456_8abfd75dac1226b95771c07991a052bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/26/b5260ac92663e8d98f2b2ca8b8c9f43e/pa/BN28456_8abfd75dac1226b95771c07991a052bb.jpg not downloaded yet
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F26%252Fb5260ac92663e8d98f2b2ca8b8c9f43e%252Fpa%252FBN28456_51d399c6711bfb955677ef6d441def2e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/26/b5260ac92663e8d98f2b2ca8b8c9f43e/pa/BN28456_51d399c6711bfb955677ef6d441def2e.jpg not downloaded yet
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F26%252Fb5260ac92663e8d98f2b2ca8b8c9f43e%252Fpa%252FBN28456_8b2eee191b25ffa8a0b51de4dd0ac5f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/26/b5260ac92663e8d98f2b2ca8b8c9f43e/pa/BN28456_8b2eee191b25ffa8a0b51de4dd0ac5f4.jpg not downloaded yet
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F26%252Fb5260ac92663e8d98f2b2ca8b8c9f43e%252Fpa%252FBN28456_955ade22c90f33af6abe781477d1148f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/26/b5260ac92663e8d98f2b2ca8b8c9f43e/pa/BN28456_955ade22c90f33af6abe781477d1148f.jpg not downloaded yet
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F26%252Fb5260ac92663e8d98f2b2ca8b8c9f43e%252Fpa%252FBN28456_5a585c9e632e973a299e4cffd406b2c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/26/b5260ac92663e8d98f2b2ca8b8c9f43e/pa/BN28456_5a585c9e632e973a299e4cffd406b2c3.jpg not downloaded yet
2026-03-30 11:19:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CY31479> (referer: https://www.auto1.com/v1/car-details-view/CY31479/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:19:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:19:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36b92630-d956-5c4b-9689-c654c65d18e5 with identifier: CY31479
2026-03-30 11:19:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36b92630-d956-5c4b-9689-c654c65d18e5 with scrape type 1
2026-03-30 11:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 36b92630-d956-5c4b-9689-c654c65d18e5
2026-03-30 11:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F77%252F8f7768472e9b519a5905b41cacdf07d4%252Fpa%252FCY31479_16bc058609491da2444b639e679de8e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/77/8f7768472e9b519a5905b41cacdf07d4/pa/CY31479_16bc058609491da2444b639e679de8e9.jpg not downloaded yet
2026-03-30 11:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F77%252F8f7768472e9b519a5905b41cacdf07d4%252Fpa%252FCY31479_24971cf091e140069227a4e6cdebcf29.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/77/8f7768472e9b519a5905b41cacdf07d4/pa/CY31479_24971cf091e140069227a4e6cdebcf29.jpg not downloaded yet
2026-03-30 11:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F77%252F8f7768472e9b519a5905b41cacdf07d4%252Fpa%252FCY31479_176bc46e54e7382e0871c0ec4bcd9d71.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/77/8f7768472e9b519a5905b41cacdf07d4/pa/CY31479_176bc46e54e7382e0871c0ec4bcd9d71.jpg not downloaded yet
2026-03-30 11:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F77%252F8f7768472e9b519a5905b41cacdf07d4%252Fpa%252FCY31479_943e07c8b66aedce4f6692da4fc88a2f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/77/8f7768472e9b519a5905b41cacdf07d4/pa/CY31479_943e07c8b66aedce4f6692da4fc88a2f.jpg not downloaded yet
2026-03-30 11:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F77%252F8f7768472e9b519a5905b41cacdf07d4%252Fpa%252FCY31479_6969371066a620d97e3f4901782e6832.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/77/8f7768472e9b519a5905b41cacdf07d4/pa/CY31479_6969371066a620d97e3f4901782e6832.jpg not downloaded yet
2026-03-30 11:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F77%252F8f7768472e9b519a5905b41cacdf07d4%252Fpa%252FCY31479_004b05c542609226d0118f3c6e9a46b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/77/8f7768472e9b519a5905b41cacdf07d4/pa/CY31479_004b05c542609226d0118f3c6e9a46b7.jpg not downloaded yet
2026-03-30 11:19:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/26/b5260ac92663e8d98f2b2ca8b8c9f43e/pa/BN28456_5a585c9e632e973a299e4cffd406b2c3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a468f90>
2026-03-30 11:19:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85f3c0c4-1bcf-57a4-a074-d6d0241115b1/85f3c0c4-1bcf-57a4-a074-d6d0241115b1_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F26%252Fb5260ac92663e8d98f2b2ca8b8c9f43e%252Fpa%252FBN28456_5a585c9e632e973a299e4cffd406b2c3.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/26/b5260ac92663e8d98f2b2ca8b8c9f43e/pa/BN28456_5a585c9e632e973a299e4cffd406b2c3.jpg saved to cache
2026-03-30 11:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 85f3c0c4-1bcf-57a4-a074-d6d0241115b1
2026-03-30 11:19:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/77/8f7768472e9b519a5905b41cacdf07d4/pa/CY31479_6969371066a620d97e3f4901782e6832.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05aee33d0>
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36b92630-d956-5c4b-9689-c654c65d18e5/36b92630-d956-5c4b-9689-c654c65d18e5_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F77%252F8f7768472e9b519a5905b41cacdf07d4%252Fpa%252FCY31479_6969371066a620d97e3f4901782e6832.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/77/8f7768472e9b519a5905b41cacdf07d4/pa/CY31479_6969371066a620d97e3f4901782e6832.jpg saved to cache
2026-03-30 11:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 36b92630-d956-5c4b-9689-c654c65d18e5
2026-03-30 11:19:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/77/8f7768472e9b519a5905b41cacdf07d4/pa/CY31479_004b05c542609226d0118f3c6e9a46b7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4a6390>
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36b92630-d956-5c4b-9689-c654c65d18e5/36b92630-d956-5c4b-9689-c654c65d18e5_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F77%252F8f7768472e9b519a5905b41cacdf07d4%252Fpa%252FCY31479_004b05c542609226d0118f3c6e9a46b7.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/77/8f7768472e9b519a5905b41cacdf07d4/pa/CY31479_004b05c542609226d0118f3c6e9a46b7.jpg saved to cache
2026-03-30 11:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 36b92630-d956-5c4b-9689-c654c65d18e5
2026-03-30 11:19:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/77/8f7768472e9b519a5905b41cacdf07d4/pa/CY31479_943e07c8b66aedce4f6692da4fc88a2f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/77/8f7768472e9b519a5905b41cacdf07d4/pa/CY31479_176bc46e54e7382e0871c0ec4bcd9d71.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a462190>
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36b92630-d956-5c4b-9689-c654c65d18e5/36b92630-d956-5c4b-9689-c654c65d18e5_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F77%252F8f7768472e9b519a5905b41cacdf07d4%252Fpa%252FCY31479_943e07c8b66aedce4f6692da4fc88a2f.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/77/8f7768472e9b519a5905b41cacdf07d4/pa/CY31479_943e07c8b66aedce4f6692da4fc88a2f.jpg saved to cache
2026-03-30 11:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 36b92630-d956-5c4b-9689-c654c65d18e5
2026-03-30 11:19:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/77/8f7768472e9b519a5905b41cacdf07d4/pa/CY31479_24971cf091e140069227a4e6cdebcf29.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a463010>
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36b92630-d956-5c4b-9689-c654c65d18e5/36b92630-d956-5c4b-9689-c654c65d18e5_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F77%252F8f7768472e9b519a5905b41cacdf07d4%252Fpa%252FCY31479_176bc46e54e7382e0871c0ec4bcd9d71.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/77/8f7768472e9b519a5905b41cacdf07d4/pa/CY31479_176bc46e54e7382e0871c0ec4bcd9d71.jpg saved to cache
2026-03-30 11:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 36b92630-d956-5c4b-9689-c654c65d18e5
2026-03-30 11:19:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/77/8f7768472e9b519a5905b41cacdf07d4/pa/CY31479_16bc058609491da2444b639e679de8e9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4a7590>
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36b92630-d956-5c4b-9689-c654c65d18e5/36b92630-d956-5c4b-9689-c654c65d18e5_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F77%252F8f7768472e9b519a5905b41cacdf07d4%252Fpa%252FCY31479_24971cf091e140069227a4e6cdebcf29.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/77/8f7768472e9b519a5905b41cacdf07d4/pa/CY31479_24971cf091e140069227a4e6cdebcf29.jpg saved to cache
2026-03-30 11:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 36b92630-d956-5c4b-9689-c654c65d18e5
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4b6310>
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36b92630-d956-5c4b-9689-c654c65d18e5/36b92630-d956-5c4b-9689-c654c65d18e5_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F77%252F8f7768472e9b519a5905b41cacdf07d4%252Fpa%252FCY31479_16bc058609491da2444b639e679de8e9.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/77/8f7768472e9b519a5905b41cacdf07d4/pa/CY31479_16bc058609491da2444b639e679de8e9.jpg saved to cache
2026-03-30 11:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36b92630-d956-5c4b-9689-c654c65d18e5
2026-03-30 11:19:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36b92630-d956-5c4b-9689-c654c65d18e5, skipping ID generation
2026-03-30 11:19:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36b92630-d956-5c4b-9689-c654c65d18e5 with scrape type 1
2026-03-30 11:19:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36b92630-d956-5c4b-9689-c654c65d18e5 sending to next pipeline
2026-03-30 11:19:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 36b92630-d956-5c4b-9689-c654c65d18e5, identifier: CY31479
2026-03-30 11:19:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 36b92630-d956-5c4b-9689-c654c65d18e5 with identifier: CY31479
2026-03-30 11:19:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 36b92630-d956-5c4b-9689-c654c65d18e5 with identifier: CY31479
2026-03-30 11:19:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 36b92630-d956-5c4b-9689-c654c65d18e5 with identifier: CY31479 to the API
2026-03-30 11:19:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:19:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:19:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8f/77/8f7768472e9b519a5905b41cacdf07d4/pa/CY31479_16bc058609491da2444b639e679de8e9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.4L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:52:50Z',
'fuel_type': 'petrol',
'id': '36b92630-d956-5c4b-9689-c654c65d18e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY31479',
'listing': 'auction',
'location': 'ES, Sevilla',
'make': 'Fiat',
'model': 'Bravo',
'odometer': 226201,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36b92630-d956-5c4b-9689-c654c65d18e5/36b92630-d956-5c4b-9689-c654c65d18e5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86666,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/77/8f7768472e9b519a5905b41cacdf07d4/pa/CY31479_16bc058609491da2444b639e679de8e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36b92630-d956-5c4b-9689-c654c65d18e5/36b92630-d956-5c4b-9689-c654c65d18e5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87425,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/77/8f7768472e9b519a5905b41cacdf07d4/pa/CY31479_24971cf091e140069227a4e6cdebcf29.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36b92630-d956-5c4b-9689-c654c65d18e5/36b92630-d956-5c4b-9689-c654c65d18e5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68385,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/77/8f7768472e9b519a5905b41cacdf07d4/pa/CY31479_176bc46e54e7382e0871c0ec4bcd9d71.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36b92630-d956-5c4b-9689-c654c65d18e5/36b92630-d956-5c4b-9689-c654c65d18e5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78161,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/77/8f7768472e9b519a5905b41cacdf07d4/pa/CY31479_943e07c8b66aedce4f6692da4fc88a2f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36b92630-d956-5c4b-9689-c654c65d18e5/36b92630-d956-5c4b-9689-c654c65d18e5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66865,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/77/8f7768472e9b519a5905b41cacdf07d4/pa/CY31479_6969371066a620d97e3f4901782e6832.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36b92630-d956-5c4b-9689-c654c65d18e5/36b92630-d956-5c4b-9689-c654c65d18e5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 135324,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/77/8f7768472e9b519a5905b41cacdf07d4/pa/CY31479_004b05c542609226d0118f3c6e9a46b7.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2008-06-30',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat Bravo 1.4 Turbo T JET Emotion',
'transmission': 'manual',
'trim': 'T JET Emotion',
'year': 2008}
2026-03-30 11:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CY31479%27 HTTP/1.1" 200 None
2026-03-30 11:19:39 [auto1.es] INFO: Saving data for CY31479: {'created_time': 1774869579.795826, 'last_price_update_time': 1774869579.795839, 'auction_closing_time': 1774972370.0}
2026-03-30 11:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CY31479') HTTP/1.1" 204 0
2026-03-30 11:19:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/26/b5260ac92663e8d98f2b2ca8b8c9f43e/pa/BN28456_955ade22c90f33af6abe781477d1148f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FW49739/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:19:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:19:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a48ce50>
2026-03-30 11:19:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85f3c0c4-1bcf-57a4-a074-d6d0241115b1/85f3c0c4-1bcf-57a4-a074-d6d0241115b1_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F26%252Fb5260ac92663e8d98f2b2ca8b8c9f43e%252Fpa%252FBN28456_955ade22c90f33af6abe781477d1148f.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/26/b5260ac92663e8d98f2b2ca8b8c9f43e/pa/BN28456_955ade22c90f33af6abe781477d1148f.jpg saved to cache
2026-03-30 11:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 85f3c0c4-1bcf-57a4-a074-d6d0241115b1
2026-03-30 11:19:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/26/b5260ac92663e8d98f2b2ca8b8c9f43e/pa/BN28456_51d399c6711bfb955677ef6d441def2e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/26/b5260ac92663e8d98f2b2ca8b8c9f43e/pa/BN28456_8b2eee191b25ffa8a0b51de4dd0ac5f4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a46b950>
2026-03-30 11:19:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85f3c0c4-1bcf-57a4-a074-d6d0241115b1/85f3c0c4-1bcf-57a4-a074-d6d0241115b1_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F26%252Fb5260ac92663e8d98f2b2ca8b8c9f43e%252Fpa%252FBN28456_51d399c6711bfb955677ef6d441def2e.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/26/b5260ac92663e8d98f2b2ca8b8c9f43e/pa/BN28456_51d399c6711bfb955677ef6d441def2e.jpg saved to cache
2026-03-30 11:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 85f3c0c4-1bcf-57a4-a074-d6d0241115b1
2026-03-30 11:19:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4d5550>
2026-03-30 11:19:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85f3c0c4-1bcf-57a4-a074-d6d0241115b1/85f3c0c4-1bcf-57a4-a074-d6d0241115b1_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F26%252Fb5260ac92663e8d98f2b2ca8b8c9f43e%252Fpa%252FBN28456_8b2eee191b25ffa8a0b51de4dd0ac5f4.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/26/b5260ac92663e8d98f2b2ca8b8c9f43e/pa/BN28456_8b2eee191b25ffa8a0b51de4dd0ac5f4.jpg saved to cache
2026-03-30 11:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 85f3c0c4-1bcf-57a4-a074-d6d0241115b1
2026-03-30 11:19:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/26/b5260ac92663e8d98f2b2ca8b8c9f43e/pa/BN28456_8abfd75dac1226b95771c07991a052bb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a364550>
2026-03-30 11:19:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85f3c0c4-1bcf-57a4-a074-d6d0241115b1/85f3c0c4-1bcf-57a4-a074-d6d0241115b1_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F26%252Fb5260ac92663e8d98f2b2ca8b8c9f43e%252Fpa%252FBN28456_8abfd75dac1226b95771c07991a052bb.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/26/b5260ac92663e8d98f2b2ca8b8c9f43e/pa/BN28456_8abfd75dac1226b95771c07991a052bb.jpg saved to cache
2026-03-30 11:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 85f3c0c4-1bcf-57a4-a074-d6d0241115b1
2026-03-30 11:19:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/26/b5260ac92663e8d98f2b2ca8b8c9f43e/pa/BN28456_94d40fcaf9e97a99adced6d1893394ce.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ae94a10>
2026-03-30 11:19:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85f3c0c4-1bcf-57a4-a074-d6d0241115b1/85f3c0c4-1bcf-57a4-a074-d6d0241115b1_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F26%252Fb5260ac92663e8d98f2b2ca8b8c9f43e%252Fpa%252FBN28456_94d40fcaf9e97a99adced6d1893394ce.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/26/b5260ac92663e8d98f2b2ca8b8c9f43e/pa/BN28456_94d40fcaf9e97a99adced6d1893394ce.jpg saved to cache
2026-03-30 11:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 85f3c0c4-1bcf-57a4-a074-d6d0241115b1
2026-03-30 11:19:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/26/b5260ac92663e8d98f2b2ca8b8c9f43e/pa/BN28456_0d9fe8eb7462a548fb0622555e3c61ce.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/26/b5260ac92663e8d98f2b2ca8b8c9f43e/pa/BN28456_ca3037ef9e83ba850821f28bec25b804.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad6d1d0>
2026-03-30 11:19:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85f3c0c4-1bcf-57a4-a074-d6d0241115b1/85f3c0c4-1bcf-57a4-a074-d6d0241115b1_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F26%252Fb5260ac92663e8d98f2b2ca8b8c9f43e%252Fpa%252FBN28456_0d9fe8eb7462a548fb0622555e3c61ce.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/26/b5260ac92663e8d98f2b2ca8b8c9f43e/pa/BN28456_0d9fe8eb7462a548fb0622555e3c61ce.jpg saved to cache
2026-03-30 11:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 85f3c0c4-1bcf-57a4-a074-d6d0241115b1
2026-03-30 11:19:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VR33132/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:19:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:19:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3aa810>
2026-03-30 11:19:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85f3c0c4-1bcf-57a4-a074-d6d0241115b1/85f3c0c4-1bcf-57a4-a074-d6d0241115b1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F26%252Fb5260ac92663e8d98f2b2ca8b8c9f43e%252Fpa%252FBN28456_ca3037ef9e83ba850821f28bec25b804.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/26/b5260ac92663e8d98f2b2ca8b8c9f43e/pa/BN28456_ca3037ef9e83ba850821f28bec25b804.jpg saved to cache
2026-03-30 11:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 85f3c0c4-1bcf-57a4-a074-d6d0241115b1
2026-03-30 11:19:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 85f3c0c4-1bcf-57a4-a074-d6d0241115b1, skipping ID generation
2026-03-30 11:19:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85f3c0c4-1bcf-57a4-a074-d6d0241115b1 with scrape type 1
2026-03-30 11:19:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 85f3c0c4-1bcf-57a4-a074-d6d0241115b1 sending to next pipeline
2026-03-30 11:19:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 85f3c0c4-1bcf-57a4-a074-d6d0241115b1, identifier: BN28456
2026-03-30 11:19:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 85f3c0c4-1bcf-57a4-a074-d6d0241115b1 with identifier: BN28456
2026-03-30 11:19:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 85f3c0c4-1bcf-57a4-a074-d6d0241115b1 with identifier: BN28456
2026-03-30 11:19:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 85f3c0c4-1bcf-57a4-a074-d6d0241115b1 with identifier: BN28456 to the API
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:19:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb5/26/b5260ac92663e8d98f2b2ca8b8c9f43e/pa/BN28456_ca3037ef9e83ba850821f28bec25b804.jpg>
{'auction_title': '',
'c_o_2_emission_value': 174,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.2L',
'engine_horse_power': 200,
'expiration_date': '2026-03-31T15:26:17Z',
'fuel_type': 'diesel',
'id': '85f3c0c4-1bcf-57a4-a074-d6d0241115b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN28456',
'listing': 'auction',
'location': 'ES, El Prat de Llobregat (Barcelona)',
'make': 'Kia',
'model': 'Sorento',
'odometer': 144184,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85f3c0c4-1bcf-57a4-a074-d6d0241115b1/85f3c0c4-1bcf-57a4-a074-d6d0241115b1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 125570,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/26/b5260ac92663e8d98f2b2ca8b8c9f43e/pa/BN28456_ca3037ef9e83ba850821f28bec25b804.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85f3c0c4-1bcf-57a4-a074-d6d0241115b1/85f3c0c4-1bcf-57a4-a074-d6d0241115b1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117335,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/26/b5260ac92663e8d98f2b2ca8b8c9f43e/pa/BN28456_7fac7a1e61f79cf6aa307502738beed5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85f3c0c4-1bcf-57a4-a074-d6d0241115b1/85f3c0c4-1bcf-57a4-a074-d6d0241115b1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105634,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/26/b5260ac92663e8d98f2b2ca8b8c9f43e/pa/BN28456_79771acb4980d42d3530a269e975e2c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85f3c0c4-1bcf-57a4-a074-d6d0241115b1/85f3c0c4-1bcf-57a4-a074-d6d0241115b1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93498,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/26/b5260ac92663e8d98f2b2ca8b8c9f43e/pa/BN28456_0d9fe8eb7462a548fb0622555e3c61ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85f3c0c4-1bcf-57a4-a074-d6d0241115b1/85f3c0c4-1bcf-57a4-a074-d6d0241115b1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96773,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/26/b5260ac92663e8d98f2b2ca8b8c9f43e/pa/BN28456_94d40fcaf9e97a99adced6d1893394ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85f3c0c4-1bcf-57a4-a074-d6d0241115b1/85f3c0c4-1bcf-57a4-a074-d6d0241115b1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89384,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/26/b5260ac92663e8d98f2b2ca8b8c9f43e/pa/BN28456_8abfd75dac1226b95771c07991a052bb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85f3c0c4-1bcf-57a4-a074-d6d0241115b1/85f3c0c4-1bcf-57a4-a074-d6d0241115b1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73264,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/26/b5260ac92663e8d98f2b2ca8b8c9f43e/pa/BN28456_51d399c6711bfb955677ef6d441def2e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85f3c0c4-1bcf-57a4-a074-d6d0241115b1/85f3c0c4-1bcf-57a4-a074-d6d0241115b1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109876,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/26/b5260ac92663e8d98f2b2ca8b8c9f43e/pa/BN28456_8b2eee191b25ffa8a0b51de4dd0ac5f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85f3c0c4-1bcf-57a4-a074-d6d0241115b1/85f3c0c4-1bcf-57a4-a074-d6d0241115b1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106419,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/26/b5260ac92663e8d98f2b2ca8b8c9f43e/pa/BN28456_955ade22c90f33af6abe781477d1148f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85f3c0c4-1bcf-57a4-a074-d6d0241115b1/85f3c0c4-1bcf-57a4-a074-d6d0241115b1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83843,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/26/b5260ac92663e8d98f2b2ca8b8c9f43e/pa/BN28456_5a585c9e632e973a299e4cffd406b2c3.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-08-02',
'seats_number': 7,
'seller_name': None,
'title': 'Kia Sorento 2.2 CRDi x-Tech 4WD',
'transmission': 'automatic',
'trim': 'x-Tech 4WD',
'year': 2017}
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BN28456%27 HTTP/1.1" 200 None
2026-03-30 11:19:41 [auto1.es] INFO: Saving data for BN28456: {'created_time': 1774869581.446983, 'last_price_update_time': 1774869581.446996, 'auction_closing_time': 1774970777.0}
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BN28456') HTTP/1.1" 204 0
2026-03-30 11:19:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_6b05723abd857dc20fc563768578383e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_3b08caeccb5646eaf681e333f80088fb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4d5810>
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55c527b0-6d02-59cb-aad4-e4034acfa757/55c527b0-6d02-59cb-aad4-e4034acfa757_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F02%252F340215b9f18f806bddeb21e9179ec587%252Fpa%252FZU15820_6b05723abd857dc20fc563768578383e.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_6b05723abd857dc20fc563768578383e.jpg saved to cache
2026-03-30 11:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 55c527b0-6d02-59cb-aad4-e4034acfa757
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a32c110>
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55c527b0-6d02-59cb-aad4-e4034acfa757/55c527b0-6d02-59cb-aad4-e4034acfa757_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F02%252F340215b9f18f806bddeb21e9179ec587%252Fpa%252FZU15820_3b08caeccb5646eaf681e333f80088fb.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_3b08caeccb5646eaf681e333f80088fb.jpg saved to cache
2026-03-30 11:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 55c527b0-6d02-59cb-aad4-e4034acfa757
2026-03-30 11:19:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_886ccb4e806302c4eaebece640c54437.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_2cb2b8416dc7bfec3fe58e83a4305318.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3c8bd0>
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55c527b0-6d02-59cb-aad4-e4034acfa757/55c527b0-6d02-59cb-aad4-e4034acfa757_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F02%252F340215b9f18f806bddeb21e9179ec587%252Fpa%252FZU15820_886ccb4e806302c4eaebece640c54437.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_886ccb4e806302c4eaebece640c54437.jpg saved to cache
2026-03-30 11:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 55c527b0-6d02-59cb-aad4-e4034acfa757
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ae72110>
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55c527b0-6d02-59cb-aad4-e4034acfa757/55c527b0-6d02-59cb-aad4-e4034acfa757_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F02%252F340215b9f18f806bddeb21e9179ec587%252Fpa%252FZU15820_2cb2b8416dc7bfec3fe58e83a4305318.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_2cb2b8416dc7bfec3fe58e83a4305318.jpg saved to cache
2026-03-30 11:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 55c527b0-6d02-59cb-aad4-e4034acfa757
2026-03-30 11:19:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_15e543e5eb2cc81ce46f8e8eae84dabc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3cb2d0>
2026-03-30 11:19:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55c527b0-6d02-59cb-aad4-e4034acfa757/55c527b0-6d02-59cb-aad4-e4034acfa757_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F02%252F340215b9f18f806bddeb21e9179ec587%252Fpa%252FZU15820_15e543e5eb2cc81ce46f8e8eae84dabc.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_15e543e5eb2cc81ce46f8e8eae84dabc.jpg saved to cache
2026-03-30 11:19:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 55c527b0-6d02-59cb-aad4-e4034acfa757
2026-03-30 11:19:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_1a83981d50ad65cba3a89329c9ab38c2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_0959eb0b48d162739fc46e49af8cf929.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a482ed0>
2026-03-30 11:19:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55c527b0-6d02-59cb-aad4-e4034acfa757/55c527b0-6d02-59cb-aad4-e4034acfa757_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F02%252F340215b9f18f806bddeb21e9179ec587%252Fpa%252FZU15820_1a83981d50ad65cba3a89329c9ab38c2.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_1a83981d50ad65cba3a89329c9ab38c2.jpg saved to cache
2026-03-30 11:19:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 55c527b0-6d02-59cb-aad4-e4034acfa757
2026-03-30 11:19:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_2d8ccafca82c189cd71c39290b5c01b2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4fa4d0>
2026-03-30 11:19:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55c527b0-6d02-59cb-aad4-e4034acfa757/55c527b0-6d02-59cb-aad4-e4034acfa757_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F02%252F340215b9f18f806bddeb21e9179ec587%252Fpa%252FZU15820_0959eb0b48d162739fc46e49af8cf929.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_0959eb0b48d162739fc46e49af8cf929.jpg saved to cache
2026-03-30 11:19:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 55c527b0-6d02-59cb-aad4-e4034acfa757
2026-03-30 11:19:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3cbbd0>
2026-03-30 11:19:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55c527b0-6d02-59cb-aad4-e4034acfa757/55c527b0-6d02-59cb-aad4-e4034acfa757_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F02%252F340215b9f18f806bddeb21e9179ec587%252Fpa%252FZU15820_2d8ccafca82c189cd71c39290b5c01b2.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_2d8ccafca82c189cd71c39290b5c01b2.jpg saved to cache
2026-03-30 11:19:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 55c527b0-6d02-59cb-aad4-e4034acfa757
2026-03-30 11:19:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JU92139/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:19:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:19:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_d7c9312ef8d27609eecb4fce5e47f8dc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_f66b6ba1b5643c9ee2921afe63f1ddbd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a464b10>
2026-03-30 11:19:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55c527b0-6d02-59cb-aad4-e4034acfa757/55c527b0-6d02-59cb-aad4-e4034acfa757_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F02%252F340215b9f18f806bddeb21e9179ec587%252Fpa%252FZU15820_d7c9312ef8d27609eecb4fce5e47f8dc.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_d7c9312ef8d27609eecb4fce5e47f8dc.jpg saved to cache
2026-03-30 11:19:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 55c527b0-6d02-59cb-aad4-e4034acfa757
2026-03-30 11:19:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad6f550>
2026-03-30 11:19:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55c527b0-6d02-59cb-aad4-e4034acfa757/55c527b0-6d02-59cb-aad4-e4034acfa757_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F02%252F340215b9f18f806bddeb21e9179ec587%252Fpa%252FZU15820_f66b6ba1b5643c9ee2921afe63f1ddbd.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_f66b6ba1b5643c9ee2921afe63f1ddbd.jpg saved to cache
2026-03-30 11:19:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 55c527b0-6d02-59cb-aad4-e4034acfa757
2026-03-30 11:19:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 55c527b0-6d02-59cb-aad4-e4034acfa757, skipping ID generation
2026-03-30 11:19:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55c527b0-6d02-59cb-aad4-e4034acfa757 with scrape type 1
2026-03-30 11:19:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 55c527b0-6d02-59cb-aad4-e4034acfa757 sending to next pipeline
2026-03-30 11:19:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 55c527b0-6d02-59cb-aad4-e4034acfa757, identifier: ZU15820
2026-03-30 11:19:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 55c527b0-6d02-59cb-aad4-e4034acfa757 with identifier: ZU15820
2026-03-30 11:19:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 55c527b0-6d02-59cb-aad4-e4034acfa757 with identifier: ZU15820
2026-03-30 11:19:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 55c527b0-6d02-59cb-aad4-e4034acfa757 with identifier: ZU15820 to the API
2026-03-30 11:19:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:19:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:19:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_f66b6ba1b5643c9ee2921afe63f1ddbd.jpg>
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 143,
'expiration_date': '2026-03-31T15:57:27Z',
'fuel_type': 'diesel',
'id': '55c527b0-6d02-59cb-aad4-e4034acfa757',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU15820',
'listing': 'auction',
'location': 'ES, Girona',
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 292895,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55c527b0-6d02-59cb-aad4-e4034acfa757/55c527b0-6d02-59cb-aad4-e4034acfa757_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102669,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_f66b6ba1b5643c9ee2921afe63f1ddbd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55c527b0-6d02-59cb-aad4-e4034acfa757/55c527b0-6d02-59cb-aad4-e4034acfa757_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81671,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_d7c9312ef8d27609eecb4fce5e47f8dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55c527b0-6d02-59cb-aad4-e4034acfa757/55c527b0-6d02-59cb-aad4-e4034acfa757_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84407,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_2d8ccafca82c189cd71c39290b5c01b2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55c527b0-6d02-59cb-aad4-e4034acfa757/55c527b0-6d02-59cb-aad4-e4034acfa757_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67640,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_0959eb0b48d162739fc46e49af8cf929.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55c527b0-6d02-59cb-aad4-e4034acfa757/55c527b0-6d02-59cb-aad4-e4034acfa757_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77043,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_1a83981d50ad65cba3a89329c9ab38c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55c527b0-6d02-59cb-aad4-e4034acfa757/55c527b0-6d02-59cb-aad4-e4034acfa757_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81035,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_15e543e5eb2cc81ce46f8e8eae84dabc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55c527b0-6d02-59cb-aad4-e4034acfa757/55c527b0-6d02-59cb-aad4-e4034acfa757_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57968,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_886ccb4e806302c4eaebece640c54437.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55c527b0-6d02-59cb-aad4-e4034acfa757/55c527b0-6d02-59cb-aad4-e4034acfa757_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81423,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_2cb2b8416dc7bfec3fe58e83a4305318.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55c527b0-6d02-59cb-aad4-e4034acfa757/55c527b0-6d02-59cb-aad4-e4034acfa757_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93501,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_3b08caeccb5646eaf681e333f80088fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55c527b0-6d02-59cb-aad4-e4034acfa757/55c527b0-6d02-59cb-aad4-e4034acfa757_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82095,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/02/340215b9f18f806bddeb21e9179ec587/pa/ZU15820_6b05723abd857dc20fc563768578383e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-08-25',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota RAV 4 2.0 D-4D Advance',
'transmission': 'manual',
'trim': 'Advance',
'year': 2016}
2026-03-30 11:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZU15820%27 HTTP/1.1" 200 None
2026-03-30 11:19:45 [auto1.es] INFO: Saving data for ZU15820: {'created_time': 1774869585.0724, 'last_price_update_time': 1774869585.072412, 'auction_closing_time': 1774972647.0}
2026-03-30 11:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZU15820') HTTP/1.1" 204 0
2026-03-30 11:19:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NN28025/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:19:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:20:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PY38886> (referer: https://www.auto1.com/v1/car-details-view/PY38886/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:20:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:20:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 176de0ce-da9d-5502-b2cd-9ca636b7eb2e with identifier: PY38886
2026-03-30 11:20:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 176de0ce-da9d-5502-b2cd-9ca636b7eb2e with scrape type 1
2026-03-30 11:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 176de0ce-da9d-5502-b2cd-9ca636b7eb2e
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F73%252F04732e6be6221e4dae5f3fafac6cc157%252Fpa%252FPY38886_eff3995185534ffd6838994641f80553.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_eff3995185534ffd6838994641f80553.jpg not downloaded yet
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F73%252F04732e6be6221e4dae5f3fafac6cc157%252Fpa%252FPY38886_bcc66b86318ced865485a198c89dcd05.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_bcc66b86318ced865485a198c89dcd05.jpg not downloaded yet
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F73%252F04732e6be6221e4dae5f3fafac6cc157%252Fpa%252FPY38886_718939f74bb658d4173cc6102b754b1c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_718939f74bb658d4173cc6102b754b1c.jpg not downloaded yet
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F73%252F04732e6be6221e4dae5f3fafac6cc157%252Fpa%252FPY38886_ad07b6af223e513a688e8dc3ed808564.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_ad07b6af223e513a688e8dc3ed808564.jpg not downloaded yet
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F73%252F04732e6be6221e4dae5f3fafac6cc157%252Fpa%252FPY38886_34638d7225755b6c42662d1fc1efe076.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_34638d7225755b6c42662d1fc1efe076.jpg not downloaded yet
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F73%252F04732e6be6221e4dae5f3fafac6cc157%252Fpa%252FPY38886_578b8c007b041145e401abbdacc5e677.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_578b8c007b041145e401abbdacc5e677.jpg already downloaded
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F73%252F04732e6be6221e4dae5f3fafac6cc157%252Fpa%252FPY38886_75951a4fbc7a9f65529a37852a34e8b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_75951a4fbc7a9f65529a37852a34e8b1.jpg not downloaded yet
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F73%252F04732e6be6221e4dae5f3fafac6cc157%252Fpa%252FPY38886_17fcf1883dd8af48ffcd370e6c3af93d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_17fcf1883dd8af48ffcd370e6c3af93d.jpg not downloaded yet
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F73%252F04732e6be6221e4dae5f3fafac6cc157%252Fpa%252FPY38886_ccdde7e507441d366e9b8b58548c5b61.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_ccdde7e507441d366e9b8b58548c5b61.jpg not downloaded yet
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F73%252F04732e6be6221e4dae5f3fafac6cc157%252Fpa%252FPY38886_1b8e89f836c6b0c1d5c1599e35aed114.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_1b8e89f836c6b0c1d5c1599e35aed114.jpg not downloaded yet
2026-03-30 11:20:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VF55417> (referer: https://www.auto1.com/v1/car-details-view/VF55417/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:20:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:20:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_1b8e89f836c6b0c1d5c1599e35aed114.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e392ba05-d999-5f83-a788-7fcf2d3f45c9 with identifier: VF55417
2026-03-30 11:20:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e392ba05-d999-5f83-a788-7fcf2d3f45c9 with scrape type 1
2026-03-30 11:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e392ba05-d999-5f83-a788-7fcf2d3f45c9
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F9d%252F219dabf0486c4c5902057ee7956646c2%252Fpa%252FVF55417_6e52a3eb12e145384e2362233fa5bd82.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_6e52a3eb12e145384e2362233fa5bd82.jpg already downloaded
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F9d%252F219dabf0486c4c5902057ee7956646c2%252Fpa%252FVF55417_73b4d2419a2525f9024e809db582ff9e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_73b4d2419a2525f9024e809db582ff9e.jpg already downloaded
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F9d%252F219dabf0486c4c5902057ee7956646c2%252Fpa%252FVF55417_5ec63155c53b4bfa34bf72c5bc0ce8e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_5ec63155c53b4bfa34bf72c5bc0ce8e7.jpg already downloaded
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F9d%252F219dabf0486c4c5902057ee7956646c2%252Fpa%252FVF55417_ddf61114bfcb2c17a0f689f2d393f369.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_ddf61114bfcb2c17a0f689f2d393f369.jpg already downloaded
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F9d%252F219dabf0486c4c5902057ee7956646c2%252Fpa%252FVF55417_6840f951ba18a0d43ac25d69193025b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_6840f951ba18a0d43ac25d69193025b6.jpg already downloaded
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F9d%252F219dabf0486c4c5902057ee7956646c2%252Fpa%252FVF55417_4c9521d45d69180274c7209b7f360a5a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_4c9521d45d69180274c7209b7f360a5a.jpg already downloaded
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F9d%252F219dabf0486c4c5902057ee7956646c2%252Fpa%252FVF55417_52acbc77505350a9016e7222a9f6a310.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_52acbc77505350a9016e7222a9f6a310.jpg already downloaded
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F9d%252F219dabf0486c4c5902057ee7956646c2%252Fpa%252FVF55417_57efa1744ca9b6186a9512f7bf8feae9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_57efa1744ca9b6186a9512f7bf8feae9.jpg already downloaded
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F9d%252F219dabf0486c4c5902057ee7956646c2%252Fpa%252FVF55417_fb00372d849abe06b81741ecfdf8be13.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_fb00372d849abe06b81741ecfdf8be13.jpg already downloaded
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F9d%252F219dabf0486c4c5902057ee7956646c2%252Fpa%252FVF55417_e5621a07ad1805d4d2f7de9e1d88089e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_e5621a07ad1805d4d2f7de9e1d88089e.jpg already downloaded
2026-03-30 11:20:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e392ba05-d999-5f83-a788-7fcf2d3f45c9, identifier: VF55417
2026-03-30 11:20:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e392ba05-d999-5f83-a788-7fcf2d3f45c9 with identifier: VF55417
2026-03-30 11:20:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e392ba05-d999-5f83-a788-7fcf2d3f45c9 with identifier: VF55417
2026-03-30 11:20:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e392ba05-d999-5f83-a788-7fcf2d3f45c9 with identifier: VF55417 to the API
2026-03-30 11:20:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:20:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:20:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VF55417>
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': 'Rental',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 95,
'expiration_date': '2026-03-31T15:04:06Z',
'fuel_type': 'diesel',
'id': 'e392ba05-d999-5f83-a788-7fcf2d3f45c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF55417',
'listing': 'auction',
'location': 'ES, La Roda de AndalucÃa',
'make': 'Fiat',
'model': '500L',
'odometer': 137569,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_6e52a3eb12e145384e2362233fa5bd82.jpg',
'https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_73b4d2419a2525f9024e809db582ff9e.jpg',
'https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_5ec63155c53b4bfa34bf72c5bc0ce8e7.jpg',
'https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_ddf61114bfcb2c17a0f689f2d393f369.jpg',
'https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_6840f951ba18a0d43ac25d69193025b6.jpg',
'https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_4c9521d45d69180274c7209b7f360a5a.jpg',
'https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_52acbc77505350a9016e7222a9f6a310.jpg',
'https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_57efa1744ca9b6186a9512f7bf8feae9.jpg',
'https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_fb00372d849abe06b81741ecfdf8be13.jpg',
'https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_e5621a07ad1805d4d2f7de9e1d88089e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e392ba05-d999-5f83-a788-7fcf2d3f45c9/e392ba05-d999-5f83-a788-7fcf2d3f45c9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95122,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_6e52a3eb12e145384e2362233fa5bd82.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e392ba05-d999-5f83-a788-7fcf2d3f45c9/e392ba05-d999-5f83-a788-7fcf2d3f45c9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90692,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_73b4d2419a2525f9024e809db582ff9e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e392ba05-d999-5f83-a788-7fcf2d3f45c9/e392ba05-d999-5f83-a788-7fcf2d3f45c9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85667,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_5ec63155c53b4bfa34bf72c5bc0ce8e7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e392ba05-d999-5f83-a788-7fcf2d3f45c9/e392ba05-d999-5f83-a788-7fcf2d3f45c9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62010,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_ddf61114bfcb2c17a0f689f2d393f369.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e392ba05-d999-5f83-a788-7fcf2d3f45c9/e392ba05-d999-5f83-a788-7fcf2d3f45c9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83789,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_6840f951ba18a0d43ac25d69193025b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e392ba05-d999-5f83-a788-7fcf2d3f45c9/e392ba05-d999-5f83-a788-7fcf2d3f45c9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92714,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_4c9521d45d69180274c7209b7f360a5a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e392ba05-d999-5f83-a788-7fcf2d3f45c9/e392ba05-d999-5f83-a788-7fcf2d3f45c9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62274,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_52acbc77505350a9016e7222a9f6a310.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e392ba05-d999-5f83-a788-7fcf2d3f45c9/e392ba05-d999-5f83-a788-7fcf2d3f45c9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92936,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_57efa1744ca9b6186a9512f7bf8feae9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e392ba05-d999-5f83-a788-7fcf2d3f45c9/e392ba05-d999-5f83-a788-7fcf2d3f45c9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90752,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_fb00372d849abe06b81741ecfdf8be13.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e392ba05-d999-5f83-a788-7fcf2d3f45c9/e392ba05-d999-5f83-a788-7fcf2d3f45c9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68911,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/9d/219dabf0486c4c5902057ee7956646c2/pa/VF55417_e5621a07ad1805d4d2f7de9e1d88089e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-03-28',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat 500L 1.3 M-Jet Pop Star',
'transmission': 'automatic',
'trim': 'Pop Star',
'year': 2017}
2026-03-30 11:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VF55417%27 HTTP/1.1" 200 None
2026-03-30 11:20:02 [auto1.es] INFO: Saving data for VF55417: {'created_time': 1774869602.454378, 'last_price_update_time': 1774869602.454391, 'auction_closing_time': 1774969446.0}
2026-03-30 11:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VF55417') HTTP/1.1" 204 0
2026-03-30 11:20:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_ccdde7e507441d366e9b8b58548c5b61.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ae83a10>
2026-03-30 11:20:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_176de0ce-da9d-5502-b2cd-9ca636b7eb2e/176de0ce-da9d-5502-b2cd-9ca636b7eb2e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F73%252F04732e6be6221e4dae5f3fafac6cc157%252Fpa%252FPY38886_1b8e89f836c6b0c1d5c1599e35aed114.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_1b8e89f836c6b0c1d5c1599e35aed114.jpg saved to cache
2026-03-30 11:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 176de0ce-da9d-5502-b2cd-9ca636b7eb2e
2026-03-30 11:20:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060d05a10>
2026-03-30 11:20:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_176de0ce-da9d-5502-b2cd-9ca636b7eb2e/176de0ce-da9d-5502-b2cd-9ca636b7eb2e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F73%252F04732e6be6221e4dae5f3fafac6cc157%252Fpa%252FPY38886_ccdde7e507441d366e9b8b58548c5b61.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_ccdde7e507441d366e9b8b58548c5b61.jpg saved to cache
2026-03-30 11:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 176de0ce-da9d-5502-b2cd-9ca636b7eb2e
2026-03-30 11:20:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_17fcf1883dd8af48ffcd370e6c3af93d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3313d0>
2026-03-30 11:20:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_176de0ce-da9d-5502-b2cd-9ca636b7eb2e/176de0ce-da9d-5502-b2cd-9ca636b7eb2e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F73%252F04732e6be6221e4dae5f3fafac6cc157%252Fpa%252FPY38886_17fcf1883dd8af48ffcd370e6c3af93d.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_17fcf1883dd8af48ffcd370e6c3af93d.jpg saved to cache
2026-03-30 11:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 176de0ce-da9d-5502-b2cd-9ca636b7eb2e
2026-03-30 11:20:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_75951a4fbc7a9f65529a37852a34e8b1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3cda50>
2026-03-30 11:20:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_176de0ce-da9d-5502-b2cd-9ca636b7eb2e/176de0ce-da9d-5502-b2cd-9ca636b7eb2e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F73%252F04732e6be6221e4dae5f3fafac6cc157%252Fpa%252FPY38886_75951a4fbc7a9f65529a37852a34e8b1.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_75951a4fbc7a9f65529a37852a34e8b1.jpg saved to cache
2026-03-30 11:20:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 176de0ce-da9d-5502-b2cd-9ca636b7eb2e
2026-03-30 11:20:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_34638d7225755b6c42662d1fc1efe076.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ae728d0>
2026-03-30 11:20:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_176de0ce-da9d-5502-b2cd-9ca636b7eb2e/176de0ce-da9d-5502-b2cd-9ca636b7eb2e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F73%252F04732e6be6221e4dae5f3fafac6cc157%252Fpa%252FPY38886_34638d7225755b6c42662d1fc1efe076.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_34638d7225755b6c42662d1fc1efe076.jpg saved to cache
2026-03-30 11:20:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 176de0ce-da9d-5502-b2cd-9ca636b7eb2e
2026-03-30 11:20:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_ad07b6af223e513a688e8dc3ed808564.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a469650>
2026-03-30 11:20:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_176de0ce-da9d-5502-b2cd-9ca636b7eb2e/176de0ce-da9d-5502-b2cd-9ca636b7eb2e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F73%252F04732e6be6221e4dae5f3fafac6cc157%252Fpa%252FPY38886_ad07b6af223e513a688e8dc3ed808564.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_ad07b6af223e513a688e8dc3ed808564.jpg saved to cache
2026-03-30 11:20:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 176de0ce-da9d-5502-b2cd-9ca636b7eb2e
2026-03-30 11:20:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_718939f74bb658d4173cc6102b754b1c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a457610>
2026-03-30 11:20:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_176de0ce-da9d-5502-b2cd-9ca636b7eb2e/176de0ce-da9d-5502-b2cd-9ca636b7eb2e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F73%252F04732e6be6221e4dae5f3fafac6cc157%252Fpa%252FPY38886_718939f74bb658d4173cc6102b754b1c.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_718939f74bb658d4173cc6102b754b1c.jpg saved to cache
2026-03-30 11:20:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 176de0ce-da9d-5502-b2cd-9ca636b7eb2e
2026-03-30 11:20:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JG71892> (referer: https://www.auto1.com/v1/car-details-view/JG71892/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:20:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:20:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_bcc66b86318ced865485a198c89dcd05.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_eff3995185534ffd6838994641f80553.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b276d836-58a4-565e-85d7-86ee98b611dd with identifier: JG71892
2026-03-30 11:20:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b276d836-58a4-565e-85d7-86ee98b611dd with scrape type 1
2026-03-30 11:20:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b276d836-58a4-565e-85d7-86ee98b611dd
2026-03-30 11:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fad%252Fbaade11404026201de11810e9c354cdc%252Fpa%252FJG71892_75d92c3acc4a8f2b8cc493747df1a646.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ad/baade11404026201de11810e9c354cdc/pa/JG71892_75d92c3acc4a8f2b8cc493747df1a646.jpg not downloaded yet
2026-03-30 11:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fad%252Fbaade11404026201de11810e9c354cdc%252Fpa%252FJG71892_cd6e38546b32a9002ebb0f163198ff71.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ad/baade11404026201de11810e9c354cdc/pa/JG71892_cd6e38546b32a9002ebb0f163198ff71.jpg not downloaded yet
2026-03-30 11:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fad%252Fbaade11404026201de11810e9c354cdc%252Fpa%252FJG71892_15546499ce4d416e6fe945542afe1de4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ad/baade11404026201de11810e9c354cdc/pa/JG71892_15546499ce4d416e6fe945542afe1de4.jpg not downloaded yet
2026-03-30 11:20:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4f9910>
2026-03-30 11:20:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_176de0ce-da9d-5502-b2cd-9ca636b7eb2e/176de0ce-da9d-5502-b2cd-9ca636b7eb2e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F73%252F04732e6be6221e4dae5f3fafac6cc157%252Fpa%252FPY38886_bcc66b86318ced865485a198c89dcd05.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_bcc66b86318ced865485a198c89dcd05.jpg saved to cache
2026-03-30 11:20:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 176de0ce-da9d-5502-b2cd-9ca636b7eb2e
2026-03-30 11:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fad%252Fbaade11404026201de11810e9c354cdc%252Fpa%252FJG71892_c3ac191e53d10d919ed105e0152d9f24.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ad/baade11404026201de11810e9c354cdc/pa/JG71892_c3ac191e53d10d919ed105e0152d9f24.jpg not downloaded yet
2026-03-30 11:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fad%252Fbaade11404026201de11810e9c354cdc%252Fpa%252FJG71892_3f3b10d55b164f399a790fd43c546e7d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ad/baade11404026201de11810e9c354cdc/pa/JG71892_3f3b10d55b164f399a790fd43c546e7d.jpg not downloaded yet
2026-03-30 11:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fad%252Fbaade11404026201de11810e9c354cdc%252Fpa%252FJG71892_a630026dde8e685cdcbca1d97f6a8556.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ad/baade11404026201de11810e9c354cdc/pa/JG71892_a630026dde8e685cdcbca1d97f6a8556.jpg not downloaded yet
2026-03-30 11:20:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a42ced0>
2026-03-30 11:20:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_176de0ce-da9d-5502-b2cd-9ca636b7eb2e/176de0ce-da9d-5502-b2cd-9ca636b7eb2e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F73%252F04732e6be6221e4dae5f3fafac6cc157%252Fpa%252FPY38886_eff3995185534ffd6838994641f80553.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_eff3995185534ffd6838994641f80553.jpg saved to cache
2026-03-30 11:20:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 176de0ce-da9d-5502-b2cd-9ca636b7eb2e
2026-03-30 11:20:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 176de0ce-da9d-5502-b2cd-9ca636b7eb2e, skipping ID generation
2026-03-30 11:20:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 176de0ce-da9d-5502-b2cd-9ca636b7eb2e with scrape type 1
2026-03-30 11:20:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 176de0ce-da9d-5502-b2cd-9ca636b7eb2e sending to next pipeline
2026-03-30 11:20:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 176de0ce-da9d-5502-b2cd-9ca636b7eb2e, identifier: PY38886
2026-03-30 11:20:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 176de0ce-da9d-5502-b2cd-9ca636b7eb2e with identifier: PY38886
2026-03-30 11:20:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 176de0ce-da9d-5502-b2cd-9ca636b7eb2e with identifier: PY38886
2026-03-30 11:20:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 176de0ce-da9d-5502-b2cd-9ca636b7eb2e with identifier: PY38886 to the API
2026-03-30 11:20:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:20:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:20:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_eff3995185534ffd6838994641f80553.jpg>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.9L',
'engine_horse_power': 105,
'expiration_date': '2026-03-31T15:25:50Z',
'fuel_type': 'diesel',
'id': '176de0ce-da9d-5502-b2cd-9ca636b7eb2e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY38886',
'listing': 'auction',
'location': 'ES, Campo Real',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 141921,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_176de0ce-da9d-5502-b2cd-9ca636b7eb2e/176de0ce-da9d-5502-b2cd-9ca636b7eb2e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109412,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_eff3995185534ffd6838994641f80553.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_176de0ce-da9d-5502-b2cd-9ca636b7eb2e/176de0ce-da9d-5502-b2cd-9ca636b7eb2e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107144,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_bcc66b86318ced865485a198c89dcd05.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_176de0ce-da9d-5502-b2cd-9ca636b7eb2e/176de0ce-da9d-5502-b2cd-9ca636b7eb2e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100773,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_718939f74bb658d4173cc6102b754b1c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_176de0ce-da9d-5502-b2cd-9ca636b7eb2e/176de0ce-da9d-5502-b2cd-9ca636b7eb2e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90641,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_ad07b6af223e513a688e8dc3ed808564.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_176de0ce-da9d-5502-b2cd-9ca636b7eb2e/176de0ce-da9d-5502-b2cd-9ca636b7eb2e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85568,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_34638d7225755b6c42662d1fc1efe076.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_176de0ce-da9d-5502-b2cd-9ca636b7eb2e/176de0ce-da9d-5502-b2cd-9ca636b7eb2e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90104,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_578b8c007b041145e401abbdacc5e677.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_176de0ce-da9d-5502-b2cd-9ca636b7eb2e/176de0ce-da9d-5502-b2cd-9ca636b7eb2e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75990,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_75951a4fbc7a9f65529a37852a34e8b1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_176de0ce-da9d-5502-b2cd-9ca636b7eb2e/176de0ce-da9d-5502-b2cd-9ca636b7eb2e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95909,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_17fcf1883dd8af48ffcd370e6c3af93d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_176de0ce-da9d-5502-b2cd-9ca636b7eb2e/176de0ce-da9d-5502-b2cd-9ca636b7eb2e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92596,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_ccdde7e507441d366e9b8b58548c5b61.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_176de0ce-da9d-5502-b2cd-9ca636b7eb2e/176de0ce-da9d-5502-b2cd-9ca636b7eb2e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87473,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img04/73/04732e6be6221e4dae5f3fafac6cc157/pa/PY38886_1b8e89f836c6b0c1d5c1599e35aed114.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-07-13',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Fabia 1.9 TDI Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2009}
2026-03-30 11:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PY38886%27 HTTP/1.1" 200 None
2026-03-30 11:20:04 [auto1.es] INFO: Saving data for PY38886: {'created_time': 1774869604.886643, 'last_price_update_time': 1774869604.886656, 'auction_closing_time': 1774970750.0}
2026-03-30 11:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PY38886') HTTP/1.1" 204 0
2026-03-30 11:20:04 [scrapy.extensions.logstats] INFO: Crawled 84 pages (at 11 pages/min), scraped 94 items (at 20 items/min)
2026-03-30 11:20:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 161MiB
2026-03-30 11:20:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JZ31691/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:20:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:20:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/ad/baade11404026201de11810e9c354cdc/pa/JG71892_a630026dde8e685cdcbca1d97f6a8556.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a47c450>
2026-03-30 11:20:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b276d836-58a4-565e-85d7-86ee98b611dd/b276d836-58a4-565e-85d7-86ee98b611dd_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fad%252Fbaade11404026201de11810e9c354cdc%252Fpa%252FJG71892_a630026dde8e685cdcbca1d97f6a8556.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ad/baade11404026201de11810e9c354cdc/pa/JG71892_a630026dde8e685cdcbca1d97f6a8556.jpg saved to cache
2026-03-30 11:20:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b276d836-58a4-565e-85d7-86ee98b611dd
2026-03-30 11:20:14 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.235(s), this was the 1st time calling it.
2026-03-30 11:20:14 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.7516004504946068 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:20:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GW76343/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:20:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:20:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/ad/baade11404026201de11810e9c354cdc/pa/JG71892_3f3b10d55b164f399a790fd43c546e7d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/ad/baade11404026201de11810e9c354cdc/pa/JG71892_c3ac191e53d10d919ed105e0152d9f24.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4af410>
2026-03-30 11:20:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b276d836-58a4-565e-85d7-86ee98b611dd/b276d836-58a4-565e-85d7-86ee98b611dd_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fad%252Fbaade11404026201de11810e9c354cdc%252Fpa%252FJG71892_3f3b10d55b164f399a790fd43c546e7d.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ad/baade11404026201de11810e9c354cdc/pa/JG71892_3f3b10d55b164f399a790fd43c546e7d.jpg saved to cache
2026-03-30 11:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b276d836-58a4-565e-85d7-86ee98b611dd
2026-03-30 11:20:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a481ed0>
2026-03-30 11:20:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b276d836-58a4-565e-85d7-86ee98b611dd/b276d836-58a4-565e-85d7-86ee98b611dd_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fad%252Fbaade11404026201de11810e9c354cdc%252Fpa%252FJG71892_c3ac191e53d10d919ed105e0152d9f24.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ad/baade11404026201de11810e9c354cdc/pa/JG71892_c3ac191e53d10d919ed105e0152d9f24.jpg saved to cache
2026-03-30 11:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b276d836-58a4-565e-85d7-86ee98b611dd
2026-03-30 11:20:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:20:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FW49739> (referer: https://www.auto1.com/v1/car-details-view/FW49739/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:20:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:20:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/ad/baade11404026201de11810e9c354cdc/pa/JG71892_15546499ce4d416e6fe945542afe1de4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5141be34-685c-5aae-bf76-6e9159ea9e94 with identifier: FW49739
2026-03-30 11:20:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5141be34-685c-5aae-bf76-6e9159ea9e94 with scrape type 1
2026-03-30 11:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5141be34-685c-5aae-bf76-6e9159ea9e94
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F8e%252F678edf7ebad3e39efd817a72598c0f34%252Fpa%252FFW49739_0ba42d22cbffc0ef70dd61b66e00e837.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_0ba42d22cbffc0ef70dd61b66e00e837.jpg not downloaded yet
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F8e%252F678edf7ebad3e39efd817a72598c0f34%252Fpa%252FFW49739_7649e5f59774b2b265171c44271cb1bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_7649e5f59774b2b265171c44271cb1bc.jpg not downloaded yet
2026-03-30 11:20:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/ad/baade11404026201de11810e9c354cdc/pa/JG71892_cd6e38546b32a9002ebb0f163198ff71.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F8e%252F678edf7ebad3e39efd817a72598c0f34%252Fpa%252FFW49739_b09e9108d4e688f4e605c50e70908276.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_b09e9108d4e688f4e605c50e70908276.jpg not downloaded yet
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F8e%252F678edf7ebad3e39efd817a72598c0f34%252Fpa%252FFW49739_c2d33166293b0763b2211d4a195cb040.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_c2d33166293b0763b2211d4a195cb040.jpg not downloaded yet
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F8e%252F678edf7ebad3e39efd817a72598c0f34%252Fpa%252FFW49739_1d904242753da36dc2a709b6caf22f43.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_1d904242753da36dc2a709b6caf22f43.jpg not downloaded yet
2026-03-30 11:20:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4d7d50>
2026-03-30 11:20:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b276d836-58a4-565e-85d7-86ee98b611dd/b276d836-58a4-565e-85d7-86ee98b611dd_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fad%252Fbaade11404026201de11810e9c354cdc%252Fpa%252FJG71892_15546499ce4d416e6fe945542afe1de4.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ad/baade11404026201de11810e9c354cdc/pa/JG71892_15546499ce4d416e6fe945542afe1de4.jpg saved to cache
2026-03-30 11:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b276d836-58a4-565e-85d7-86ee98b611dd
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F8e%252F678edf7ebad3e39efd817a72598c0f34%252Fpa%252FFW49739_fd9757c1ddf4039097ae5121667c59ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_fd9757c1ddf4039097ae5121667c59ea.jpg not downloaded yet
2026-03-30 11:20:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_0ba42d22cbffc0ef70dd61b66e00e837.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F8e%252F678edf7ebad3e39efd817a72598c0f34%252Fpa%252FFW49739_6556f4fffe68cb4eb5ea8f862c06e9fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_6556f4fffe68cb4eb5ea8f862c06e9fd.jpg not downloaded yet
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F8e%252F678edf7ebad3e39efd817a72598c0f34%252Fpa%252FFW49739_5dfe2484ecf936eaa23ad25bac83037c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_5dfe2484ecf936eaa23ad25bac83037c.jpg not downloaded yet
2026-03-30 11:20:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a399950>
2026-03-30 11:20:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b276d836-58a4-565e-85d7-86ee98b611dd/b276d836-58a4-565e-85d7-86ee98b611dd_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fad%252Fbaade11404026201de11810e9c354cdc%252Fpa%252FJG71892_cd6e38546b32a9002ebb0f163198ff71.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ad/baade11404026201de11810e9c354cdc/pa/JG71892_cd6e38546b32a9002ebb0f163198ff71.jpg saved to cache
2026-03-30 11:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b276d836-58a4-565e-85d7-86ee98b611dd
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F8e%252F678edf7ebad3e39efd817a72598c0f34%252Fpa%252FFW49739_1e490d5b80205729437252960acb3fae.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_1e490d5b80205729437252960acb3fae.jpg not downloaded yet
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F8e%252F678edf7ebad3e39efd817a72598c0f34%252Fpa%252FFW49739_8bbf61a4fe950f9e4a7553c1f17ec22f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_8bbf61a4fe950f9e4a7553c1f17ec22f.jpg not downloaded yet
2026-03-30 11:20:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4d7d50>
2026-03-30 11:20:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F8e%252F678edf7ebad3e39efd817a72598c0f34%252Fpa%252FFW49739_0ba42d22cbffc0ef70dd61b66e00e837.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_0ba42d22cbffc0ef70dd61b66e00e837.jpg saved to cache
2026-03-30 11:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5141be34-685c-5aae-bf76-6e9159ea9e94
2026-03-30 11:20:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_1d904242753da36dc2a709b6caf22f43.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_8bbf61a4fe950f9e4a7553c1f17ec22f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a455390>
2026-03-30 11:20:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F8e%252F678edf7ebad3e39efd817a72598c0f34%252Fpa%252FFW49739_1d904242753da36dc2a709b6caf22f43.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_1d904242753da36dc2a709b6caf22f43.jpg saved to cache
2026-03-30 11:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5141be34-685c-5aae-bf76-6e9159ea9e94
2026-03-30 11:20:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad51e10>
2026-03-30 11:20:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F8e%252F678edf7ebad3e39efd817a72598c0f34%252Fpa%252FFW49739_8bbf61a4fe950f9e4a7553c1f17ec22f.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_8bbf61a4fe950f9e4a7553c1f17ec22f.jpg saved to cache
2026-03-30 11:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5141be34-685c-5aae-bf76-6e9159ea9e94
2026-03-30 11:20:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_1e490d5b80205729437252960acb3fae.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc0610c3590>
2026-03-30 11:20:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F8e%252F678edf7ebad3e39efd817a72598c0f34%252Fpa%252FFW49739_1e490d5b80205729437252960acb3fae.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_1e490d5b80205729437252960acb3fae.jpg saved to cache
2026-03-30 11:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5141be34-685c-5aae-bf76-6e9159ea9e94
2026-03-30 11:20:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_5dfe2484ecf936eaa23ad25bac83037c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a48f790>
2026-03-30 11:20:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F8e%252F678edf7ebad3e39efd817a72598c0f34%252Fpa%252FFW49739_5dfe2484ecf936eaa23ad25bac83037c.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_5dfe2484ecf936eaa23ad25bac83037c.jpg saved to cache
2026-03-30 11:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5141be34-685c-5aae-bf76-6e9159ea9e94
2026-03-30 11:20:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_6556f4fffe68cb4eb5ea8f862c06e9fd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a36f490>
2026-03-30 11:20:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F8e%252F678edf7ebad3e39efd817a72598c0f34%252Fpa%252FFW49739_6556f4fffe68cb4eb5ea8f862c06e9fd.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_6556f4fffe68cb4eb5ea8f862c06e9fd.jpg saved to cache
2026-03-30 11:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5141be34-685c-5aae-bf76-6e9159ea9e94
2026-03-30 11:20:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_fd9757c1ddf4039097ae5121667c59ea.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a359790>
2026-03-30 11:20:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F8e%252F678edf7ebad3e39efd817a72598c0f34%252Fpa%252FFW49739_fd9757c1ddf4039097ae5121667c59ea.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_fd9757c1ddf4039097ae5121667c59ea.jpg saved to cache
2026-03-30 11:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5141be34-685c-5aae-bf76-6e9159ea9e94
2026-03-30 11:20:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_c2d33166293b0763b2211d4a195cb040.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a36cbd0>
2026-03-30 11:20:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F8e%252F678edf7ebad3e39efd817a72598c0f34%252Fpa%252FFW49739_c2d33166293b0763b2211d4a195cb040.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_c2d33166293b0763b2211d4a195cb040.jpg saved to cache
2026-03-30 11:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5141be34-685c-5aae-bf76-6e9159ea9e94
2026-03-30 11:20:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_b09e9108d4e688f4e605c50e70908276.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a35a350>
2026-03-30 11:20:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F8e%252F678edf7ebad3e39efd817a72598c0f34%252Fpa%252FFW49739_b09e9108d4e688f4e605c50e70908276.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_b09e9108d4e688f4e605c50e70908276.jpg saved to cache
2026-03-30 11:20:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5141be34-685c-5aae-bf76-6e9159ea9e94
2026-03-30 11:20:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_7649e5f59774b2b265171c44271cb1bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/ad/baade11404026201de11810e9c354cdc/pa/JG71892_75d92c3acc4a8f2b8cc493747df1a646.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a454a50>
2026-03-30 11:20:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F8e%252F678edf7ebad3e39efd817a72598c0f34%252Fpa%252FFW49739_7649e5f59774b2b265171c44271cb1bc.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_7649e5f59774b2b265171c44271cb1bc.jpg saved to cache
2026-03-30 11:20:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5141be34-685c-5aae-bf76-6e9159ea9e94
2026-03-30 11:20:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5141be34-685c-5aae-bf76-6e9159ea9e94, skipping ID generation
2026-03-30 11:20:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5141be34-685c-5aae-bf76-6e9159ea9e94 with scrape type 1
2026-03-30 11:20:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5141be34-685c-5aae-bf76-6e9159ea9e94 sending to next pipeline
2026-03-30 11:20:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5141be34-685c-5aae-bf76-6e9159ea9e94, identifier: FW49739
2026-03-30 11:20:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5141be34-685c-5aae-bf76-6e9159ea9e94 with identifier: FW49739
2026-03-30 11:20:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5141be34-685c-5aae-bf76-6e9159ea9e94 with identifier: FW49739
2026-03-30 11:20:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5141be34-685c-5aae-bf76-6e9159ea9e94 with identifier: FW49739 to the API
2026-03-30 11:20:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:20:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:20:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_7649e5f59774b2b265171c44271cb1bc.jpg>
{'auction_title': '',
'c_o_2_emission_value': 190,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'engine_horse_power': 231,
'expiration_date': '2026-03-31T15:41:21Z',
'fuel_type': 'diesel',
'id': '5141be34-685c-5aae-bf76-6e9159ea9e94',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW49739',
'listing': 'auction',
'location': 'ES, Sevilla',
'make': 'Audi',
'model': 'A6',
'odometer': 88811,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82653,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_0ba42d22cbffc0ef70dd61b66e00e837.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71985,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_7649e5f59774b2b265171c44271cb1bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71919,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_b09e9108d4e688f4e605c50e70908276.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74972,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_c2d33166293b0763b2211d4a195cb040.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73648,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_1d904242753da36dc2a709b6caf22f43.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76289,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_fd9757c1ddf4039097ae5121667c59ea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74563,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_6556f4fffe68cb4eb5ea8f862c06e9fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74511,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_5dfe2484ecf936eaa23ad25bac83037c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76494,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_1e490d5b80205729437252960acb3fae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5141be34-685c-5aae-bf76-6e9159ea9e94/5141be34-685c-5aae-bf76-6e9159ea9e94_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80612,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/8e/678edf7ebad3e39efd817a72598c0f34/pa/FW49739_8bbf61a4fe950f9e4a7553c1f17ec22f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-03-06',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A6 45 TDI Mild-Hybrid quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2019}
2026-03-30 11:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FW49739%27 HTTP/1.1" 200 None
2026-03-30 11:20:32 [auto1.es] INFO: Saving data for FW49739: {'created_time': 1774869632.03226, 'last_price_update_time': 1774869632.032273, 'auction_closing_time': 1774971681.0}
2026-03-30 11:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FW49739') HTTP/1.1" 204 0
2026-03-30 11:20:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad53090>
2026-03-30 11:20:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b276d836-58a4-565e-85d7-86ee98b611dd/b276d836-58a4-565e-85d7-86ee98b611dd_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fad%252Fbaade11404026201de11810e9c354cdc%252Fpa%252FJG71892_75d92c3acc4a8f2b8cc493747df1a646.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ad/baade11404026201de11810e9c354cdc/pa/JG71892_75d92c3acc4a8f2b8cc493747df1a646.jpg saved to cache
2026-03-30 11:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b276d836-58a4-565e-85d7-86ee98b611dd
2026-03-30 11:20:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b276d836-58a4-565e-85d7-86ee98b611dd, skipping ID generation
2026-03-30 11:20:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b276d836-58a4-565e-85d7-86ee98b611dd with scrape type 1
2026-03-30 11:20:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b276d836-58a4-565e-85d7-86ee98b611dd sending to next pipeline
2026-03-30 11:20:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b276d836-58a4-565e-85d7-86ee98b611dd, identifier: JG71892
2026-03-30 11:20:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b276d836-58a4-565e-85d7-86ee98b611dd with identifier: JG71892
2026-03-30 11:20:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b276d836-58a4-565e-85d7-86ee98b611dd with identifier: JG71892
2026-03-30 11:20:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b276d836-58a4-565e-85d7-86ee98b611dd with identifier: JG71892 to the API
2026-03-30 11:20:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:20:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:20:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgba/ad/baade11404026201de11810e9c354cdc/pa/JG71892_75d92c3acc4a8f2b8cc493747df1a646.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.9L',
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:43:42Z',
'fuel_type': 'diesel',
'id': 'b276d836-58a4-565e-85d7-86ee98b611dd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG71892',
'listing': 'auction',
'location': 'ES, Tarragona',
'make': 'Seat',
'model': 'Leon',
'odometer': 194653,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b276d836-58a4-565e-85d7-86ee98b611dd/b276d836-58a4-565e-85d7-86ee98b611dd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102783,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgba/ad/baade11404026201de11810e9c354cdc/pa/JG71892_75d92c3acc4a8f2b8cc493747df1a646.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b276d836-58a4-565e-85d7-86ee98b611dd/b276d836-58a4-565e-85d7-86ee98b611dd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113619,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgba/ad/baade11404026201de11810e9c354cdc/pa/JG71892_cd6e38546b32a9002ebb0f163198ff71.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b276d836-58a4-565e-85d7-86ee98b611dd/b276d836-58a4-565e-85d7-86ee98b611dd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78914,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgba/ad/baade11404026201de11810e9c354cdc/pa/JG71892_15546499ce4d416e6fe945542afe1de4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b276d836-58a4-565e-85d7-86ee98b611dd/b276d836-58a4-565e-85d7-86ee98b611dd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67091,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgba/ad/baade11404026201de11810e9c354cdc/pa/JG71892_c3ac191e53d10d919ed105e0152d9f24.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b276d836-58a4-565e-85d7-86ee98b611dd/b276d836-58a4-565e-85d7-86ee98b611dd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83309,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgba/ad/baade11404026201de11810e9c354cdc/pa/JG71892_3f3b10d55b164f399a790fd43c546e7d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b276d836-58a4-565e-85d7-86ee98b611dd/b276d836-58a4-565e-85d7-86ee98b611dd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 146493,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgba/ad/baade11404026201de11810e9c354cdc/pa/JG71892_a630026dde8e685cdcbca1d97f6a8556.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2003-12-31',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Leon 1.9 TDI Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2003}
2026-03-30 11:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG71892%27 HTTP/1.1" 200 None
2026-03-30 11:20:32 [auto1.es] INFO: Saving data for JG71892: {'created_time': 1774869632.662228, 'last_price_update_time': 1774869632.662239, 'auction_closing_time': 1774971822.0}
2026-03-30 11:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JG71892') HTTP/1.1" 204 0
2026-03-30 11:20:44 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.087(s), this was the 1st time calling it.
2026-03-30 11:20:44 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.499452922093601 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:20:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AT55590/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:20:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:20:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JU92139> (referer: https://www.auto1.com/v1/car-details-view/JU92139/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:20:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:20:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5e260d9-3b71-5749-b77e-e15005e315c6 with identifier: JU92139
2026-03-30 11:20:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5e260d9-3b71-5749-b77e-e15005e315c6 with scrape type 1
2026-03-30 11:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f5e260d9-3b71-5749-b77e-e15005e315c6
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F4f%252F394fe106ddfaf3067a4d828c7a8b2520%252Fpa%252FJU92139_fe9c8969a4f9da310b1c1335295784e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/4f/394fe106ddfaf3067a4d828c7a8b2520/pa/JU92139_fe9c8969a4f9da310b1c1335295784e6.jpg already downloaded
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F4f%252F394fe106ddfaf3067a4d828c7a8b2520%252Fpa%252FJU92139_ee8a2744b4d593e1ef03081bf9c20753.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/4f/394fe106ddfaf3067a4d828c7a8b2520/pa/JU92139_ee8a2744b4d593e1ef03081bf9c20753.jpg already downloaded
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F4f%252F394fe106ddfaf3067a4d828c7a8b2520%252Fpa%252FJU92139_fc0e22c111895538d22e96fe87ec45c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/4f/394fe106ddfaf3067a4d828c7a8b2520/pa/JU92139_fc0e22c111895538d22e96fe87ec45c4.jpg already downloaded
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F4f%252F394fe106ddfaf3067a4d828c7a8b2520%252Fpa%252FJU92139_2518b43d37ed58ca0cd5403dd63b194f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/4f/394fe106ddfaf3067a4d828c7a8b2520/pa/JU92139_2518b43d37ed58ca0cd5403dd63b194f.jpg already downloaded
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F4f%252F394fe106ddfaf3067a4d828c7a8b2520%252Fpa%252FJU92139_dff79d49cca05bf449f08d2480d0ae33.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/4f/394fe106ddfaf3067a4d828c7a8b2520/pa/JU92139_dff79d49cca05bf449f08d2480d0ae33.jpg already downloaded
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F4f%252F394fe106ddfaf3067a4d828c7a8b2520%252Fpa%252FJU92139_771beba37a16356b215203299212f172.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/4f/394fe106ddfaf3067a4d828c7a8b2520/pa/JU92139_771beba37a16356b215203299212f172.jpg already downloaded
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F4f%252F394fe106ddfaf3067a4d828c7a8b2520%252Fpa%252FJU92139_01539fba771db7b8ec6d234381d64ba4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/4f/394fe106ddfaf3067a4d828c7a8b2520/pa/JU92139_01539fba771db7b8ec6d234381d64ba4.jpg already downloaded
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F4f%252F394fe106ddfaf3067a4d828c7a8b2520%252Fpa%252FJU92139_d76af3485897fe6fb26ea71f43418416.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/4f/394fe106ddfaf3067a4d828c7a8b2520/pa/JU92139_d76af3485897fe6fb26ea71f43418416.jpg already downloaded
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F4f%252F394fe106ddfaf3067a4d828c7a8b2520%252Fpa%252FJU92139_64468ae47da257870b3bcd19879baed4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/4f/394fe106ddfaf3067a4d828c7a8b2520/pa/JU92139_64468ae47da257870b3bcd19879baed4.jpg already downloaded
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F4f%252F394fe106ddfaf3067a4d828c7a8b2520%252Fpa%252FJU92139_2a7838aef07f3b1ef8d864c31b08d4d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/4f/394fe106ddfaf3067a4d828c7a8b2520/pa/JU92139_2a7838aef07f3b1ef8d864c31b08d4d3.jpg already downloaded
2026-03-30 11:20:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f5e260d9-3b71-5749-b77e-e15005e315c6, identifier: JU92139
2026-03-30 11:20:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f5e260d9-3b71-5749-b77e-e15005e315c6 with identifier: JU92139
2026-03-30 11:20:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f5e260d9-3b71-5749-b77e-e15005e315c6 with identifier: JU92139
2026-03-30 11:20:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f5e260d9-3b71-5749-b77e-e15005e315c6 with identifier: JU92139 to the API
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:20:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:20:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JU92139>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:09:47Z',
'fuel_type': 'diesel',
'id': 'f5e260d9-3b71-5749-b77e-e15005e315c6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU92139',
'listing': 'auction',
'location': 'ES, Barcelona',
'make': 'BMW',
'model': 'X1',
'odometer': 102604,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img39/4f/394fe106ddfaf3067a4d828c7a8b2520/pa/JU92139_fe9c8969a4f9da310b1c1335295784e6.jpg',
'https://img-pa.auto1.com/img39/4f/394fe106ddfaf3067a4d828c7a8b2520/pa/JU92139_ee8a2744b4d593e1ef03081bf9c20753.jpg',
'https://img-pa.auto1.com/img39/4f/394fe106ddfaf3067a4d828c7a8b2520/pa/JU92139_fc0e22c111895538d22e96fe87ec45c4.jpg',
'https://img-pa.auto1.com/img39/4f/394fe106ddfaf3067a4d828c7a8b2520/pa/JU92139_2518b43d37ed58ca0cd5403dd63b194f.jpg',
'https://img-pa.auto1.com/img39/4f/394fe106ddfaf3067a4d828c7a8b2520/pa/JU92139_dff79d49cca05bf449f08d2480d0ae33.jpg',
'https://img-pa.auto1.com/img39/4f/394fe106ddfaf3067a4d828c7a8b2520/pa/JU92139_771beba37a16356b215203299212f172.jpg',
'https://img-pa.auto1.com/img39/4f/394fe106ddfaf3067a4d828c7a8b2520/pa/JU92139_01539fba771db7b8ec6d234381d64ba4.jpg',
'https://img-pa.auto1.com/img39/4f/394fe106ddfaf3067a4d828c7a8b2520/pa/JU92139_d76af3485897fe6fb26ea71f43418416.jpg',
'https://img-pa.auto1.com/img39/4f/394fe106ddfaf3067a4d828c7a8b2520/pa/JU92139_64468ae47da257870b3bcd19879baed4.jpg',
'https://img-pa.auto1.com/img39/4f/394fe106ddfaf3067a4d828c7a8b2520/pa/JU92139_2a7838aef07f3b1ef8d864c31b08d4d3.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5e260d9-3b71-5749-b77e-e15005e315c6/f5e260d9-3b71-5749-b77e-e15005e315c6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61288,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/4f/394fe106ddfaf3067a4d828c7a8b2520/pa/JU92139_fe9c8969a4f9da310b1c1335295784e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5e260d9-3b71-5749-b77e-e15005e315c6/f5e260d9-3b71-5749-b77e-e15005e315c6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59764,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/4f/394fe106ddfaf3067a4d828c7a8b2520/pa/JU92139_ee8a2744b4d593e1ef03081bf9c20753.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5e260d9-3b71-5749-b77e-e15005e315c6/f5e260d9-3b71-5749-b77e-e15005e315c6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63889,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/4f/394fe106ddfaf3067a4d828c7a8b2520/pa/JU92139_fc0e22c111895538d22e96fe87ec45c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5e260d9-3b71-5749-b77e-e15005e315c6/f5e260d9-3b71-5749-b77e-e15005e315c6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53287,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/4f/394fe106ddfaf3067a4d828c7a8b2520/pa/JU92139_2518b43d37ed58ca0cd5403dd63b194f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5e260d9-3b71-5749-b77e-e15005e315c6/f5e260d9-3b71-5749-b77e-e15005e315c6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61816,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/4f/394fe106ddfaf3067a4d828c7a8b2520/pa/JU92139_dff79d49cca05bf449f08d2480d0ae33.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5e260d9-3b71-5749-b77e-e15005e315c6/f5e260d9-3b71-5749-b77e-e15005e315c6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65698,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/4f/394fe106ddfaf3067a4d828c7a8b2520/pa/JU92139_771beba37a16356b215203299212f172.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5e260d9-3b71-5749-b77e-e15005e315c6/f5e260d9-3b71-5749-b77e-e15005e315c6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57591,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/4f/394fe106ddfaf3067a4d828c7a8b2520/pa/JU92139_01539fba771db7b8ec6d234381d64ba4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5e260d9-3b71-5749-b77e-e15005e315c6/f5e260d9-3b71-5749-b77e-e15005e315c6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65052,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/4f/394fe106ddfaf3067a4d828c7a8b2520/pa/JU92139_d76af3485897fe6fb26ea71f43418416.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5e260d9-3b71-5749-b77e-e15005e315c6/f5e260d9-3b71-5749-b77e-e15005e315c6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59967,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/4f/394fe106ddfaf3067a4d828c7a8b2520/pa/JU92139_64468ae47da257870b3bcd19879baed4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5e260d9-3b71-5749-b77e-e15005e315c6/f5e260d9-3b71-5749-b77e-e15005e315c6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63977,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/4f/394fe106ddfaf3067a4d828c7a8b2520/pa/JU92139_2a7838aef07f3b1ef8d864c31b08d4d3.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-08-30',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X1 xDrive 18d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2017}
2026-03-30 11:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JU92139%27 HTTP/1.1" 200 None
2026-03-30 11:20:50 [auto1.es] INFO: Saving data for JU92139: {'created_time': 1774869650.081719, 'last_price_update_time': 1774869650.081729, 'auction_closing_time': 1774969787.0}
2026-03-30 11:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JU92139') HTTP/1.1" 204 0
2026-03-30 11:20:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:20:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DX71922/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:20:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:21:04 [scrapy.extensions.logstats] INFO: Crawled 90 pages (at 6 pages/min), scraped 97 items (at 3 items/min)
2026-03-30 11:21:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 161MiB
2026-03-30 11:21:11 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 132.083(s), this was the 1st time calling it.
2026-03-30 11:21:11 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.226830594439301 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:21:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:21:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FK17944/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:21:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:21:27 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.618(s), this was the 1st time calling it.
2026-03-30 11:21:27 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.443126623903722 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:21:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VX61508/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:21:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:21:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:21:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HH14310/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:21:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:21:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JZ31691> (referer: https://www.auto1.com/v1/car-details-view/JZ31691/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:21:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:21:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5efc38a-380f-5dc8-b237-62816f43d356 with identifier: JZ31691
2026-03-30 11:21:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5efc38a-380f-5dc8-b237-62816f43d356 with scrape type 1
2026-03-30 11:21:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f5efc38a-380f-5dc8-b237-62816f43d356
2026-03-30 11:21:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Ffe%252Fd8fe0c0d784b49e4df9ceca7269629bd%252Fpa%252FJZ31691_dc69e9f7e0f9ea961f0e38a85f71a690.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_dc69e9f7e0f9ea961f0e38a85f71a690.jpg not downloaded yet
2026-03-30 11:21:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Ffe%252Fd8fe0c0d784b49e4df9ceca7269629bd%252Fpa%252FJZ31691_868fd2ef64a146ee13b10c5fb1a7f943.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_868fd2ef64a146ee13b10c5fb1a7f943.jpg not downloaded yet
2026-03-30 11:21:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Ffe%252Fd8fe0c0d784b49e4df9ceca7269629bd%252Fpa%252FJZ31691_76a740e133ddfe99c91df9c6b6a10944.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_76a740e133ddfe99c91df9c6b6a10944.jpg not downloaded yet
2026-03-30 11:21:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Ffe%252Fd8fe0c0d784b49e4df9ceca7269629bd%252Fpa%252FJZ31691_7d6e1a645168599ec9a26c207401215e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_7d6e1a645168599ec9a26c207401215e.jpg not downloaded yet
2026-03-30 11:21:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Ffe%252Fd8fe0c0d784b49e4df9ceca7269629bd%252Fpa%252FJZ31691_f56c54e7733b98687d4c2c99601d8e79.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_f56c54e7733b98687d4c2c99601d8e79.jpg not downloaded yet
2026-03-30 11:21:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Ffe%252Fd8fe0c0d784b49e4df9ceca7269629bd%252Fpa%252FJZ31691_2528dcd4389a53b3f748ec92bbc4d558.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_2528dcd4389a53b3f748ec92bbc4d558.jpg not downloaded yet
2026-03-30 11:21:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Ffe%252Fd8fe0c0d784b49e4df9ceca7269629bd%252Fpa%252FJZ31691_9fb8820a7ede240efcaf0d5fea58bfe3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_9fb8820a7ede240efcaf0d5fea58bfe3.jpg not downloaded yet
2026-03-30 11:21:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Ffe%252Fd8fe0c0d784b49e4df9ceca7269629bd%252Fpa%252FJZ31691_1b1b240279b2d88cd592d58c52e48e56.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_1b1b240279b2d88cd592d58c52e48e56.jpg not downloaded yet
2026-03-30 11:21:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Ffe%252Fd8fe0c0d784b49e4df9ceca7269629bd%252Fpa%252FJZ31691_b0bafcd9e1675b1ffbdba0a7af3d1886.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_b0bafcd9e1675b1ffbdba0a7af3d1886.jpg not downloaded yet
2026-03-30 11:21:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Ffe%252Fd8fe0c0d784b49e4df9ceca7269629bd%252Fpa%252FJZ31691_77c84089bcda327743214389c4e00a42.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_77c84089bcda327743214389c4e00a42.jpg not downloaded yet
2026-03-30 11:21:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GW76343> (referer: https://www.auto1.com/v1/car-details-view/GW76343/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:21:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:21:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3196182f-d35c-507b-a9fc-2fdb910ea802 with identifier: GW76343
2026-03-30 11:21:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3196182f-d35c-507b-a9fc-2fdb910ea802 with scrape type 1
2026-03-30 11:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3196182f-d35c-507b-a9fc-2fdb910ea802
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F71%252Ff4712b01cb6ca05c221101e9b66020c8%252Fpa%252FGW76343_dfb8eb7a9991dce9dddbd5215733de9e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_dfb8eb7a9991dce9dddbd5215733de9e.jpg not downloaded yet
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F71%252Ff4712b01cb6ca05c221101e9b66020c8%252Fpa%252FGW76343_18ccc727a64f2d5b3cef3615953cded1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_18ccc727a64f2d5b3cef3615953cded1.jpg not downloaded yet
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F71%252Ff4712b01cb6ca05c221101e9b66020c8%252Fpa%252FGW76343_86ee12f5948a7d8e88719e3e9101fc09.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_86ee12f5948a7d8e88719e3e9101fc09.jpg not downloaded yet
2026-03-30 11:21:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_77c84089bcda327743214389c4e00a42.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F71%252Ff4712b01cb6ca05c221101e9b66020c8%252Fpa%252FGW76343_277275a334d2c4892bef9b81e2daeb3d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_277275a334d2c4892bef9b81e2daeb3d.jpg not downloaded yet
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F71%252Ff4712b01cb6ca05c221101e9b66020c8%252Fpa%252FGW76343_873b9813ad08834d8a9d53f09188c060.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_873b9813ad08834d8a9d53f09188c060.jpg not downloaded yet
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F71%252Ff4712b01cb6ca05c221101e9b66020c8%252Fpa%252FGW76343_6fa7714089445becf2d08c88b3d6460e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_6fa7714089445becf2d08c88b3d6460e.jpg not downloaded yet
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F71%252Ff4712b01cb6ca05c221101e9b66020c8%252Fpa%252FGW76343_44da0f25091f63c47f11273ccda0b15b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_44da0f25091f63c47f11273ccda0b15b.jpg not downloaded yet
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F71%252Ff4712b01cb6ca05c221101e9b66020c8%252Fpa%252FGW76343_7cba4309c740820b658030965a4cd1b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_7cba4309c740820b658030965a4cd1b1.jpg not downloaded yet
2026-03-30 11:21:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_86ee12f5948a7d8e88719e3e9101fc09.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F71%252Ff4712b01cb6ca05c221101e9b66020c8%252Fpa%252FGW76343_8857e29e1869202151fbced416f9b0d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_8857e29e1869202151fbced416f9b0d8.jpg not downloaded yet
2026-03-30 11:21:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a42ced0>
2026-03-30 11:21:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5efc38a-380f-5dc8-b237-62816f43d356/f5efc38a-380f-5dc8-b237-62816f43d356_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Ffe%252Fd8fe0c0d784b49e4df9ceca7269629bd%252Fpa%252FJZ31691_77c84089bcda327743214389c4e00a42.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_77c84089bcda327743214389c4e00a42.jpg saved to cache
2026-03-30 11:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f5efc38a-380f-5dc8-b237-62816f43d356
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F71%252Ff4712b01cb6ca05c221101e9b66020c8%252Fpa%252FGW76343_0d968098d98fb28d1f2f6de75eb7d167.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_0d968098d98fb28d1f2f6de75eb7d167.jpg not downloaded yet
2026-03-30 11:21:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a334210>
2026-03-30 11:21:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3196182f-d35c-507b-a9fc-2fdb910ea802/3196182f-d35c-507b-a9fc-2fdb910ea802_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F71%252Ff4712b01cb6ca05c221101e9b66020c8%252Fpa%252FGW76343_86ee12f5948a7d8e88719e3e9101fc09.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_86ee12f5948a7d8e88719e3e9101fc09.jpg saved to cache
2026-03-30 11:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3196182f-d35c-507b-a9fc-2fdb910ea802
2026-03-30 11:21:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_7cba4309c740820b658030965a4cd1b1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_0d968098d98fb28d1f2f6de75eb7d167.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_8857e29e1869202151fbced416f9b0d8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060d6c450>
2026-03-30 11:21:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3196182f-d35c-507b-a9fc-2fdb910ea802/3196182f-d35c-507b-a9fc-2fdb910ea802_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F71%252Ff4712b01cb6ca05c221101e9b66020c8%252Fpa%252FGW76343_7cba4309c740820b658030965a4cd1b1.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_7cba4309c740820b658030965a4cd1b1.jpg saved to cache
2026-03-30 11:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3196182f-d35c-507b-a9fc-2fdb910ea802
2026-03-30 11:21:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_44da0f25091f63c47f11273ccda0b15b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a36e190>
2026-03-30 11:21:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3196182f-d35c-507b-a9fc-2fdb910ea802/3196182f-d35c-507b-a9fc-2fdb910ea802_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F71%252Ff4712b01cb6ca05c221101e9b66020c8%252Fpa%252FGW76343_0d968098d98fb28d1f2f6de75eb7d167.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_0d968098d98fb28d1f2f6de75eb7d167.jpg saved to cache
2026-03-30 11:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3196182f-d35c-507b-a9fc-2fdb910ea802
2026-03-30 11:21:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad43ad0>
2026-03-30 11:21:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3196182f-d35c-507b-a9fc-2fdb910ea802/3196182f-d35c-507b-a9fc-2fdb910ea802_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F71%252Ff4712b01cb6ca05c221101e9b66020c8%252Fpa%252FGW76343_8857e29e1869202151fbced416f9b0d8.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_8857e29e1869202151fbced416f9b0d8.jpg saved to cache
2026-03-30 11:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3196182f-d35c-507b-a9fc-2fdb910ea802
2026-03-30 11:21:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_6fa7714089445becf2d08c88b3d6460e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3d7d50>
2026-03-30 11:21:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3196182f-d35c-507b-a9fc-2fdb910ea802/3196182f-d35c-507b-a9fc-2fdb910ea802_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F71%252Ff4712b01cb6ca05c221101e9b66020c8%252Fpa%252FGW76343_44da0f25091f63c47f11273ccda0b15b.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_44da0f25091f63c47f11273ccda0b15b.jpg saved to cache
2026-03-30 11:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3196182f-d35c-507b-a9fc-2fdb910ea802
2026-03-30 11:21:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05aebbb90>
2026-03-30 11:21:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3196182f-d35c-507b-a9fc-2fdb910ea802/3196182f-d35c-507b-a9fc-2fdb910ea802_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F71%252Ff4712b01cb6ca05c221101e9b66020c8%252Fpa%252FGW76343_6fa7714089445becf2d08c88b3d6460e.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_6fa7714089445becf2d08c88b3d6460e.jpg saved to cache
2026-03-30 11:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3196182f-d35c-507b-a9fc-2fdb910ea802
2026-03-30 11:21:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_873b9813ad08834d8a9d53f09188c060.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_277275a334d2c4892bef9b81e2daeb3d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_18ccc727a64f2d5b3cef3615953cded1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3d6d50>
2026-03-30 11:21:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3196182f-d35c-507b-a9fc-2fdb910ea802/3196182f-d35c-507b-a9fc-2fdb910ea802_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F71%252Ff4712b01cb6ca05c221101e9b66020c8%252Fpa%252FGW76343_873b9813ad08834d8a9d53f09188c060.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_873b9813ad08834d8a9d53f09188c060.jpg saved to cache
2026-03-30 11:21:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3196182f-d35c-507b-a9fc-2fdb910ea802
2026-03-30 11:21:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_dfb8eb7a9991dce9dddbd5215733de9e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3d4650>
2026-03-30 11:21:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3196182f-d35c-507b-a9fc-2fdb910ea802/3196182f-d35c-507b-a9fc-2fdb910ea802_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F71%252Ff4712b01cb6ca05c221101e9b66020c8%252Fpa%252FGW76343_277275a334d2c4892bef9b81e2daeb3d.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_277275a334d2c4892bef9b81e2daeb3d.jpg saved to cache
2026-03-30 11:21:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3196182f-d35c-507b-a9fc-2fdb910ea802
2026-03-30 11:21:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a336250>
2026-03-30 11:21:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3196182f-d35c-507b-a9fc-2fdb910ea802/3196182f-d35c-507b-a9fc-2fdb910ea802_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F71%252Ff4712b01cb6ca05c221101e9b66020c8%252Fpa%252FGW76343_18ccc727a64f2d5b3cef3615953cded1.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_18ccc727a64f2d5b3cef3615953cded1.jpg saved to cache
2026-03-30 11:21:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3196182f-d35c-507b-a9fc-2fdb910ea802
2026-03-30 11:21:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_b0bafcd9e1675b1ffbdba0a7af3d1886.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a344b10>
2026-03-30 11:21:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3196182f-d35c-507b-a9fc-2fdb910ea802/3196182f-d35c-507b-a9fc-2fdb910ea802_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F71%252Ff4712b01cb6ca05c221101e9b66020c8%252Fpa%252FGW76343_dfb8eb7a9991dce9dddbd5215733de9e.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_dfb8eb7a9991dce9dddbd5215733de9e.jpg saved to cache
2026-03-30 11:21:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3196182f-d35c-507b-a9fc-2fdb910ea802
2026-03-30 11:21:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3196182f-d35c-507b-a9fc-2fdb910ea802, skipping ID generation
2026-03-30 11:21:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3196182f-d35c-507b-a9fc-2fdb910ea802 with scrape type 1
2026-03-30 11:21:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3196182f-d35c-507b-a9fc-2fdb910ea802 sending to next pipeline
2026-03-30 11:21:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3196182f-d35c-507b-a9fc-2fdb910ea802, identifier: GW76343
2026-03-30 11:21:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3196182f-d35c-507b-a9fc-2fdb910ea802 with identifier: GW76343
2026-03-30 11:21:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3196182f-d35c-507b-a9fc-2fdb910ea802 with identifier: GW76343
2026-03-30 11:21:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3196182f-d35c-507b-a9fc-2fdb910ea802 with identifier: GW76343 to the API
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:21:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_dfb8eb7a9991dce9dddbd5215733de9e.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 101,
'expiration_date': '2026-03-31T15:18:21Z',
'fuel_type': 'diesel',
'id': '3196182f-d35c-507b-a9fc-2fdb910ea802',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW76343',
'listing': 'auction',
'location': 'ES',
'make': 'Renault',
'model': 'Clio',
'odometer': 999999,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3196182f-d35c-507b-a9fc-2fdb910ea802/3196182f-d35c-507b-a9fc-2fdb910ea802_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76214,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_dfb8eb7a9991dce9dddbd5215733de9e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3196182f-d35c-507b-a9fc-2fdb910ea802/3196182f-d35c-507b-a9fc-2fdb910ea802_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76214,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_18ccc727a64f2d5b3cef3615953cded1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3196182f-d35c-507b-a9fc-2fdb910ea802/3196182f-d35c-507b-a9fc-2fdb910ea802_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97118,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_86ee12f5948a7d8e88719e3e9101fc09.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3196182f-d35c-507b-a9fc-2fdb910ea802/3196182f-d35c-507b-a9fc-2fdb910ea802_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97118,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_277275a334d2c4892bef9b81e2daeb3d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3196182f-d35c-507b-a9fc-2fdb910ea802/3196182f-d35c-507b-a9fc-2fdb910ea802_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96741,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_873b9813ad08834d8a9d53f09188c060.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3196182f-d35c-507b-a9fc-2fdb910ea802/3196182f-d35c-507b-a9fc-2fdb910ea802_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84973,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_6fa7714089445becf2d08c88b3d6460e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3196182f-d35c-507b-a9fc-2fdb910ea802/3196182f-d35c-507b-a9fc-2fdb910ea802_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76214,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_44da0f25091f63c47f11273ccda0b15b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3196182f-d35c-507b-a9fc-2fdb910ea802/3196182f-d35c-507b-a9fc-2fdb910ea802_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90145,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_7cba4309c740820b658030965a4cd1b1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3196182f-d35c-507b-a9fc-2fdb910ea802/3196182f-d35c-507b-a9fc-2fdb910ea802_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59547,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_8857e29e1869202151fbced416f9b0d8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3196182f-d35c-507b-a9fc-2fdb910ea802/3196182f-d35c-507b-a9fc-2fdb910ea802_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59547,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/71/f4712b01cb6ca05c221101e9b66020c8/pa/GW76343_0d968098d98fb28d1f2f6de75eb7d167.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2025-04-23',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Clio 1.5 BLUE dCi Evolution',
'transmission': 'manual',
'trim': 'Evolution',
'year': 2025}
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GW76343%27 HTTP/1.1" 200 None
2026-03-30 11:21:47 [auto1.es] INFO: Saving data for GW76343: {'created_time': 1774869707.7636, 'last_price_update_time': 1774869707.763611, 'auction_closing_time': 1774970301.0}
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GW76343') HTTP/1.1" 204 0
2026-03-30 11:21:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_1b1b240279b2d88cd592d58c52e48e56.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a32ced0>
2026-03-30 11:21:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5efc38a-380f-5dc8-b237-62816f43d356/f5efc38a-380f-5dc8-b237-62816f43d356_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Ffe%252Fd8fe0c0d784b49e4df9ceca7269629bd%252Fpa%252FJZ31691_b0bafcd9e1675b1ffbdba0a7af3d1886.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_b0bafcd9e1675b1ffbdba0a7af3d1886.jpg saved to cache
2026-03-30 11:21:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f5efc38a-380f-5dc8-b237-62816f43d356
2026-03-30 11:21:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a300e10>
2026-03-30 11:21:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5efc38a-380f-5dc8-b237-62816f43d356/f5efc38a-380f-5dc8-b237-62816f43d356_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Ffe%252Fd8fe0c0d784b49e4df9ceca7269629bd%252Fpa%252FJZ31691_1b1b240279b2d88cd592d58c52e48e56.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_1b1b240279b2d88cd592d58c52e48e56.jpg saved to cache
2026-03-30 11:21:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f5efc38a-380f-5dc8-b237-62816f43d356
2026-03-30 11:21:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_9fb8820a7ede240efcaf0d5fea58bfe3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a345d90>
2026-03-30 11:21:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5efc38a-380f-5dc8-b237-62816f43d356/f5efc38a-380f-5dc8-b237-62816f43d356_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Ffe%252Fd8fe0c0d784b49e4df9ceca7269629bd%252Fpa%252FJZ31691_9fb8820a7ede240efcaf0d5fea58bfe3.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_9fb8820a7ede240efcaf0d5fea58bfe3.jpg saved to cache
2026-03-30 11:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f5efc38a-380f-5dc8-b237-62816f43d356
2026-03-30 11:21:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_2528dcd4389a53b3f748ec92bbc4d558.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a303890>
2026-03-30 11:21:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5efc38a-380f-5dc8-b237-62816f43d356/f5efc38a-380f-5dc8-b237-62816f43d356_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Ffe%252Fd8fe0c0d784b49e4df9ceca7269629bd%252Fpa%252FJZ31691_2528dcd4389a53b3f748ec92bbc4d558.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_2528dcd4389a53b3f748ec92bbc4d558.jpg saved to cache
2026-03-30 11:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f5efc38a-380f-5dc8-b237-62816f43d356
2026-03-30 11:21:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_f56c54e7733b98687d4c2c99601d8e79.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_7d6e1a645168599ec9a26c207401215e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_76a740e133ddfe99c91df9c6b6a10944.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05aed5a50>
2026-03-30 11:21:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5efc38a-380f-5dc8-b237-62816f43d356/f5efc38a-380f-5dc8-b237-62816f43d356_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Ffe%252Fd8fe0c0d784b49e4df9ceca7269629bd%252Fpa%252FJZ31691_f56c54e7733b98687d4c2c99601d8e79.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_f56c54e7733b98687d4c2c99601d8e79.jpg saved to cache
2026-03-30 11:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f5efc38a-380f-5dc8-b237-62816f43d356
2026-03-30 11:21:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_868fd2ef64a146ee13b10c5fb1a7f943.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc06d4a01d0>
2026-03-30 11:21:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5efc38a-380f-5dc8-b237-62816f43d356/f5efc38a-380f-5dc8-b237-62816f43d356_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Ffe%252Fd8fe0c0d784b49e4df9ceca7269629bd%252Fpa%252FJZ31691_7d6e1a645168599ec9a26c207401215e.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_7d6e1a645168599ec9a26c207401215e.jpg saved to cache
2026-03-30 11:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f5efc38a-380f-5dc8-b237-62816f43d356
2026-03-30 11:21:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4f9f50>
2026-03-30 11:21:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5efc38a-380f-5dc8-b237-62816f43d356/f5efc38a-380f-5dc8-b237-62816f43d356_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Ffe%252Fd8fe0c0d784b49e4df9ceca7269629bd%252Fpa%252FJZ31691_76a740e133ddfe99c91df9c6b6a10944.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_76a740e133ddfe99c91df9c6b6a10944.jpg saved to cache
2026-03-30 11:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f5efc38a-380f-5dc8-b237-62816f43d356
2026-03-30 11:21:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_dc69e9f7e0f9ea961f0e38a85f71a690.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:21:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad51690>
2026-03-30 11:21:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5efc38a-380f-5dc8-b237-62816f43d356/f5efc38a-380f-5dc8-b237-62816f43d356_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Ffe%252Fd8fe0c0d784b49e4df9ceca7269629bd%252Fpa%252FJZ31691_868fd2ef64a146ee13b10c5fb1a7f943.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_868fd2ef64a146ee13b10c5fb1a7f943.jpg saved to cache
2026-03-30 11:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f5efc38a-380f-5dc8-b237-62816f43d356
2026-03-30 11:21:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:21:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ae819d0>
2026-03-30 11:21:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:21:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:21:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:21:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5efc38a-380f-5dc8-b237-62816f43d356/f5efc38a-380f-5dc8-b237-62816f43d356_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Ffe%252Fd8fe0c0d784b49e4df9ceca7269629bd%252Fpa%252FJZ31691_dc69e9f7e0f9ea961f0e38a85f71a690.jpg') HTTP/1.1" 204 0
2026-03-30 11:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_dc69e9f7e0f9ea961f0e38a85f71a690.jpg saved to cache
2026-03-30 11:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f5efc38a-380f-5dc8-b237-62816f43d356
2026-03-30 11:21:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f5efc38a-380f-5dc8-b237-62816f43d356, skipping ID generation
2026-03-30 11:21:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5efc38a-380f-5dc8-b237-62816f43d356 with scrape type 1
2026-03-30 11:21:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f5efc38a-380f-5dc8-b237-62816f43d356 sending to next pipeline
2026-03-30 11:21:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f5efc38a-380f-5dc8-b237-62816f43d356, identifier: JZ31691
2026-03-30 11:21:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f5efc38a-380f-5dc8-b237-62816f43d356 with identifier: JZ31691
2026-03-30 11:21:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f5efc38a-380f-5dc8-b237-62816f43d356 with identifier: JZ31691
2026-03-30 11:21:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f5efc38a-380f-5dc8-b237-62816f43d356 with identifier: JZ31691 to the API
2026-03-30 11:21:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:21:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:21:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_dc69e9f7e0f9ea961f0e38a85f71a690.jpg>
{'auction_title': '',
'c_o_2_emission_value': 100,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:01:50Z',
'fuel_type': 'diesel',
'id': 'f5efc38a-380f-5dc8-b237-62816f43d356',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ31691',
'listing': 'auction',
'location': 'ES, Seseña, Toledo',
'make': 'Peugeot',
'model': '308',
'odometer': 211342,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5efc38a-380f-5dc8-b237-62816f43d356/f5efc38a-380f-5dc8-b237-62816f43d356_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91526,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_dc69e9f7e0f9ea961f0e38a85f71a690.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5efc38a-380f-5dc8-b237-62816f43d356/f5efc38a-380f-5dc8-b237-62816f43d356_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91733,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_868fd2ef64a146ee13b10c5fb1a7f943.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5efc38a-380f-5dc8-b237-62816f43d356/f5efc38a-380f-5dc8-b237-62816f43d356_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80857,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_76a740e133ddfe99c91df9c6b6a10944.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5efc38a-380f-5dc8-b237-62816f43d356/f5efc38a-380f-5dc8-b237-62816f43d356_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75716,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_7d6e1a645168599ec9a26c207401215e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5efc38a-380f-5dc8-b237-62816f43d356/f5efc38a-380f-5dc8-b237-62816f43d356_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64806,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_f56c54e7733b98687d4c2c99601d8e79.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5efc38a-380f-5dc8-b237-62816f43d356/f5efc38a-380f-5dc8-b237-62816f43d356_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72817,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_2528dcd4389a53b3f748ec92bbc4d558.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5efc38a-380f-5dc8-b237-62816f43d356/f5efc38a-380f-5dc8-b237-62816f43d356_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58439,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_9fb8820a7ede240efcaf0d5fea58bfe3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5efc38a-380f-5dc8-b237-62816f43d356/f5efc38a-380f-5dc8-b237-62816f43d356_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74577,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_1b1b240279b2d88cd592d58c52e48e56.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5efc38a-380f-5dc8-b237-62816f43d356/f5efc38a-380f-5dc8-b237-62816f43d356_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76972,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_b0bafcd9e1675b1ffbdba0a7af3d1886.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5efc38a-380f-5dc8-b237-62816f43d356/f5efc38a-380f-5dc8-b237-62816f43d356_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60733,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/fe/d8fe0c0d784b49e4df9ceca7269629bd/pa/JZ31691_77c84089bcda327743214389c4e00a42.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-03-22',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.6 e-HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2015}
2026-03-30 11:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JZ31691%27 HTTP/1.1" 200 None
2026-03-30 11:21:49 [auto1.es] INFO: Saving data for JZ31691: {'created_time': 1774869709.397057, 'last_price_update_time': 1774869709.397071, 'auction_closing_time': 1774969310.0}
2026-03-30 11:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JZ31691') HTTP/1.1" 204 0
2026-03-30 11:21:50 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.496(s), this was the 1st time calling it.
2026-03-30 11:21:50 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.167599765090619 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:21:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:22:04 [scrapy.extensions.logstats] INFO: Crawled 95 pages (at 5 pages/min), scraped 99 items (at 2 items/min)
2026-03-30 11:22:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 161MiB
2026-03-30 11:22:14 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.930(s), this was the 1st time calling it.
2026-03-30 11:22:14 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.648184024489287 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:22:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:22:27 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.642(s), this was the 1st time calling it.
2026-03-30 11:22:27 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.9242762111922955 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:22:27 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 262.358(s), this was the 2nd time calling it.
2026-03-30 11:22:27 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.292414321134503 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:22:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WR66787/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:22:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:31 [auto1.es] INFO: Channel: 24h | Page: 7 | totalHits: 2225 | hits on page: 40
2026-03-30 11:22:31 [auto1.es] INFO: Found listing with ID: WA83651
2026-03-30 11:22:31 [auto1.es] INFO: Found listing with ID: WL52368
2026-03-30 11:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WL52368%27 HTTP/1.1" 200 None
2026-03-30 11:22:31 [auto1.es] INFO: Scrape type for WL52368: 0
2026-03-30 11:22:31 [auto1.es] INFO: Found listing with ID: BX88029
2026-03-30 11:22:31 [auto1.es] INFO: Found listing with ID: UZ66881
2026-03-30 11:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UZ66881%27 HTTP/1.1" 200 None
2026-03-30 11:22:31 [auto1.es] INFO: Scrape type for UZ66881: 0
2026-03-30 11:22:31 [auto1.es] INFO: Found listing with ID: BL63813
2026-03-30 11:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BL63813%27 HTTP/1.1" 200 None
2026-03-30 11:22:31 [auto1.es] INFO: Scrape type for BL63813: 0
2026-03-30 11:22:31 [auto1.es] INFO: Found listing with ID: TU33340
2026-03-30 11:22:31 [auto1.es] INFO: Found listing with ID: DV32133
2026-03-30 11:22:31 [auto1.es] INFO: Found listing with ID: ZE12212
2026-03-30 11:22:31 [auto1.es] INFO: Found listing with ID: RX15442
2026-03-30 11:22:31 [auto1.es] INFO: Found listing with ID: ER99924
2026-03-30 11:22:31 [auto1.es] INFO: Found listing with ID: KW14097
2026-03-30 11:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KW14097%27 HTTP/1.1" 200 None
2026-03-30 11:22:31 [auto1.es] INFO: Scrape type for KW14097: 0
2026-03-30 11:22:31 [auto1.es] INFO: Found listing with ID: VE04719
2026-03-30 11:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VE04719%27 HTTP/1.1" 200 None
2026-03-30 11:22:31 [auto1.es] INFO: Scrape type for VE04719: 0
2026-03-30 11:22:31 [auto1.es] INFO: Found listing with ID: AJ63740
2026-03-30 11:22:31 [auto1.es] INFO: Found listing with ID: TM33190
2026-03-30 11:22:31 [auto1.es] INFO: Found listing with ID: TE55978
2026-03-30 11:22:31 [auto1.es] INFO: Found listing with ID: SA67244
2026-03-30 11:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SA67244%27 HTTP/1.1" 200 None
2026-03-30 11:22:32 [auto1.es] INFO: Scrape type for SA67244: 1
2026-03-30 11:22:32 [auto1.es] INFO: Found listing with ID: DG64903
2026-03-30 11:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DG64903%27 HTTP/1.1" 200 None
2026-03-30 11:22:32 [auto1.es] INFO: Scrape type for DG64903: 2
2026-03-30 11:22:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b23ebf95-31eb-5c82-8323-698822098da3 with identifier: DG64903
2026-03-30 11:22:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b23ebf95-31eb-5c82-8323-698822098da3 with scrape type 2
2026-03-30 11:22:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b23ebf95-31eb-5c82-8323-698822098da3 with scrape type 2
2026-03-30 11:22:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b23ebf95-31eb-5c82-8323-698822098da3, identifier: DG64903
2026-03-30 11:22:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b23ebf95-31eb-5c82-8323-698822098da3 with identifier: DG64903
2026-03-30 11:22:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b23ebf95-31eb-5c82-8323-698822098da3 with identifier: DG64903
2026-03-30 11:22:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b23ebf95-31eb-5c82-8323-698822098da3 with identifier: DG64903 to the API
2026-03-30 11:22:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:22:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:22:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 224,
'expiration_date': '2026-03-31T15:19:35Z',
'fuel_type': 'hybrid',
'id': 'b23ebf95-31eb-5c82-8323-698822098da3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG64903',
'listing': 'auction',
'make': 'DS Automobiles',
'model': 'DS4',
'odometer': 8778,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-25',
'seller_name': None,
'title': 'DS Automobiles DS4 1.6 E-Tense Hybrid Trocadero',
'transmission': 'automatic',
'trim': 'Trocadero',
'year': 2023}
2026-03-30 11:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DG64903%27 HTTP/1.1" 200 None
2026-03-30 11:22:32 [auto1.es] INFO: Saving data for DG64903: {'auction_closing_time': 1774970375.0, 'created_time': 1773131099.859072, 'last_price_update_time': 1774869752.702067}
2026-03-30 11:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DG64903') HTTP/1.1" 204 0
2026-03-30 11:22:32 [auto1.es] INFO: Found listing with ID: YE59618
2026-03-30 11:22:32 [auto1.es] INFO: Found listing with ID: SN21821
2026-03-30 11:22:32 [auto1.es] INFO: Found listing with ID: YP50704
2026-03-30 11:22:32 [auto1.es] INFO: Found listing with ID: AE33071
2026-03-30 11:22:32 [auto1.es] INFO: Found listing with ID: EY16008
2026-03-30 11:22:32 [auto1.es] INFO: Found listing with ID: RC12425
2026-03-30 11:22:32 [auto1.es] INFO: Found listing with ID: WB62155
2026-03-30 11:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WB62155%27 HTTP/1.1" 200 None
2026-03-30 11:22:32 [auto1.es] INFO: Scrape type for WB62155: 2
2026-03-30 11:22:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a1f0488-e5d5-5c75-95dd-02d0938edf61 with identifier: WB62155
2026-03-30 11:22:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a1f0488-e5d5-5c75-95dd-02d0938edf61 with scrape type 2
2026-03-30 11:22:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a1f0488-e5d5-5c75-95dd-02d0938edf61 with scrape type 2
2026-03-30 11:22:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3a1f0488-e5d5-5c75-95dd-02d0938edf61, identifier: WB62155
2026-03-30 11:22:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3a1f0488-e5d5-5c75-95dd-02d0938edf61 with identifier: WB62155
2026-03-30 11:22:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3a1f0488-e5d5-5c75-95dd-02d0938edf61 with identifier: WB62155
2026-03-30 11:22:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3a1f0488-e5d5-5c75-95dd-02d0938edf61 with identifier: WB62155 to the API
2026-03-30 11:22:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:22:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:22:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:56:29Z',
'fuel_type': 'petrol',
'id': '3a1f0488-e5d5-5c75-95dd-02d0938edf61',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB62155',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 25429,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-26',
'seller_name': None,
'title': 'Opel Astra 1.2 Turbo GS Line',
'transmission': 'manual',
'trim': 'GS Line',
'year': 2023}
2026-03-30 11:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WB62155%27 HTTP/1.1" 200 None
2026-03-30 11:22:33 [auto1.es] INFO: Saving data for WB62155: {'auction_closing_time': 1774972589.0, 'created_time': 1773130259.619267, 'last_price_update_time': 1774869753.384312}
2026-03-30 11:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WB62155') HTTP/1.1" 204 0
2026-03-30 11:22:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 11:22:33 [auto1.es] INFO: Found listing with ID: ZR40213
2026-03-30 11:22:33 [auto1.es] INFO: Found listing with ID: BZ14545
2026-03-30 11:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BZ14545%27 HTTP/1.1" 200 None
2026-03-30 11:22:33 [auto1.es] INFO: Scrape type for BZ14545: 2
2026-03-30 11:22:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2443bad3-e85d-51ce-bd94-b12fe801d728 with identifier: BZ14545
2026-03-30 11:22:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2443bad3-e85d-51ce-bd94-b12fe801d728 with scrape type 2
2026-03-30 11:22:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2443bad3-e85d-51ce-bd94-b12fe801d728 with scrape type 2
2026-03-30 11:22:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2443bad3-e85d-51ce-bd94-b12fe801d728, identifier: BZ14545
2026-03-30 11:22:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2443bad3-e85d-51ce-bd94-b12fe801d728 with identifier: BZ14545
2026-03-30 11:22:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2443bad3-e85d-51ce-bd94-b12fe801d728 with identifier: BZ14545
2026-03-30 11:22:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2443bad3-e85d-51ce-bd94-b12fe801d728 with identifier: BZ14545 to the API
2026-03-30 11:22:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:22:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:22:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 102,
'expiration_date': '2026-03-31T15:46:43Z',
'fuel_type': 'diesel',
'id': '2443bad3-e85d-51ce-bd94-b12fe801d728',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ14545',
'listing': 'auction',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 65979,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-19',
'seller_name': None,
'title': 'Citroen Berlingo 1.5 Blue-HDi Contrlol M',
'transmission': 'manual',
'trim': 'Contrlol M',
'year': 2021}
2026-03-30 11:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BZ14545%27 HTTP/1.1" 200 None
2026-03-30 11:22:33 [auto1.es] INFO: Saving data for BZ14545: {'auction_closing_time': 1774972003.0, 'created_time': 1773131300.478276, 'last_price_update_time': 1774869753.892362}
2026-03-30 11:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BZ14545') HTTP/1.1" 204 0
2026-03-30 11:22:33 [auto1.es] INFO: Found listing with ID: GV98075
2026-03-30 11:22:33 [auto1.es] INFO: Found listing with ID: ZH49347
2026-03-30 11:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZH49347%27 HTTP/1.1" 200 None
2026-03-30 11:22:33 [auto1.es] INFO: Scrape type for ZH49347: 2
2026-03-30 11:22:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40c082ff-2292-5b3f-aedf-f4a82705f931 with identifier: ZH49347
2026-03-30 11:22:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40c082ff-2292-5b3f-aedf-f4a82705f931 with scrape type 2
2026-03-30 11:22:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40c082ff-2292-5b3f-aedf-f4a82705f931 with scrape type 2
2026-03-30 11:22:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 40c082ff-2292-5b3f-aedf-f4a82705f931, identifier: ZH49347
2026-03-30 11:22:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 40c082ff-2292-5b3f-aedf-f4a82705f931 with identifier: ZH49347
2026-03-30 11:22:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 40c082ff-2292-5b3f-aedf-f4a82705f931 with identifier: ZH49347
2026-03-30 11:22:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 40c082ff-2292-5b3f-aedf-f4a82705f931 with identifier: ZH49347 to the API
2026-03-30 11:22:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:22:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:22:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-31T15:07:28Z',
'fuel_type': 'diesel',
'id': '40c082ff-2292-5b3f-aedf-f4a82705f931',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH49347',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 196858,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-26',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Ready2Go',
'transmission': 'manual',
'trim': 'Ready2Go',
'year': 2019}
2026-03-30 11:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZH49347%27 HTTP/1.1" 200 None
2026-03-30 11:22:34 [auto1.es] INFO: Saving data for ZH49347: {'auction_closing_time': 1774969648.0, 'created_time': 1774274795.695806, 'last_price_update_time': 1774869754.475041}
2026-03-30 11:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZH49347') HTTP/1.1" 204 0
2026-03-30 11:22:34 [auto1.es] INFO: Found listing with ID: ZK94271
2026-03-30 11:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZK94271%27 HTTP/1.1" 200 None
2026-03-30 11:22:34 [auto1.es] INFO: Scrape type for ZK94271: 2
2026-03-30 11:22:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1b7d9e7-3e73-5367-98a4-ab831eb8b100 with identifier: ZK94271
2026-03-30 11:22:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1b7d9e7-3e73-5367-98a4-ab831eb8b100 with scrape type 2
2026-03-30 11:22:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1b7d9e7-3e73-5367-98a4-ab831eb8b100 with scrape type 2
2026-03-30 11:22:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c1b7d9e7-3e73-5367-98a4-ab831eb8b100, identifier: ZK94271
2026-03-30 11:22:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c1b7d9e7-3e73-5367-98a4-ab831eb8b100 with identifier: ZK94271
2026-03-30 11:22:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c1b7d9e7-3e73-5367-98a4-ab831eb8b100 with identifier: ZK94271
2026-03-30 11:22:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c1b7d9e7-3e73-5367-98a4-ab831eb8b100 with identifier: ZK94271 to the API
2026-03-30 11:22:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:22:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:22:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-31T15:53:18Z',
'fuel_type': 'diesel',
'id': 'c1b7d9e7-3e73-5367-98a4-ab831eb8b100',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK94271',
'listing': 'auction',
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 231377,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-06-27',
'seller_name': None,
'title': 'Toyota RAV 4 2.2 Turbodiesel',
'transmission': 'manual',
'trim': '',
'year': 2007}
2026-03-30 11:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZK94271%27 HTTP/1.1" 200 None
2026-03-30 11:22:35 [auto1.es] INFO: Saving data for ZK94271: {'auction_closing_time': 1774972398.0, 'created_time': 1772890222.614846, 'last_price_update_time': 1774869755.685503}
2026-03-30 11:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZK94271') HTTP/1.1" 204 0
2026-03-30 11:22:35 [auto1.es] INFO: Found listing with ID: YL98507
2026-03-30 11:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YL98507%27 HTTP/1.1" 200 None
2026-03-30 11:22:35 [auto1.es] INFO: Scrape type for YL98507: 2
2026-03-30 11:22:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0c29b3a-17a6-56c7-86c8-2ee1ec9e0457 with identifier: YL98507
2026-03-30 11:22:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0c29b3a-17a6-56c7-86c8-2ee1ec9e0457 with scrape type 2
2026-03-30 11:22:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0c29b3a-17a6-56c7-86c8-2ee1ec9e0457 with scrape type 2
2026-03-30 11:22:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b0c29b3a-17a6-56c7-86c8-2ee1ec9e0457, identifier: YL98507
2026-03-30 11:22:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b0c29b3a-17a6-56c7-86c8-2ee1ec9e0457 with identifier: YL98507
2026-03-30 11:22:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b0c29b3a-17a6-56c7-86c8-2ee1ec9e0457 with identifier: YL98507
2026-03-30 11:22:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b0c29b3a-17a6-56c7-86c8-2ee1ec9e0457 with identifier: YL98507 to the API
2026-03-30 11:22:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:22:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:22:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:51:35Z',
'fuel_type': 'diesel',
'id': 'b0c29b3a-17a6-56c7-86c8-2ee1ec9e0457',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL98507',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 29039,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-06-23',
'seller_name': None,
'title': 'Opel Astra 1.5 CDTI GS',
'transmission': 'automatic',
'trim': 'GS',
'year': 2024}
2026-03-30 11:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YL98507%27 HTTP/1.1" 200 None
2026-03-30 11:22:36 [auto1.es] INFO: Saving data for YL98507: {'auction_closing_time': 1774972295.0, 'created_time': 1773131224.864423, 'last_price_update_time': 1774869756.314209}
2026-03-30 11:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YL98507') HTTP/1.1" 204 0
2026-03-30 11:22:36 [auto1.es] INFO: Found listing with ID: VH15293
2026-03-30 11:22:36 [auto1.es] INFO: Found listing with ID: KX02596
2026-03-30 11:22:36 [auto1.es] INFO: Found listing with ID: FE56951
2026-03-30 11:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FE56951%27 HTTP/1.1" 200 None
2026-03-30 11:22:36 [auto1.es] INFO: Scrape type for FE56951: 2
2026-03-30 11:22:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b55d219-11b3-55d1-8a23-fa27348d05f0 with identifier: FE56951
2026-03-30 11:22:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b55d219-11b3-55d1-8a23-fa27348d05f0 with scrape type 2
2026-03-30 11:22:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b55d219-11b3-55d1-8a23-fa27348d05f0 with scrape type 2
2026-03-30 11:22:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3b55d219-11b3-55d1-8a23-fa27348d05f0, identifier: FE56951
2026-03-30 11:22:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3b55d219-11b3-55d1-8a23-fa27348d05f0 with identifier: FE56951
2026-03-30 11:22:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3b55d219-11b3-55d1-8a23-fa27348d05f0 with identifier: FE56951
2026-03-30 11:22:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3b55d219-11b3-55d1-8a23-fa27348d05f0 with identifier: FE56951 to the API
2026-03-30 11:22:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:22:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:22:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:43:37Z',
'fuel_type': 'petrol',
'id': '3b55d219-11b3-55d1-8a23-fa27348d05f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE56951',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3 Aircross',
'odometer': 39634,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-07',
'seller_name': None,
'title': 'Citroen C3 Aircross 1.2 PureTech Feel',
'transmission': 'manual',
'trim': 'Feel',
'year': 2021}
2026-03-30 11:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FE56951%27 HTTP/1.1" 200 None
2026-03-30 11:22:36 [auto1.es] INFO: Saving data for FE56951: {'auction_closing_time': 1774971817.0, 'created_time': 1773131132.90541, 'last_price_update_time': 1774869756.801437}
2026-03-30 11:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FE56951') HTTP/1.1" 204 0
2026-03-30 11:22:36 [auto1.es] INFO: Found listing with ID: RD14633
2026-03-30 11:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD14633%27 HTTP/1.1" 200 None
2026-03-30 11:22:36 [auto1.es] INFO: Scrape type for RD14633: 2
2026-03-30 11:22:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5424e1de-4815-5eeb-9e75-6f2c0bbdc1cf with identifier: RD14633
2026-03-30 11:22:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5424e1de-4815-5eeb-9e75-6f2c0bbdc1cf with scrape type 2
2026-03-30 11:22:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5424e1de-4815-5eeb-9e75-6f2c0bbdc1cf with scrape type 2
2026-03-30 11:22:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5424e1de-4815-5eeb-9e75-6f2c0bbdc1cf, identifier: RD14633
2026-03-30 11:22:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5424e1de-4815-5eeb-9e75-6f2c0bbdc1cf with identifier: RD14633
2026-03-30 11:22:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5424e1de-4815-5eeb-9e75-6f2c0bbdc1cf with identifier: RD14633
2026-03-30 11:22:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5424e1de-4815-5eeb-9e75-6f2c0bbdc1cf with identifier: RD14633 to the API
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:22:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:47:06Z',
'fuel_type': 'petrol',
'id': '5424e1de-4815-5eeb-9e75-6f2c0bbdc1cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD14633',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 19440,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-20',
'seller_name': None,
'title': 'Peugeot 308 1.2 PureTech Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2023}
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD14633%27 HTTP/1.1" 200 None
2026-03-30 11:22:37 [auto1.es] INFO: Saving data for RD14633: {'auction_closing_time': 1774972026.0, 'created_time': 1773131334.589563, 'last_price_update_time': 1774869757.345548}
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RD14633') HTTP/1.1" 204 0
2026-03-30 11:22:37 [auto1.es] INFO: Found listing with ID: AJ53679
2026-03-30 11:22:37 [auto1.es] INFO: Found listing with ID: AX54555
2026-03-30 11:22:37 [auto1.es] INFO: Found listing with ID: UA88301
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UA88301%27 HTTP/1.1" 200 None
2026-03-30 11:22:37 [auto1.es] INFO: Scrape type for UA88301: 2
2026-03-30 11:22:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17e39c35-fd8a-519c-abf7-eae4834cdeef with identifier: UA88301
2026-03-30 11:22:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17e39c35-fd8a-519c-abf7-eae4834cdeef with scrape type 2
2026-03-30 11:22:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17e39c35-fd8a-519c-abf7-eae4834cdeef with scrape type 2
2026-03-30 11:22:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 17e39c35-fd8a-519c-abf7-eae4834cdeef, identifier: UA88301
2026-03-30 11:22:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 17e39c35-fd8a-519c-abf7-eae4834cdeef with identifier: UA88301
2026-03-30 11:22:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 17e39c35-fd8a-519c-abf7-eae4834cdeef with identifier: UA88301
2026-03-30 11:22:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 17e39c35-fd8a-519c-abf7-eae4834cdeef with identifier: UA88301 to the API
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:22:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:22:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-31T15:05:06Z',
'fuel_type': 'petrol',
'id': '17e39c35-fd8a-519c-abf7-eae4834cdeef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA88301',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 151402,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-28',
'seller_name': None,
'title': 'Ford Focus 1.0 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2016}
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UA88301%27 HTTP/1.1" 200 None
2026-03-30 11:22:38 [auto1.es] INFO: Saving data for UA88301: {'auction_closing_time': 1774969506.0, 'created_time': 1774264034.26157, 'last_price_update_time': 1774869758.052652}
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UA88301') HTTP/1.1" 204 0
2026-03-30 11:22:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JZ58453/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:38 [auto1.es] INFO: Found listing with ID: FN90345
2026-03-30 11:22:38 [auto1.es] INFO: Found listing with ID: TT54847
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TT54847%27 HTTP/1.1" 200 None
2026-03-30 11:22:38 [auto1.es] INFO: Scrape type for TT54847: 2
2026-03-30 11:22:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62d61d3c-bfef-5de2-a41c-d140c88f9276 with identifier: TT54847
2026-03-30 11:22:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62d61d3c-bfef-5de2-a41c-d140c88f9276 with scrape type 2
2026-03-30 11:22:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62d61d3c-bfef-5de2-a41c-d140c88f9276 with scrape type 2
2026-03-30 11:22:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 62d61d3c-bfef-5de2-a41c-d140c88f9276, identifier: TT54847
2026-03-30 11:22:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 62d61d3c-bfef-5de2-a41c-d140c88f9276 with identifier: TT54847
2026-03-30 11:22:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 62d61d3c-bfef-5de2-a41c-d140c88f9276 with identifier: TT54847
2026-03-30 11:22:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 62d61d3c-bfef-5de2-a41c-d140c88f9276 with identifier: TT54847 to the API
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:22:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 155,
'expiration_date': '2026-03-31T15:11:44Z',
'fuel_type': 'petrol',
'id': '62d61d3c-bfef-5de2-a41c-d140c88f9276',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT54847',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4',
'odometer': 209879,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-07',
'seller_name': None,
'title': 'Citroen C4 1.6 Exclusive',
'transmission': 'automatic',
'trim': 'Exclusive',
'year': 2011}
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TT54847%27 HTTP/1.1" 200 None
2026-03-30 11:22:38 [auto1.es] INFO: Saving data for TT54847: {'auction_closing_time': 1774969904.0, 'created_time': 1774264027.901952, 'last_price_update_time': 1774869758.625276}
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TT54847') HTTP/1.1" 204 0
2026-03-30 11:22:38 [auto1.es] INFO: Found listing with ID: VV73300
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV73300%27 HTTP/1.1" 200 None
2026-03-30 11:22:38 [auto1.es] INFO: Scrape type for VV73300: 2
2026-03-30 11:22:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc6ae31f-6cf3-5c5f-91f5-a878272f8b4d with identifier: VV73300
2026-03-30 11:22:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc6ae31f-6cf3-5c5f-91f5-a878272f8b4d with scrape type 2
2026-03-30 11:22:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc6ae31f-6cf3-5c5f-91f5-a878272f8b4d with scrape type 2
2026-03-30 11:22:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dc6ae31f-6cf3-5c5f-91f5-a878272f8b4d, identifier: VV73300
2026-03-30 11:22:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dc6ae31f-6cf3-5c5f-91f5-a878272f8b4d with identifier: VV73300
2026-03-30 11:22:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dc6ae31f-6cf3-5c5f-91f5-a878272f8b4d with identifier: VV73300
2026-03-30 11:22:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dc6ae31f-6cf3-5c5f-91f5-a878272f8b4d with identifier: VV73300 to the API
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:22:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 184,
'expiration_date': '2026-03-31T15:22:46Z',
'fuel_type': 'hybrid',
'id': 'dc6ae31f-6cf3-5c5f-91f5-a878272f8b4d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV73300',
'listing': 'auction',
'make': 'Lexus',
'model': 'UX-Serie',
'odometer': 76710,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-21',
'seller_name': None,
'title': 'Lexus UX-Serie UX 250h Eco',
'transmission': 'automatic',
'trim': 'Eco',
'year': 2022}
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV73300%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.es] INFO: Saving data for VV73300: {'auction_closing_time': 1774970566.0, 'created_time': 1773131176.980672, 'last_price_update_time': 1774869759.502353}
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VV73300') HTTP/1.1" 204 0
2026-03-30 11:22:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LH46678/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VR33132> (referer: https://www.auto1.com/v1/car-details-view/VR33132/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8e29383-7fd5-50c8-a4b7-6ff3bf6df604 with identifier: VR33132
2026-03-30 11:22:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8e29383-7fd5-50c8-a4b7-6ff3bf6df604 with scrape type 1
2026-03-30 11:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b8e29383-7fd5-50c8-a4b7-6ff3bf6df604
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fe6%252F37e6a37f14d8334c291eaee97046e171%252Fpa%252FVR33132_6d59fe8945c3290137f6b4f2aadabca7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_6d59fe8945c3290137f6b4f2aadabca7.jpg not downloaded yet
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fe6%252F37e6a37f14d8334c291eaee97046e171%252Fpa%252FVR33132_be2529c140a3cb3e7d212a5852306ac2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_be2529c140a3cb3e7d212a5852306ac2.jpg not downloaded yet
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fe6%252F37e6a37f14d8334c291eaee97046e171%252Fpa%252FVR33132_09446496d6aa321c80a850787b6a0a9a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_09446496d6aa321c80a850787b6a0a9a.jpg not downloaded yet
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fe6%252F37e6a37f14d8334c291eaee97046e171%252Fpa%252FVR33132_b66953878131a03f1737a1993805df1d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_b66953878131a03f1737a1993805df1d.jpg not downloaded yet
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fe6%252F37e6a37f14d8334c291eaee97046e171%252Fpa%252FVR33132_f1c4479a9ad5aace39f2a20e6d273b65.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_f1c4479a9ad5aace39f2a20e6d273b65.jpg not downloaded yet
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fe6%252F37e6a37f14d8334c291eaee97046e171%252Fpa%252FVR33132_b8d150b4eea7597322312e8580190be8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_b8d150b4eea7597322312e8580190be8.jpg not downloaded yet
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fe6%252F37e6a37f14d8334c291eaee97046e171%252Fpa%252FVR33132_208be5bf29d7f6099101d3534522eeee.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_208be5bf29d7f6099101d3534522eeee.jpg not downloaded yet
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fe6%252F37e6a37f14d8334c291eaee97046e171%252Fpa%252FVR33132_854fde9d624f6e1dab421014918fa60b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_854fde9d624f6e1dab421014918fa60b.jpg not downloaded yet
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fe6%252F37e6a37f14d8334c291eaee97046e171%252Fpa%252FVR33132_d12310a5974461967a9d2732b2403e36.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_d12310a5974461967a9d2732b2403e36.jpg not downloaded yet
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fe6%252F37e6a37f14d8334c291eaee97046e171%252Fpa%252FVR33132_263638c708891e328a02d3ef07dd444e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_263638c708891e328a02d3ef07dd444e.jpg not downloaded yet
2026-03-30 11:22:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FK17944> (referer: https://www.auto1.com/v1/car-details-view/FK17944/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29200403-bd9c-5765-b812-23e5662618fc with identifier: FK17944
2026-03-30 11:22:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29200403-bd9c-5765-b812-23e5662618fc with scrape type 1
2026-03-30 11:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 29200403-bd9c-5765-b812-23e5662618fc
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F5b%252Fbe5bd569bcd6bfae90d5557d39db307a%252Fpa%252FFK17944_ae609e7da9190c9e38c72a6fc31fd2b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/5b/be5bd569bcd6bfae90d5557d39db307a/pa/FK17944_ae609e7da9190c9e38c72a6fc31fd2b3.jpg already downloaded
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F5b%252Fbe5bd569bcd6bfae90d5557d39db307a%252Fpa%252FFK17944_0ee47f6a6bf60e1314c0a7cc0ebdce49.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/5b/be5bd569bcd6bfae90d5557d39db307a/pa/FK17944_0ee47f6a6bf60e1314c0a7cc0ebdce49.jpg already downloaded
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F5b%252Fbe5bd569bcd6bfae90d5557d39db307a%252Fpa%252FFK17944_5516244c7b380b94a5b110c83c89ac4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/5b/be5bd569bcd6bfae90d5557d39db307a/pa/FK17944_5516244c7b380b94a5b110c83c89ac4a.jpg already downloaded
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F5b%252Fbe5bd569bcd6bfae90d5557d39db307a%252Fpa%252FFK17944_602cdd056467a2045047512e56876389.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/5b/be5bd569bcd6bfae90d5557d39db307a/pa/FK17944_602cdd056467a2045047512e56876389.jpg already downloaded
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F5b%252Fbe5bd569bcd6bfae90d5557d39db307a%252Fpa%252FFK17944_06c23b81e2d666c97b2fe145b14b0713.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/5b/be5bd569bcd6bfae90d5557d39db307a/pa/FK17944_06c23b81e2d666c97b2fe145b14b0713.jpg already downloaded
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F5b%252Fbe5bd569bcd6bfae90d5557d39db307a%252Fpa%252FFK17944_5a2f7112bd02900c4a7dc8a36ea706cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/5b/be5bd569bcd6bfae90d5557d39db307a/pa/FK17944_5a2f7112bd02900c4a7dc8a36ea706cb.jpg already downloaded
2026-03-30 11:22:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 29200403-bd9c-5765-b812-23e5662618fc, identifier: FK17944
2026-03-30 11:22:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 29200403-bd9c-5765-b812-23e5662618fc with identifier: FK17944
2026-03-30 11:22:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 29200403-bd9c-5765-b812-23e5662618fc with identifier: FK17944
2026-03-30 11:22:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 29200403-bd9c-5765-b812-23e5662618fc with identifier: FK17944 to the API
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:22:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FK17944>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.6L',
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:35:35Z',
'fuel_type': 'diesel',
'id': '29200403-bd9c-5765-b812-23e5662618fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK17944',
'listing': 'auction',
'location': 'ES, Araia',
'make': 'Peugeot',
'model': '207',
'odometer': 190356,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/imgbe/5b/be5bd569bcd6bfae90d5557d39db307a/pa/FK17944_ae609e7da9190c9e38c72a6fc31fd2b3.jpg',
'https://img-pa.auto1.com/imgbe/5b/be5bd569bcd6bfae90d5557d39db307a/pa/FK17944_0ee47f6a6bf60e1314c0a7cc0ebdce49.jpg',
'https://img-pa.auto1.com/imgbe/5b/be5bd569bcd6bfae90d5557d39db307a/pa/FK17944_5516244c7b380b94a5b110c83c89ac4a.jpg',
'https://img-pa.auto1.com/imgbe/5b/be5bd569bcd6bfae90d5557d39db307a/pa/FK17944_602cdd056467a2045047512e56876389.jpg',
'https://img-pa.auto1.com/imgbe/5b/be5bd569bcd6bfae90d5557d39db307a/pa/FK17944_06c23b81e2d666c97b2fe145b14b0713.jpg',
'https://img-pa.auto1.com/imgbe/5b/be5bd569bcd6bfae90d5557d39db307a/pa/FK17944_5a2f7112bd02900c4a7dc8a36ea706cb.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29200403-bd9c-5765-b812-23e5662618fc/29200403-bd9c-5765-b812-23e5662618fc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92636,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/5b/be5bd569bcd6bfae90d5557d39db307a/pa/FK17944_ae609e7da9190c9e38c72a6fc31fd2b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29200403-bd9c-5765-b812-23e5662618fc/29200403-bd9c-5765-b812-23e5662618fc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84226,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/5b/be5bd569bcd6bfae90d5557d39db307a/pa/FK17944_0ee47f6a6bf60e1314c0a7cc0ebdce49.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29200403-bd9c-5765-b812-23e5662618fc/29200403-bd9c-5765-b812-23e5662618fc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89178,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/5b/be5bd569bcd6bfae90d5557d39db307a/pa/FK17944_5516244c7b380b94a5b110c83c89ac4a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29200403-bd9c-5765-b812-23e5662618fc/29200403-bd9c-5765-b812-23e5662618fc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91518,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/5b/be5bd569bcd6bfae90d5557d39db307a/pa/FK17944_602cdd056467a2045047512e56876389.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29200403-bd9c-5765-b812-23e5662618fc/29200403-bd9c-5765-b812-23e5662618fc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65341,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/5b/be5bd569bcd6bfae90d5557d39db307a/pa/FK17944_06c23b81e2d666c97b2fe145b14b0713.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29200403-bd9c-5765-b812-23e5662618fc/29200403-bd9c-5765-b812-23e5662618fc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92410,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/5b/be5bd569bcd6bfae90d5557d39db307a/pa/FK17944_5a2f7112bd02900c4a7dc8a36ea706cb.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2007-12-26',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 207 1.6 HDi XT Pack',
'transmission': 'manual',
'trim': 'XT Pack',
'year': 2007}
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK17944%27 HTTP/1.1" 200 None
2026-03-30 11:22:42 [auto1.es] INFO: Saving data for FK17944: {'created_time': 1774869762.518348, 'last_price_update_time': 1774869762.518358, 'auction_closing_time': 1774971335.0}
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FK17944') HTTP/1.1" 204 0
2026-03-30 11:22:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_263638c708891e328a02d3ef07dd444e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc061100ad0>
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8e29383-7fd5-50c8-a4b7-6ff3bf6df604/b8e29383-7fd5-50c8-a4b7-6ff3bf6df604_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fe6%252F37e6a37f14d8334c291eaee97046e171%252Fpa%252FVR33132_263638c708891e328a02d3ef07dd444e.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_263638c708891e328a02d3ef07dd444e.jpg saved to cache
2026-03-30 11:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b8e29383-7fd5-50c8-a4b7-6ff3bf6df604
2026-03-30 11:22:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_d12310a5974461967a9d2732b2403e36.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad42410>
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8e29383-7fd5-50c8-a4b7-6ff3bf6df604/b8e29383-7fd5-50c8-a4b7-6ff3bf6df604_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fe6%252F37e6a37f14d8334c291eaee97046e171%252Fpa%252FVR33132_d12310a5974461967a9d2732b2403e36.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_d12310a5974461967a9d2732b2403e36.jpg saved to cache
2026-03-30 11:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b8e29383-7fd5-50c8-a4b7-6ff3bf6df604
2026-03-30 11:22:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_854fde9d624f6e1dab421014918fa60b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad7a1d0>
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8e29383-7fd5-50c8-a4b7-6ff3bf6df604/b8e29383-7fd5-50c8-a4b7-6ff3bf6df604_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fe6%252F37e6a37f14d8334c291eaee97046e171%252Fpa%252FVR33132_854fde9d624f6e1dab421014918fa60b.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_854fde9d624f6e1dab421014918fa60b.jpg saved to cache
2026-03-30 11:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b8e29383-7fd5-50c8-a4b7-6ff3bf6df604
2026-03-30 11:22:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_208be5bf29d7f6099101d3534522eeee.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad42290>
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8e29383-7fd5-50c8-a4b7-6ff3bf6df604/b8e29383-7fd5-50c8-a4b7-6ff3bf6df604_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fe6%252F37e6a37f14d8334c291eaee97046e171%252Fpa%252FVR33132_208be5bf29d7f6099101d3534522eeee.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_208be5bf29d7f6099101d3534522eeee.jpg saved to cache
2026-03-30 11:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b8e29383-7fd5-50c8-a4b7-6ff3bf6df604
2026-03-30 11:22:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_b8d150b4eea7597322312e8580190be8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ae80410>
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8e29383-7fd5-50c8-a4b7-6ff3bf6df604/b8e29383-7fd5-50c8-a4b7-6ff3bf6df604_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fe6%252F37e6a37f14d8334c291eaee97046e171%252Fpa%252FVR33132_b8d150b4eea7597322312e8580190be8.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_b8d150b4eea7597322312e8580190be8.jpg saved to cache
2026-03-30 11:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b8e29383-7fd5-50c8-a4b7-6ff3bf6df604
2026-03-30 11:22:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_f1c4479a9ad5aace39f2a20e6d273b65.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4fadd0>
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8e29383-7fd5-50c8-a4b7-6ff3bf6df604/b8e29383-7fd5-50c8-a4b7-6ff3bf6df604_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fe6%252F37e6a37f14d8334c291eaee97046e171%252Fpa%252FVR33132_f1c4479a9ad5aace39f2a20e6d273b65.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_f1c4479a9ad5aace39f2a20e6d273b65.jpg saved to cache
2026-03-30 11:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b8e29383-7fd5-50c8-a4b7-6ff3bf6df604
2026-03-30 11:22:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_b66953878131a03f1737a1993805df1d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_09446496d6aa321c80a850787b6a0a9a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a464e50>
2026-03-30 11:22:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8e29383-7fd5-50c8-a4b7-6ff3bf6df604/b8e29383-7fd5-50c8-a4b7-6ff3bf6df604_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fe6%252F37e6a37f14d8334c291eaee97046e171%252Fpa%252FVR33132_b66953878131a03f1737a1993805df1d.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_b66953878131a03f1737a1993805df1d.jpg saved to cache
2026-03-30 11:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b8e29383-7fd5-50c8-a4b7-6ff3bf6df604
2026-03-30 11:22:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a300150>
2026-03-30 11:22:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8e29383-7fd5-50c8-a4b7-6ff3bf6df604/b8e29383-7fd5-50c8-a4b7-6ff3bf6df604_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fe6%252F37e6a37f14d8334c291eaee97046e171%252Fpa%252FVR33132_09446496d6aa321c80a850787b6a0a9a.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_09446496d6aa321c80a850787b6a0a9a.jpg saved to cache
2026-03-30 11:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b8e29383-7fd5-50c8-a4b7-6ff3bf6df604
2026-03-30 11:22:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_be2529c140a3cb3e7d212a5852306ac2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_6d59fe8945c3290137f6b4f2aadabca7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a325810>
2026-03-30 11:22:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8e29383-7fd5-50c8-a4b7-6ff3bf6df604/b8e29383-7fd5-50c8-a4b7-6ff3bf6df604_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fe6%252F37e6a37f14d8334c291eaee97046e171%252Fpa%252FVR33132_be2529c140a3cb3e7d212a5852306ac2.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_be2529c140a3cb3e7d212a5852306ac2.jpg saved to cache
2026-03-30 11:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b8e29383-7fd5-50c8-a4b7-6ff3bf6df604
2026-03-30 11:22:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a327950>
2026-03-30 11:22:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8e29383-7fd5-50c8-a4b7-6ff3bf6df604/b8e29383-7fd5-50c8-a4b7-6ff3bf6df604_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fe6%252F37e6a37f14d8334c291eaee97046e171%252Fpa%252FVR33132_6d59fe8945c3290137f6b4f2aadabca7.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_6d59fe8945c3290137f6b4f2aadabca7.jpg saved to cache
2026-03-30 11:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b8e29383-7fd5-50c8-a4b7-6ff3bf6df604
2026-03-30 11:22:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b8e29383-7fd5-50c8-a4b7-6ff3bf6df604, skipping ID generation
2026-03-30 11:22:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8e29383-7fd5-50c8-a4b7-6ff3bf6df604 with scrape type 1
2026-03-30 11:22:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b8e29383-7fd5-50c8-a4b7-6ff3bf6df604 sending to next pipeline
2026-03-30 11:22:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b8e29383-7fd5-50c8-a4b7-6ff3bf6df604, identifier: VR33132
2026-03-30 11:22:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b8e29383-7fd5-50c8-a4b7-6ff3bf6df604 with identifier: VR33132
2026-03-30 11:22:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b8e29383-7fd5-50c8-a4b7-6ff3bf6df604 with identifier: VR33132
2026-03-30 11:22:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b8e29383-7fd5-50c8-a4b7-6ff3bf6df604 with identifier: VR33132 to the API
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:22:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_6d59fe8945c3290137f6b4f2aadabca7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '0.9L',
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:07:06Z',
'fuel_type': 'petrol',
'id': 'b8e29383-7fd5-50c8-a4b7-6ff3bf6df604',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR33132',
'listing': 'auction',
'location': 'ES, Tarragona',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 109449,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8e29383-7fd5-50c8-a4b7-6ff3bf6df604/b8e29383-7fd5-50c8-a4b7-6ff3bf6df604_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84404,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_6d59fe8945c3290137f6b4f2aadabca7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8e29383-7fd5-50c8-a4b7-6ff3bf6df604/b8e29383-7fd5-50c8-a4b7-6ff3bf6df604_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81000,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_be2529c140a3cb3e7d212a5852306ac2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8e29383-7fd5-50c8-a4b7-6ff3bf6df604/b8e29383-7fd5-50c8-a4b7-6ff3bf6df604_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78954,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_09446496d6aa321c80a850787b6a0a9a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8e29383-7fd5-50c8-a4b7-6ff3bf6df604/b8e29383-7fd5-50c8-a4b7-6ff3bf6df604_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67538,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_b66953878131a03f1737a1993805df1d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8e29383-7fd5-50c8-a4b7-6ff3bf6df604/b8e29383-7fd5-50c8-a4b7-6ff3bf6df604_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72172,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_f1c4479a9ad5aace39f2a20e6d273b65.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8e29383-7fd5-50c8-a4b7-6ff3bf6df604/b8e29383-7fd5-50c8-a4b7-6ff3bf6df604_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86225,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_b8d150b4eea7597322312e8580190be8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8e29383-7fd5-50c8-a4b7-6ff3bf6df604/b8e29383-7fd5-50c8-a4b7-6ff3bf6df604_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59558,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_208be5bf29d7f6099101d3534522eeee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8e29383-7fd5-50c8-a4b7-6ff3bf6df604/b8e29383-7fd5-50c8-a4b7-6ff3bf6df604_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83654,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_854fde9d624f6e1dab421014918fa60b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8e29383-7fd5-50c8-a4b7-6ff3bf6df604/b8e29383-7fd5-50c8-a4b7-6ff3bf6df604_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80212,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_d12310a5974461967a9d2732b2403e36.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8e29383-7fd5-50c8-a4b7-6ff3bf6df604/b8e29383-7fd5-50c8-a4b7-6ff3bf6df604_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64471,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/e6/37e6a37f14d8334c291eaee97046e171/pa/VR33132_263638c708891e328a02d3ef07dd444e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-10-19',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Sandero 0.9 TCe Stepway',
'transmission': 'manual',
'trim': 'Stepway',
'year': 2016}
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VR33132%27 HTTP/1.1" 200 None
2026-03-30 11:22:44 [auto1.es] INFO: Saving data for VR33132: {'created_time': 1774869764.901909, 'last_price_update_time': 1774869764.90192, 'auction_closing_time': 1774969626.0}
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VR33132') HTTP/1.1" 204 0
2026-03-30 11:22:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DX71922> (referer: https://www.auto1.com/v1/car-details-view/DX71922/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: becf468d-0b67-5f4d-88b4-f88004cd2c98 with identifier: DX71922
2026-03-30 11:22:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item becf468d-0b67-5f4d-88b4-f88004cd2c98 with scrape type 1
2026-03-30 11:22:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item becf468d-0b67-5f4d-88b4-f88004cd2c98
2026-03-30 11:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Faa%252Fefaa0164a41c2a07552aefdc10ed674b%252Fpa%252FDX71922_5d172f08e4390c36146ac10eca882263.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/aa/efaa0164a41c2a07552aefdc10ed674b/pa/DX71922_5d172f08e4390c36146ac10eca882263.jpg already downloaded
2026-03-30 11:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Faa%252Fefaa0164a41c2a07552aefdc10ed674b%252Fpa%252FDX71922_8790df98c568e1eebdbf8b388390dc8e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/aa/efaa0164a41c2a07552aefdc10ed674b/pa/DX71922_8790df98c568e1eebdbf8b388390dc8e.jpg already downloaded
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Faa%252Fefaa0164a41c2a07552aefdc10ed674b%252Fpa%252FDX71922_3f39eec4b4910458cd1dcfb5bd64bd66.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/aa/efaa0164a41c2a07552aefdc10ed674b/pa/DX71922_3f39eec4b4910458cd1dcfb5bd64bd66.jpg already downloaded
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Faa%252Fefaa0164a41c2a07552aefdc10ed674b%252Fpa%252FDX71922_4b927060aedb03aac648332a9eefa4a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/aa/efaa0164a41c2a07552aefdc10ed674b/pa/DX71922_4b927060aedb03aac648332a9eefa4a3.jpg already downloaded
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Faa%252Fefaa0164a41c2a07552aefdc10ed674b%252Fpa%252FDX71922_ba057970b447af310af53d362f529be4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/aa/efaa0164a41c2a07552aefdc10ed674b/pa/DX71922_ba057970b447af310af53d362f529be4.jpg already downloaded
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Faa%252Fefaa0164a41c2a07552aefdc10ed674b%252Fpa%252FDX71922_a23980521ffb4b8ce7f675ce0ba138c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/aa/efaa0164a41c2a07552aefdc10ed674b/pa/DX71922_a23980521ffb4b8ce7f675ce0ba138c8.jpg already downloaded
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Faa%252Fefaa0164a41c2a07552aefdc10ed674b%252Fpa%252FDX71922_d856bced45dfc4f18f499d7bbdb7cd94.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/aa/efaa0164a41c2a07552aefdc10ed674b/pa/DX71922_d856bced45dfc4f18f499d7bbdb7cd94.jpg already downloaded
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Faa%252Fefaa0164a41c2a07552aefdc10ed674b%252Fpa%252FDX71922_b6169283cbccfb4755d5d886feb0b6e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/aa/efaa0164a41c2a07552aefdc10ed674b/pa/DX71922_b6169283cbccfb4755d5d886feb0b6e1.jpg already downloaded
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Faa%252Fefaa0164a41c2a07552aefdc10ed674b%252Fpa%252FDX71922_19b9ac6817fb75e13e9b1f0136cd8a6c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/aa/efaa0164a41c2a07552aefdc10ed674b/pa/DX71922_19b9ac6817fb75e13e9b1f0136cd8a6c.jpg already downloaded
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Faa%252Fefaa0164a41c2a07552aefdc10ed674b%252Fpa%252FDX71922_4f57faa31862f985a477f4bcb682b670.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/aa/efaa0164a41c2a07552aefdc10ed674b/pa/DX71922_4f57faa31862f985a477f4bcb682b670.jpg already downloaded
2026-03-30 11:22:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: becf468d-0b67-5f4d-88b4-f88004cd2c98, identifier: DX71922
2026-03-30 11:22:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: becf468d-0b67-5f4d-88b4-f88004cd2c98 with identifier: DX71922
2026-03-30 11:22:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: becf468d-0b67-5f4d-88b4-f88004cd2c98 with identifier: DX71922
2026-03-30 11:22:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: becf468d-0b67-5f4d-88b4-f88004cd2c98 with identifier: DX71922 to the API
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:22:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DX71922>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'engine_horse_power': 152,
'expiration_date': '2026-03-31T15:27:36Z',
'fuel_type': 'petrol',
'id': 'becf468d-0b67-5f4d-88b4-f88004cd2c98',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX71922',
'listing': 'auction',
'location': 'ES, Caldes de Malavella (Girona)',
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 171294,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgef/aa/efaa0164a41c2a07552aefdc10ed674b/pa/DX71922_5d172f08e4390c36146ac10eca882263.jpg',
'https://img-pa.auto1.com/imgef/aa/efaa0164a41c2a07552aefdc10ed674b/pa/DX71922_8790df98c568e1eebdbf8b388390dc8e.jpg',
'https://img-pa.auto1.com/imgef/aa/efaa0164a41c2a07552aefdc10ed674b/pa/DX71922_3f39eec4b4910458cd1dcfb5bd64bd66.jpg',
'https://img-pa.auto1.com/imgef/aa/efaa0164a41c2a07552aefdc10ed674b/pa/DX71922_4b927060aedb03aac648332a9eefa4a3.jpg',
'https://img-pa.auto1.com/imgef/aa/efaa0164a41c2a07552aefdc10ed674b/pa/DX71922_ba057970b447af310af53d362f529be4.jpg',
'https://img-pa.auto1.com/imgef/aa/efaa0164a41c2a07552aefdc10ed674b/pa/DX71922_a23980521ffb4b8ce7f675ce0ba138c8.jpg',
'https://img-pa.auto1.com/imgef/aa/efaa0164a41c2a07552aefdc10ed674b/pa/DX71922_d856bced45dfc4f18f499d7bbdb7cd94.jpg',
'https://img-pa.auto1.com/imgef/aa/efaa0164a41c2a07552aefdc10ed674b/pa/DX71922_b6169283cbccfb4755d5d886feb0b6e1.jpg',
'https://img-pa.auto1.com/imgef/aa/efaa0164a41c2a07552aefdc10ed674b/pa/DX71922_19b9ac6817fb75e13e9b1f0136cd8a6c.jpg',
'https://img-pa.auto1.com/imgef/aa/efaa0164a41c2a07552aefdc10ed674b/pa/DX71922_4f57faa31862f985a477f4bcb682b670.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_becf468d-0b67-5f4d-88b4-f88004cd2c98/becf468d-0b67-5f4d-88b4-f88004cd2c98_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88737,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/aa/efaa0164a41c2a07552aefdc10ed674b/pa/DX71922_5d172f08e4390c36146ac10eca882263.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_becf468d-0b67-5f4d-88b4-f88004cd2c98/becf468d-0b67-5f4d-88b4-f88004cd2c98_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83058,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/aa/efaa0164a41c2a07552aefdc10ed674b/pa/DX71922_8790df98c568e1eebdbf8b388390dc8e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_becf468d-0b67-5f4d-88b4-f88004cd2c98/becf468d-0b67-5f4d-88b4-f88004cd2c98_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68835,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/aa/efaa0164a41c2a07552aefdc10ed674b/pa/DX71922_3f39eec4b4910458cd1dcfb5bd64bd66.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_becf468d-0b67-5f4d-88b4-f88004cd2c98/becf468d-0b67-5f4d-88b4-f88004cd2c98_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49006,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/aa/efaa0164a41c2a07552aefdc10ed674b/pa/DX71922_4b927060aedb03aac648332a9eefa4a3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_becf468d-0b67-5f4d-88b4-f88004cd2c98/becf468d-0b67-5f4d-88b4-f88004cd2c98_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80201,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/aa/efaa0164a41c2a07552aefdc10ed674b/pa/DX71922_ba057970b447af310af53d362f529be4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_becf468d-0b67-5f4d-88b4-f88004cd2c98/becf468d-0b67-5f4d-88b4-f88004cd2c98_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74918,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/aa/efaa0164a41c2a07552aefdc10ed674b/pa/DX71922_a23980521ffb4b8ce7f675ce0ba138c8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_becf468d-0b67-5f4d-88b4-f88004cd2c98/becf468d-0b67-5f4d-88b4-f88004cd2c98_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60009,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/aa/efaa0164a41c2a07552aefdc10ed674b/pa/DX71922_d856bced45dfc4f18f499d7bbdb7cd94.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_becf468d-0b67-5f4d-88b4-f88004cd2c98/becf468d-0b67-5f4d-88b4-f88004cd2c98_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74351,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/aa/efaa0164a41c2a07552aefdc10ed674b/pa/DX71922_b6169283cbccfb4755d5d886feb0b6e1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_becf468d-0b67-5f4d-88b4-f88004cd2c98/becf468d-0b67-5f4d-88b4-f88004cd2c98_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74900,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/aa/efaa0164a41c2a07552aefdc10ed674b/pa/DX71922_19b9ac6817fb75e13e9b1f0136cd8a6c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_becf468d-0b67-5f4d-88b4-f88004cd2c98/becf468d-0b67-5f4d-88b4-f88004cd2c98_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76512,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/aa/efaa0164a41c2a07552aefdc10ed674b/pa/DX71922_4f57faa31862f985a477f4bcb682b670.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2006-11-08',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota RAV 4 2.0 Sol',
'transmission': 'manual',
'trim': 'Sol',
'year': 2006}
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DX71922%27 HTTP/1.1" 200 None
2026-03-30 11:22:51 [auto1.es] INFO: Saving data for DX71922: {'created_time': 1774869771.665888, 'last_price_update_time': 1774869771.6659, 'auction_closing_time': 1774970856.0}
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DX71922') HTTP/1.1" 204 0
2026-03-30 11:22:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HH14310> (referer: https://www.auto1.com/v1/car-details-view/HH14310/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 885c354c-c23d-584f-bbe1-7b2af33821a2 with identifier: HH14310
2026-03-30 11:22:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 885c354c-c23d-584f-bbe1-7b2af33821a2 with scrape type 1
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 885c354c-c23d-584f-bbe1-7b2af33821a2
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F2a%252F922af40c323f3e17bf1d3e5d1d5d1a86%252Fpa%252FHH14310_b00ad72cfe54a9f7c76556fe11077341.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/2a/922af40c323f3e17bf1d3e5d1d5d1a86/pa/HH14310_b00ad72cfe54a9f7c76556fe11077341.jpg already downloaded
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F2a%252F922af40c323f3e17bf1d3e5d1d5d1a86%252Fpa%252FHH14310_4493ea602c99c6c7dbb9c39d795069f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/2a/922af40c323f3e17bf1d3e5d1d5d1a86/pa/HH14310_4493ea602c99c6c7dbb9c39d795069f8.jpg already downloaded
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F2a%252F922af40c323f3e17bf1d3e5d1d5d1a86%252Fpa%252FHH14310_ddcd54f13cbb8b01d12e9ec5fc660224.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/2a/922af40c323f3e17bf1d3e5d1d5d1a86/pa/HH14310_ddcd54f13cbb8b01d12e9ec5fc660224.jpg already downloaded
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F2a%252F922af40c323f3e17bf1d3e5d1d5d1a86%252Fpa%252FHH14310_08440f94483d075669cdaaba36c17d64.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/2a/922af40c323f3e17bf1d3e5d1d5d1a86/pa/HH14310_08440f94483d075669cdaaba36c17d64.jpg already downloaded
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F2a%252F922af40c323f3e17bf1d3e5d1d5d1a86%252Fpa%252FHH14310_c7a35aefe879f1a4486ec449325afd5e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/2a/922af40c323f3e17bf1d3e5d1d5d1a86/pa/HH14310_c7a35aefe879f1a4486ec449325afd5e.jpg already downloaded
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F2a%252F922af40c323f3e17bf1d3e5d1d5d1a86%252Fpa%252FHH14310_892f2077d80bbb74f5860e8b29e69ae8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/2a/922af40c323f3e17bf1d3e5d1d5d1a86/pa/HH14310_892f2077d80bbb74f5860e8b29e69ae8.jpg already downloaded
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F2a%252F922af40c323f3e17bf1d3e5d1d5d1a86%252Fpa%252FHH14310_e140732f30b63d11579f23d538f7aa95.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/2a/922af40c323f3e17bf1d3e5d1d5d1a86/pa/HH14310_e140732f30b63d11579f23d538f7aa95.jpg already downloaded
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F2a%252F922af40c323f3e17bf1d3e5d1d5d1a86%252Fpa%252FHH14310_7111a830a7bd6a2be6753b61593d1c3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/2a/922af40c323f3e17bf1d3e5d1d5d1a86/pa/HH14310_7111a830a7bd6a2be6753b61593d1c3a.jpg already downloaded
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F2a%252F922af40c323f3e17bf1d3e5d1d5d1a86%252Fpa%252FHH14310_507638c242eb5a9799776481d07597e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/2a/922af40c323f3e17bf1d3e5d1d5d1a86/pa/HH14310_507638c242eb5a9799776481d07597e9.jpg already downloaded
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F2a%252F922af40c323f3e17bf1d3e5d1d5d1a86%252Fpa%252FHH14310_d07123dc7b5071a47ed4b30b2f634e9c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/2a/922af40c323f3e17bf1d3e5d1d5d1a86/pa/HH14310_d07123dc7b5071a47ed4b30b2f634e9c.jpg already downloaded
2026-03-30 11:22:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 885c354c-c23d-584f-bbe1-7b2af33821a2, identifier: HH14310
2026-03-30 11:22:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 885c354c-c23d-584f-bbe1-7b2af33821a2 with identifier: HH14310
2026-03-30 11:22:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 885c354c-c23d-584f-bbe1-7b2af33821a2 with identifier: HH14310
2026-03-30 11:22:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 885c354c-c23d-584f-bbe1-7b2af33821a2 with identifier: HH14310 to the API
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:22:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HH14310>
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:02:26Z',
'fuel_type': 'diesel',
'id': '885c354c-c23d-584f-bbe1-7b2af33821a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH14310',
'listing': 'auction',
'location': 'Puerto de Santa MarÃa',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 160424,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img92/2a/922af40c323f3e17bf1d3e5d1d5d1a86/pa/HH14310_b00ad72cfe54a9f7c76556fe11077341.jpg',
'https://img-pa.auto1.com/img92/2a/922af40c323f3e17bf1d3e5d1d5d1a86/pa/HH14310_4493ea602c99c6c7dbb9c39d795069f8.jpg',
'https://img-pa.auto1.com/img92/2a/922af40c323f3e17bf1d3e5d1d5d1a86/pa/HH14310_ddcd54f13cbb8b01d12e9ec5fc660224.jpg',
'https://img-pa.auto1.com/img92/2a/922af40c323f3e17bf1d3e5d1d5d1a86/pa/HH14310_08440f94483d075669cdaaba36c17d64.jpg',
'https://img-pa.auto1.com/img92/2a/922af40c323f3e17bf1d3e5d1d5d1a86/pa/HH14310_c7a35aefe879f1a4486ec449325afd5e.jpg',
'https://img-pa.auto1.com/img92/2a/922af40c323f3e17bf1d3e5d1d5d1a86/pa/HH14310_892f2077d80bbb74f5860e8b29e69ae8.jpg',
'https://img-pa.auto1.com/img92/2a/922af40c323f3e17bf1d3e5d1d5d1a86/pa/HH14310_e140732f30b63d11579f23d538f7aa95.jpg',
'https://img-pa.auto1.com/img92/2a/922af40c323f3e17bf1d3e5d1d5d1a86/pa/HH14310_7111a830a7bd6a2be6753b61593d1c3a.jpg',
'https://img-pa.auto1.com/img92/2a/922af40c323f3e17bf1d3e5d1d5d1a86/pa/HH14310_507638c242eb5a9799776481d07597e9.jpg',
'https://img-pa.auto1.com/img92/2a/922af40c323f3e17bf1d3e5d1d5d1a86/pa/HH14310_d07123dc7b5071a47ed4b30b2f634e9c.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_885c354c-c23d-584f-bbe1-7b2af33821a2/885c354c-c23d-584f-bbe1-7b2af33821a2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92531,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/2a/922af40c323f3e17bf1d3e5d1d5d1a86/pa/HH14310_b00ad72cfe54a9f7c76556fe11077341.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_885c354c-c23d-584f-bbe1-7b2af33821a2/885c354c-c23d-584f-bbe1-7b2af33821a2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84326,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/2a/922af40c323f3e17bf1d3e5d1d5d1a86/pa/HH14310_4493ea602c99c6c7dbb9c39d795069f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_885c354c-c23d-584f-bbe1-7b2af33821a2/885c354c-c23d-584f-bbe1-7b2af33821a2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94391,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/2a/922af40c323f3e17bf1d3e5d1d5d1a86/pa/HH14310_ddcd54f13cbb8b01d12e9ec5fc660224.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_885c354c-c23d-584f-bbe1-7b2af33821a2/885c354c-c23d-584f-bbe1-7b2af33821a2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82911,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/2a/922af40c323f3e17bf1d3e5d1d5d1a86/pa/HH14310_08440f94483d075669cdaaba36c17d64.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_885c354c-c23d-584f-bbe1-7b2af33821a2/885c354c-c23d-584f-bbe1-7b2af33821a2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85614,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/2a/922af40c323f3e17bf1d3e5d1d5d1a86/pa/HH14310_c7a35aefe879f1a4486ec449325afd5e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_885c354c-c23d-584f-bbe1-7b2af33821a2/885c354c-c23d-584f-bbe1-7b2af33821a2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82852,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/2a/922af40c323f3e17bf1d3e5d1d5d1a86/pa/HH14310_892f2077d80bbb74f5860e8b29e69ae8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_885c354c-c23d-584f-bbe1-7b2af33821a2/885c354c-c23d-584f-bbe1-7b2af33821a2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69320,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/2a/922af40c323f3e17bf1d3e5d1d5d1a86/pa/HH14310_e140732f30b63d11579f23d538f7aa95.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_885c354c-c23d-584f-bbe1-7b2af33821a2/885c354c-c23d-584f-bbe1-7b2af33821a2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80748,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/2a/922af40c323f3e17bf1d3e5d1d5d1a86/pa/HH14310_7111a830a7bd6a2be6753b61593d1c3a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_885c354c-c23d-584f-bbe1-7b2af33821a2/885c354c-c23d-584f-bbe1-7b2af33821a2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82473,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/2a/922af40c323f3e17bf1d3e5d1d5d1a86/pa/HH14310_507638c242eb5a9799776481d07597e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_885c354c-c23d-584f-bbe1-7b2af33821a2/885c354c-c23d-584f-bbe1-7b2af33821a2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65136,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/2a/922af40c323f3e17bf1d3e5d1d5d1a86/pa/HH14310_d07123dc7b5071a47ed4b30b2f634e9c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-08-10',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris 1.4 D-4D Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2014}
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HH14310%27 HTTP/1.1" 200 None
2026-03-30 11:22:54 [auto1.es] INFO: Saving data for HH14310: {'created_time': 1774869774.801874, 'last_price_update_time': 1774869774.801887, 'auction_closing_time': 1774969346.0}
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HH14310') HTTP/1.1" 204 0
2026-03-30 11:22:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VX61508> (referer: https://www.auto1.com/v1/car-details-view/VX61508/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_566eb98f2bf91e361714a1276ea3ca21.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 701db595-719a-592a-b690-5822bdc1f9d2 with identifier: VX61508
2026-03-30 11:22:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 701db595-719a-592a-b690-5822bdc1f9d2 with scrape type 1
2026-03-30 11:22:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 701db595-719a-592a-b690-5822bdc1f9d2
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3a%252F753a50fa1ffb9a545cac7c5ace85bba1%252Fpa%252FVX61508_d0d707f840e5a0bfc477c3321a67594a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753a50fa1ffb9a545cac7c5ace85bba1/pa/VX61508_d0d707f840e5a0bfc477c3321a67594a.jpg not downloaded yet
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3a%252F753a50fa1ffb9a545cac7c5ace85bba1%252Fpa%252FVX61508_e7202f8107d53d6df9cf68b5c08c86e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753a50fa1ffb9a545cac7c5ace85bba1/pa/VX61508_e7202f8107d53d6df9cf68b5c08c86e5.jpg not downloaded yet
2026-03-30 11:22:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_a952a3e12f7bd44e2b0889655f748ba6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3a%252F753a50fa1ffb9a545cac7c5ace85bba1%252Fpa%252FVX61508_b8fd77da7f28c579e9daed77b77bc765.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753a50fa1ffb9a545cac7c5ace85bba1/pa/VX61508_b8fd77da7f28c579e9daed77b77bc765.jpg not downloaded yet
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3a%252F753a50fa1ffb9a545cac7c5ace85bba1%252Fpa%252FVX61508_dca9ae6e166dd86fd2f36d0942fbd142.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753a50fa1ffb9a545cac7c5ace85bba1/pa/VX61508_dca9ae6e166dd86fd2f36d0942fbd142.jpg not downloaded yet
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3a%252F753a50fa1ffb9a545cac7c5ace85bba1%252Fpa%252FVX61508_2394663cd0d1d4efb75c731c2b938371.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753a50fa1ffb9a545cac7c5ace85bba1/pa/VX61508_2394663cd0d1d4efb75c731c2b938371.jpg not downloaded yet
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a47cb10>
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c6a321c-549c-5231-9c18-f8e36df55d15/7c6a321c-549c-5231-9c18-f8e36df55d15_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F86%252F708661a42a8987a1bfdc64777b15cbb1%252Fpa%252FZV81401_566eb98f2bf91e361714a1276ea3ca21.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_566eb98f2bf91e361714a1276ea3ca21.jpg saved to cache
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7c6a321c-549c-5231-9c18-f8e36df55d15
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3a%252F753a50fa1ffb9a545cac7c5ace85bba1%252Fpa%252FVX61508_8611c69c38b1263b3728f9771fa4dc61.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753a50fa1ffb9a545cac7c5ace85bba1/pa/VX61508_8611c69c38b1263b3728f9771fa4dc61.jpg not downloaded yet
2026-03-30 11:22:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/3a/753a50fa1ffb9a545cac7c5ace85bba1/pa/VX61508_d0d707f840e5a0bfc477c3321a67594a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a336a90>
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c6a321c-549c-5231-9c18-f8e36df55d15/7c6a321c-549c-5231-9c18-f8e36df55d15_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F86%252F708661a42a8987a1bfdc64777b15cbb1%252Fpa%252FZV81401_a952a3e12f7bd44e2b0889655f748ba6.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_a952a3e12f7bd44e2b0889655f748ba6.jpg saved to cache
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7c6a321c-549c-5231-9c18-f8e36df55d15
2026-03-30 11:22:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/3a/753a50fa1ffb9a545cac7c5ace85bba1/pa/VX61508_2394663cd0d1d4efb75c731c2b938371.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/3a/753a50fa1ffb9a545cac7c5ace85bba1/pa/VX61508_8611c69c38b1263b3728f9771fa4dc61.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3a8150>
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_701db595-719a-592a-b690-5822bdc1f9d2/701db595-719a-592a-b690-5822bdc1f9d2_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3a%252F753a50fa1ffb9a545cac7c5ace85bba1%252Fpa%252FVX61508_d0d707f840e5a0bfc477c3321a67594a.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753a50fa1ffb9a545cac7c5ace85bba1/pa/VX61508_d0d707f840e5a0bfc477c3321a67594a.jpg saved to cache
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 701db595-719a-592a-b690-5822bdc1f9d2
2026-03-30 11:22:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/3a/753a50fa1ffb9a545cac7c5ace85bba1/pa/VX61508_dca9ae6e166dd86fd2f36d0942fbd142.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a483890>
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_701db595-719a-592a-b690-5822bdc1f9d2/701db595-719a-592a-b690-5822bdc1f9d2_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3a%252F753a50fa1ffb9a545cac7c5ace85bba1%252Fpa%252FVX61508_2394663cd0d1d4efb75c731c2b938371.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753a50fa1ffb9a545cac7c5ace85bba1/pa/VX61508_2394663cd0d1d4efb75c731c2b938371.jpg saved to cache
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 701db595-719a-592a-b690-5822bdc1f9d2
2026-03-30 11:22:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/3a/753a50fa1ffb9a545cac7c5ace85bba1/pa/VX61508_b8fd77da7f28c579e9daed77b77bc765.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a335850>
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_701db595-719a-592a-b690-5822bdc1f9d2/701db595-719a-592a-b690-5822bdc1f9d2_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3a%252F753a50fa1ffb9a545cac7c5ace85bba1%252Fpa%252FVX61508_8611c69c38b1263b3728f9771fa4dc61.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753a50fa1ffb9a545cac7c5ace85bba1/pa/VX61508_8611c69c38b1263b3728f9771fa4dc61.jpg saved to cache
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 701db595-719a-592a-b690-5822bdc1f9d2
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a365c10>
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_701db595-719a-592a-b690-5822bdc1f9d2/701db595-719a-592a-b690-5822bdc1f9d2_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3a%252F753a50fa1ffb9a545cac7c5ace85bba1%252Fpa%252FVX61508_dca9ae6e166dd86fd2f36d0942fbd142.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753a50fa1ffb9a545cac7c5ace85bba1/pa/VX61508_dca9ae6e166dd86fd2f36d0942fbd142.jpg saved to cache
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 701db595-719a-592a-b690-5822bdc1f9d2
2026-03-30 11:22:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/3a/753a50fa1ffb9a545cac7c5ace85bba1/pa/VX61508_e7202f8107d53d6df9cf68b5c08c86e5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05aee3350>
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_701db595-719a-592a-b690-5822bdc1f9d2/701db595-719a-592a-b690-5822bdc1f9d2_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3a%252F753a50fa1ffb9a545cac7c5ace85bba1%252Fpa%252FVX61508_b8fd77da7f28c579e9daed77b77bc765.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753a50fa1ffb9a545cac7c5ace85bba1/pa/VX61508_b8fd77da7f28c579e9daed77b77bc765.jpg saved to cache
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 701db595-719a-592a-b690-5822bdc1f9d2
2026-03-30 11:22:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_0c881f9a7e444a4b19c65d25ebba5c12.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_d624b426902567eb42b7872ea0e2a747.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3b2a90>
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_701db595-719a-592a-b690-5822bdc1f9d2/701db595-719a-592a-b690-5822bdc1f9d2_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3a%252F753a50fa1ffb9a545cac7c5ace85bba1%252Fpa%252FVX61508_e7202f8107d53d6df9cf68b5c08c86e5.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3a/753a50fa1ffb9a545cac7c5ace85bba1/pa/VX61508_e7202f8107d53d6df9cf68b5c08c86e5.jpg saved to cache
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 701db595-719a-592a-b690-5822bdc1f9d2
2026-03-30 11:22:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 701db595-719a-592a-b690-5822bdc1f9d2, skipping ID generation
2026-03-30 11:22:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 701db595-719a-592a-b690-5822bdc1f9d2 with scrape type 1
2026-03-30 11:22:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 701db595-719a-592a-b690-5822bdc1f9d2 sending to next pipeline
2026-03-30 11:22:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 701db595-719a-592a-b690-5822bdc1f9d2, identifier: VX61508
2026-03-30 11:22:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 701db595-719a-592a-b690-5822bdc1f9d2 with identifier: VX61508
2026-03-30 11:22:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 701db595-719a-592a-b690-5822bdc1f9d2 with identifier: VX61508
2026-03-30 11:22:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 701db595-719a-592a-b690-5822bdc1f9d2 with identifier: VX61508 to the API
2026-03-30 11:22:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:22:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img75/3a/753a50fa1ffb9a545cac7c5ace85bba1/pa/VX61508_e7202f8107d53d6df9cf68b5c08c86e5.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:25:21Z',
'fuel_type': 'petrol',
'id': '701db595-719a-592a-b690-5822bdc1f9d2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX61508',
'listing': 'auction',
'location': 'ES, Alicante',
'make': 'Mazda',
'model': '626',
'odometer': 158168,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_701db595-719a-592a-b690-5822bdc1f9d2/701db595-719a-592a-b690-5822bdc1f9d2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79597,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/3a/753a50fa1ffb9a545cac7c5ace85bba1/pa/VX61508_d0d707f840e5a0bfc477c3321a67594a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_701db595-719a-592a-b690-5822bdc1f9d2/701db595-719a-592a-b690-5822bdc1f9d2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88723,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/3a/753a50fa1ffb9a545cac7c5ace85bba1/pa/VX61508_e7202f8107d53d6df9cf68b5c08c86e5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_701db595-719a-592a-b690-5822bdc1f9d2/701db595-719a-592a-b690-5822bdc1f9d2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75494,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/3a/753a50fa1ffb9a545cac7c5ace85bba1/pa/VX61508_b8fd77da7f28c579e9daed77b77bc765.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_701db595-719a-592a-b690-5822bdc1f9d2/701db595-719a-592a-b690-5822bdc1f9d2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51281,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/3a/753a50fa1ffb9a545cac7c5ace85bba1/pa/VX61508_dca9ae6e166dd86fd2f36d0942fbd142.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_701db595-719a-592a-b690-5822bdc1f9d2/701db595-719a-592a-b690-5822bdc1f9d2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116825,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/3a/753a50fa1ffb9a545cac7c5ace85bba1/pa/VX61508_2394663cd0d1d4efb75c731c2b938371.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_701db595-719a-592a-b690-5822bdc1f9d2/701db595-719a-592a-b690-5822bdc1f9d2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67767,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/3a/753a50fa1ffb9a545cac7c5ace85bba1/pa/VX61508_8611c69c38b1263b3728f9771fa4dc61.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2001-08-22',
'seats_number': 5,
'seller_name': None,
'title': 'Mazda 626 2.0 Exclusive',
'transmission': 'manual',
'trim': 'Exclusive',
'year': 2001}
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VX61508%27 HTTP/1.1" 200 None
2026-03-30 11:22:56 [auto1.es] INFO: Saving data for VX61508: {'created_time': 1774869776.165664, 'last_price_update_time': 1774869776.165676, 'auction_closing_time': 1774970721.0}
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VX61508') HTTP/1.1" 204 0
2026-03-30 11:22:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_fed165d72cfab1d79930f241846b5ffe.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EN27378> (referer: https://www.auto1.com/v1/car-details-view/EN27378/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CP61201> (referer: https://www.auto1.com/v1/car-details-view/CP61201/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3cac50>
2026-03-30 11:22:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c6a321c-549c-5231-9c18-f8e36df55d15/7c6a321c-549c-5231-9c18-f8e36df55d15_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F86%252F708661a42a8987a1bfdc64777b15cbb1%252Fpa%252FZV81401_0c881f9a7e444a4b19c65d25ebba5c12.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_0c881f9a7e444a4b19c65d25ebba5c12.jpg saved to cache
2026-03-30 11:22:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7c6a321c-549c-5231-9c18-f8e36df55d15
2026-03-30 11:22:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc0611ce210>
2026-03-30 11:22:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c6a321c-549c-5231-9c18-f8e36df55d15/7c6a321c-549c-5231-9c18-f8e36df55d15_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F86%252F708661a42a8987a1bfdc64777b15cbb1%252Fpa%252FZV81401_d624b426902567eb42b7872ea0e2a747.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_d624b426902567eb42b7872ea0e2a747.jpg saved to cache
2026-03-30 11:22:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7c6a321c-549c-5231-9c18-f8e36df55d15
2026-03-30 11:22:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad413d0>
2026-03-30 11:22:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c6a321c-549c-5231-9c18-f8e36df55d15/7c6a321c-549c-5231-9c18-f8e36df55d15_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F86%252F708661a42a8987a1bfdc64777b15cbb1%252Fpa%252FZV81401_fed165d72cfab1d79930f241846b5ffe.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_fed165d72cfab1d79930f241846b5ffe.jpg saved to cache
2026-03-30 11:22:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7c6a321c-549c-5231-9c18-f8e36df55d15
2026-03-30 11:22:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1318257-9edd-51db-8086-97096264de5e with identifier: EN27378
2026-03-30 11:22:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1318257-9edd-51db-8086-97096264de5e with scrape type 1
2026-03-30 11:22:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f1318257-9edd-51db-8086-97096264de5e
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F9a%252Fb39af51750cfe7b42cb217e98d1e021b%252Fpa%252FEN27378_d4a1f1451f0ef3c24251ad8348374cf8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_d4a1f1451f0ef3c24251ad8348374cf8.jpg not downloaded yet
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F9a%252Fb39af51750cfe7b42cb217e98d1e021b%252Fpa%252FEN27378_2c797abec9f755294fde7c23df9fd012.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_2c797abec9f755294fde7c23df9fd012.jpg not downloaded yet
2026-03-30 11:22:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_c4ae4bb5d94f32a3497c69aa94b6fe7c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f048c2da-a2d9-5d01-9aab-6685a1a0f538 with identifier: CP61201
2026-03-30 11:22:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f048c2da-a2d9-5d01-9aab-6685a1a0f538 with scrape type 1
2026-03-30 11:22:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f048c2da-a2d9-5d01-9aab-6685a1a0f538
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fb9%252F39b929b4c743e67b09662d8495de65cd%252Fpa%252FCP61201_c92e185d759c69f6a20d9ff4bc907b20.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_c92e185d759c69f6a20d9ff4bc907b20.jpg not downloaded yet
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F9a%252Fb39af51750cfe7b42cb217e98d1e021b%252Fpa%252FEN27378_fdc214577fab65742c8179ed597585fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_fdc214577fab65742c8179ed597585fa.jpg not downloaded yet
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fb9%252F39b929b4c743e67b09662d8495de65cd%252Fpa%252FCP61201_75fdab8adedd172f8b387ee08d579237.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_75fdab8adedd172f8b387ee08d579237.jpg not downloaded yet
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F9a%252Fb39af51750cfe7b42cb217e98d1e021b%252Fpa%252FEN27378_f38f4c5a5b0f812823355ef6df7e7d0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_f38f4c5a5b0f812823355ef6df7e7d0a.jpg not downloaded yet
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fb9%252F39b929b4c743e67b09662d8495de65cd%252Fpa%252FCP61201_0b4c95febcb5aaaeabf4491f19dd476e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_0b4c95febcb5aaaeabf4491f19dd476e.jpg not downloaded yet
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F9a%252Fb39af51750cfe7b42cb217e98d1e021b%252Fpa%252FEN27378_fe36cd183ff4a6fa095f17b2fe93d02d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_fe36cd183ff4a6fa095f17b2fe93d02d.jpg not downloaded yet
2026-03-30 11:22:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_d4a1f1451f0ef3c24251ad8348374cf8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fb9%252F39b929b4c743e67b09662d8495de65cd%252Fpa%252FCP61201_905257932e25a58e769ddcd6c3f1fb34.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_905257932e25a58e769ddcd6c3f1fb34.jpg not downloaded yet
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F9a%252Fb39af51750cfe7b42cb217e98d1e021b%252Fpa%252FEN27378_0f17f2153654c0a95b47626c5a7fc31b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_0f17f2153654c0a95b47626c5a7fc31b.jpg not downloaded yet
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fb9%252F39b929b4c743e67b09662d8495de65cd%252Fpa%252FCP61201_f01f02bc5bb13ac9e30ab4d5e88e1014.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_f01f02bc5bb13ac9e30ab4d5e88e1014.jpg not downloaded yet
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F9a%252Fb39af51750cfe7b42cb217e98d1e021b%252Fpa%252FEN27378_ff05108c0afaae8c883d053191b29b75.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_ff05108c0afaae8c883d053191b29b75.jpg not downloaded yet
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fb9%252F39b929b4c743e67b09662d8495de65cd%252Fpa%252FCP61201_0f13aa87af1a726a52b6290be1914f98.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_0f13aa87af1a726a52b6290be1914f98.jpg not downloaded yet
2026-03-30 11:22:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4d4e50>
2026-03-30 11:22:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c6a321c-549c-5231-9c18-f8e36df55d15/7c6a321c-549c-5231-9c18-f8e36df55d15_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F86%252F708661a42a8987a1bfdc64777b15cbb1%252Fpa%252FZV81401_c4ae4bb5d94f32a3497c69aa94b6fe7c.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_c4ae4bb5d94f32a3497c69aa94b6fe7c.jpg saved to cache
2026-03-30 11:22:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7c6a321c-549c-5231-9c18-f8e36df55d15
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F9a%252Fb39af51750cfe7b42cb217e98d1e021b%252Fpa%252FEN27378_b10b79fa7236c13cc7d8b7adf2b76443.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_b10b79fa7236c13cc7d8b7adf2b76443.jpg not downloaded yet
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fb9%252F39b929b4c743e67b09662d8495de65cd%252Fpa%252FCP61201_549868074fdbd8fac741bfa8b791a93f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_549868074fdbd8fac741bfa8b791a93f.jpg not downloaded yet
2026-03-30 11:22:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_fe36cd183ff4a6fa095f17b2fe93d02d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_8e7e8257a2a336aadda827826a7f5505.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F9a%252Fb39af51750cfe7b42cb217e98d1e021b%252Fpa%252FEN27378_b548b91a7e6e0fca3c0e7357975ebb6f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_b548b91a7e6e0fca3c0e7357975ebb6f.jpg not downloaded yet
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fb9%252F39b929b4c743e67b09662d8495de65cd%252Fpa%252FCP61201_7c46506be0a552cc4f5bb491fac1e90b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_7c46506be0a552cc4f5bb491fac1e90b.jpg not downloaded yet
2026-03-30 11:22:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a37ac50>
2026-03-30 11:22:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1318257-9edd-51db-8086-97096264de5e/f1318257-9edd-51db-8086-97096264de5e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F9a%252Fb39af51750cfe7b42cb217e98d1e021b%252Fpa%252FEN27378_d4a1f1451f0ef3c24251ad8348374cf8.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_d4a1f1451f0ef3c24251ad8348374cf8.jpg saved to cache
2026-03-30 11:22:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f1318257-9edd-51db-8086-97096264de5e
2026-03-30 11:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F9a%252Fb39af51750cfe7b42cb217e98d1e021b%252Fpa%252FEN27378_fdd5eefe3403d0c8d4d1a6fbeacdafe2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_fdd5eefe3403d0c8d4d1a6fbeacdafe2.jpg not downloaded yet
2026-03-30 11:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fb9%252F39b929b4c743e67b09662d8495de65cd%252Fpa%252FCP61201_4a04f2868b322f56f9486e437903dc93.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_4a04f2868b322f56f9486e437903dc93.jpg not downloaded yet
2026-03-30 11:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fb9%252F39b929b4c743e67b09662d8495de65cd%252Fpa%252FCP61201_2252020c966f326b05941fd775bcd5f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:22:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_2252020c966f326b05941fd775bcd5f9.jpg not downloaded yet
2026-03-30 11:22:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060d54e50>
2026-03-30 11:22:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1318257-9edd-51db-8086-97096264de5e/f1318257-9edd-51db-8086-97096264de5e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F9a%252Fb39af51750cfe7b42cb217e98d1e021b%252Fpa%252FEN27378_fe36cd183ff4a6fa095f17b2fe93d02d.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_fe36cd183ff4a6fa095f17b2fe93d02d.jpg saved to cache
2026-03-30 11:22:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f1318257-9edd-51db-8086-97096264de5e
2026-03-30 11:22:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a46b290>
2026-03-30 11:22:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c6a321c-549c-5231-9c18-f8e36df55d15/7c6a321c-549c-5231-9c18-f8e36df55d15_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F86%252F708661a42a8987a1bfdc64777b15cbb1%252Fpa%252FZV81401_8e7e8257a2a336aadda827826a7f5505.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_8e7e8257a2a336aadda827826a7f5505.jpg saved to cache
2026-03-30 11:22:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7c6a321c-549c-5231-9c18-f8e36df55d15
2026-03-30 11:22:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7c6a321c-549c-5231-9c18-f8e36df55d15, skipping ID generation
2026-03-30 11:22:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c6a321c-549c-5231-9c18-f8e36df55d15 with scrape type 1
2026-03-30 11:22:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7c6a321c-549c-5231-9c18-f8e36df55d15 sending to next pipeline
2026-03-30 11:22:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7c6a321c-549c-5231-9c18-f8e36df55d15, identifier: ZV81401
2026-03-30 11:22:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7c6a321c-549c-5231-9c18-f8e36df55d15 with identifier: ZV81401
2026-03-30 11:22:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7c6a321c-549c-5231-9c18-f8e36df55d15 with identifier: ZV81401
2026-03-30 11:22:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7c6a321c-549c-5231-9c18-f8e36df55d15 with identifier: ZV81401 to the API
2026-03-30 11:22:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:22:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:22:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_8e7e8257a2a336aadda827826a7f5505.jpg>
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.8L',
'engine_horse_power': 136,
'expiration_date': '2026-03-31T15:56:16Z',
'fuel_type': 'hybrid',
'id': '7c6a321c-549c-5231-9c18-f8e36df55d15',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV81401',
'listing': 'auction',
'location': 'ES, Zaragoza',
'make': 'Toyota',
'model': 'Auris Touring Sports',
'odometer': 112369,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c6a321c-549c-5231-9c18-f8e36df55d15/7c6a321c-549c-5231-9c18-f8e36df55d15_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84167,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_8e7e8257a2a336aadda827826a7f5505.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c6a321c-549c-5231-9c18-f8e36df55d15/7c6a321c-549c-5231-9c18-f8e36df55d15_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74786,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_c4ae4bb5d94f32a3497c69aa94b6fe7c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c6a321c-549c-5231-9c18-f8e36df55d15/7c6a321c-549c-5231-9c18-f8e36df55d15_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77905,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_fed165d72cfab1d79930f241846b5ffe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c6a321c-549c-5231-9c18-f8e36df55d15/7c6a321c-549c-5231-9c18-f8e36df55d15_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72704,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_d624b426902567eb42b7872ea0e2a747.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c6a321c-549c-5231-9c18-f8e36df55d15/7c6a321c-549c-5231-9c18-f8e36df55d15_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76864,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_0c881f9a7e444a4b19c65d25ebba5c12.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c6a321c-549c-5231-9c18-f8e36df55d15/7c6a321c-549c-5231-9c18-f8e36df55d15_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75016,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_a952a3e12f7bd44e2b0889655f748ba6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c6a321c-549c-5231-9c18-f8e36df55d15/7c6a321c-549c-5231-9c18-f8e36df55d15_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73456,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_566eb98f2bf91e361714a1276ea3ca21.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c6a321c-549c-5231-9c18-f8e36df55d15/7c6a321c-549c-5231-9c18-f8e36df55d15_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75275,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_efbb3e5052bca35d78253c81af9a04c1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c6a321c-549c-5231-9c18-f8e36df55d15/7c6a321c-549c-5231-9c18-f8e36df55d15_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78527,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_89d9523d0aca16fdb4faddde863fba89.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c6a321c-549c-5231-9c18-f8e36df55d15/7c6a321c-549c-5231-9c18-f8e36df55d15_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63013,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/86/708661a42a8987a1bfdc64777b15cbb1/pa/ZV81401_54fbafc39593d60f8a5f1b27b9ecc640.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-08-30',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Auris Touring Sports 1.8 Hybrid Feel! Edition',
'transmission': 'automatic',
'trim': 'Feel! Edition',
'year': 2018}
2026-03-30 11:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZV81401%27 HTTP/1.1" 200 None
2026-03-30 11:22:58 [auto1.es] INFO: Saving data for ZV81401: {'created_time': 1774869778.308835, 'last_price_update_time': 1774869778.308847, 'auction_closing_time': 1774972576.0}
2026-03-30 11:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZV81401') HTTP/1.1" 204 0
2026-03-30 11:22:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_b10b79fa7236c13cc7d8b7adf2b76443.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_0f13aa87af1a726a52b6290be1914f98.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05aeb94d0>
2026-03-30 11:22:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1318257-9edd-51db-8086-97096264de5e/f1318257-9edd-51db-8086-97096264de5e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F9a%252Fb39af51750cfe7b42cb217e98d1e021b%252Fpa%252FEN27378_b10b79fa7236c13cc7d8b7adf2b76443.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_b10b79fa7236c13cc7d8b7adf2b76443.jpg saved to cache
2026-03-30 11:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f1318257-9edd-51db-8086-97096264de5e
2026-03-30 11:22:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a393b10>
2026-03-30 11:22:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f048c2da-a2d9-5d01-9aab-6685a1a0f538/f048c2da-a2d9-5d01-9aab-6685a1a0f538_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fb9%252F39b929b4c743e67b09662d8495de65cd%252Fpa%252FCP61201_0f13aa87af1a726a52b6290be1914f98.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_0f13aa87af1a726a52b6290be1914f98.jpg saved to cache
2026-03-30 11:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f048c2da-a2d9-5d01-9aab-6685a1a0f538
2026-03-30 11:22:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_4a04f2868b322f56f9486e437903dc93.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_2252020c966f326b05941fd775bcd5f9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_fdd5eefe3403d0c8d4d1a6fbeacdafe2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a481e90>
2026-03-30 11:22:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f048c2da-a2d9-5d01-9aab-6685a1a0f538/f048c2da-a2d9-5d01-9aab-6685a1a0f538_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fb9%252F39b929b4c743e67b09662d8495de65cd%252Fpa%252FCP61201_4a04f2868b322f56f9486e437903dc93.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_4a04f2868b322f56f9486e437903dc93.jpg saved to cache
2026-03-30 11:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f048c2da-a2d9-5d01-9aab-6685a1a0f538
2026-03-30 11:22:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_b548b91a7e6e0fca3c0e7357975ebb6f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a43e090>
2026-03-30 11:22:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f048c2da-a2d9-5d01-9aab-6685a1a0f538/f048c2da-a2d9-5d01-9aab-6685a1a0f538_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fb9%252F39b929b4c743e67b09662d8495de65cd%252Fpa%252FCP61201_2252020c966f326b05941fd775bcd5f9.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_2252020c966f326b05941fd775bcd5f9.jpg saved to cache
2026-03-30 11:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f048c2da-a2d9-5d01-9aab-6685a1a0f538
2026-03-30 11:22:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a457590>
2026-03-30 11:22:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1318257-9edd-51db-8086-97096264de5e/f1318257-9edd-51db-8086-97096264de5e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F9a%252Fb39af51750cfe7b42cb217e98d1e021b%252Fpa%252FEN27378_fdd5eefe3403d0c8d4d1a6fbeacdafe2.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_fdd5eefe3403d0c8d4d1a6fbeacdafe2.jpg saved to cache
2026-03-30 11:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f1318257-9edd-51db-8086-97096264de5e
2026-03-30 11:22:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a47f5d0>
2026-03-30 11:22:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1318257-9edd-51db-8086-97096264de5e/f1318257-9edd-51db-8086-97096264de5e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F9a%252Fb39af51750cfe7b42cb217e98d1e021b%252Fpa%252FEN27378_b548b91a7e6e0fca3c0e7357975ebb6f.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_b548b91a7e6e0fca3c0e7357975ebb6f.jpg saved to cache
2026-03-30 11:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f1318257-9edd-51db-8086-97096264de5e
2026-03-30 11:22:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_7c46506be0a552cc4f5bb491fac1e90b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_549868074fdbd8fac741bfa8b791a93f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4d4390>
2026-03-30 11:22:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f048c2da-a2d9-5d01-9aab-6685a1a0f538/f048c2da-a2d9-5d01-9aab-6685a1a0f538_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fb9%252F39b929b4c743e67b09662d8495de65cd%252Fpa%252FCP61201_7c46506be0a552cc4f5bb491fac1e90b.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_7c46506be0a552cc4f5bb491fac1e90b.jpg saved to cache
2026-03-30 11:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f048c2da-a2d9-5d01-9aab-6685a1a0f538
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4a47d0>
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f048c2da-a2d9-5d01-9aab-6685a1a0f538/f048c2da-a2d9-5d01-9aab-6685a1a0f538_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fb9%252F39b929b4c743e67b09662d8495de65cd%252Fpa%252FCP61201_549868074fdbd8fac741bfa8b791a93f.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_549868074fdbd8fac741bfa8b791a93f.jpg saved to cache
2026-03-30 11:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f048c2da-a2d9-5d01-9aab-6685a1a0f538
2026-03-30 11:22:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_ff05108c0afaae8c883d053191b29b75.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_f01f02bc5bb13ac9e30ab4d5e88e1014.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_905257932e25a58e769ddcd6c3f1fb34.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060d3d9d0>
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1318257-9edd-51db-8086-97096264de5e/f1318257-9edd-51db-8086-97096264de5e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F9a%252Fb39af51750cfe7b42cb217e98d1e021b%252Fpa%252FEN27378_ff05108c0afaae8c883d053191b29b75.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_ff05108c0afaae8c883d053191b29b75.jpg saved to cache
2026-03-30 11:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f1318257-9edd-51db-8086-97096264de5e
2026-03-30 11:22:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_0b4c95febcb5aaaeabf4491f19dd476e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4a7190>
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f048c2da-a2d9-5d01-9aab-6685a1a0f538/f048c2da-a2d9-5d01-9aab-6685a1a0f538_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fb9%252F39b929b4c743e67b09662d8495de65cd%252Fpa%252FCP61201_f01f02bc5bb13ac9e30ab4d5e88e1014.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_f01f02bc5bb13ac9e30ab4d5e88e1014.jpg saved to cache
2026-03-30 11:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f048c2da-a2d9-5d01-9aab-6685a1a0f538
2026-03-30 11:22:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_0f17f2153654c0a95b47626c5a7fc31b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4d4ad0>
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f048c2da-a2d9-5d01-9aab-6685a1a0f538/f048c2da-a2d9-5d01-9aab-6685a1a0f538_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fb9%252F39b929b4c743e67b09662d8495de65cd%252Fpa%252FCP61201_905257932e25a58e769ddcd6c3f1fb34.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_905257932e25a58e769ddcd6c3f1fb34.jpg saved to cache
2026-03-30 11:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f048c2da-a2d9-5d01-9aab-6685a1a0f538
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a382b90>
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f048c2da-a2d9-5d01-9aab-6685a1a0f538/f048c2da-a2d9-5d01-9aab-6685a1a0f538_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fb9%252F39b929b4c743e67b09662d8495de65cd%252Fpa%252FCP61201_0b4c95febcb5aaaeabf4491f19dd476e.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_0b4c95febcb5aaaeabf4491f19dd476e.jpg saved to cache
2026-03-30 11:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f048c2da-a2d9-5d01-9aab-6685a1a0f538
2026-03-30 11:22:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_75fdab8adedd172f8b387ee08d579237.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad1ce50>
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1318257-9edd-51db-8086-97096264de5e/f1318257-9edd-51db-8086-97096264de5e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F9a%252Fb39af51750cfe7b42cb217e98d1e021b%252Fpa%252FEN27378_0f17f2153654c0a95b47626c5a7fc31b.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_0f17f2153654c0a95b47626c5a7fc31b.jpg saved to cache
2026-03-30 11:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f1318257-9edd-51db-8086-97096264de5e
2026-03-30 11:22:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_fdc214577fab65742c8179ed597585fa.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_f38f4c5a5b0f812823355ef6df7e7d0a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_c92e185d759c69f6a20d9ff4bc907b20.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a325110>
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f048c2da-a2d9-5d01-9aab-6685a1a0f538/f048c2da-a2d9-5d01-9aab-6685a1a0f538_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fb9%252F39b929b4c743e67b09662d8495de65cd%252Fpa%252FCP61201_75fdab8adedd172f8b387ee08d579237.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_75fdab8adedd172f8b387ee08d579237.jpg saved to cache
2026-03-30 11:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f048c2da-a2d9-5d01-9aab-6685a1a0f538
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4d4510>
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1318257-9edd-51db-8086-97096264de5e/f1318257-9edd-51db-8086-97096264de5e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F9a%252Fb39af51750cfe7b42cb217e98d1e021b%252Fpa%252FEN27378_fdc214577fab65742c8179ed597585fa.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_fdc214577fab65742c8179ed597585fa.jpg saved to cache
2026-03-30 11:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f1318257-9edd-51db-8086-97096264de5e
2026-03-30 11:22:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_2c797abec9f755294fde7c23df9fd012.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05aee03d0>
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1318257-9edd-51db-8086-97096264de5e/f1318257-9edd-51db-8086-97096264de5e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F9a%252Fb39af51750cfe7b42cb217e98d1e021b%252Fpa%252FEN27378_f38f4c5a5b0f812823355ef6df7e7d0a.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_f38f4c5a5b0f812823355ef6df7e7d0a.jpg saved to cache
2026-03-30 11:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f1318257-9edd-51db-8086-97096264de5e
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a36ef90>
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:22:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f048c2da-a2d9-5d01-9aab-6685a1a0f538/f048c2da-a2d9-5d01-9aab-6685a1a0f538_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fb9%252F39b929b4c743e67b09662d8495de65cd%252Fpa%252FCP61201_c92e185d759c69f6a20d9ff4bc907b20.jpg') HTTP/1.1" 204 0
2026-03-30 11:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_c92e185d759c69f6a20d9ff4bc907b20.jpg saved to cache
2026-03-30 11:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f048c2da-a2d9-5d01-9aab-6685a1a0f538
2026-03-30 11:22:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f048c2da-a2d9-5d01-9aab-6685a1a0f538, skipping ID generation
2026-03-30 11:22:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f048c2da-a2d9-5d01-9aab-6685a1a0f538 with scrape type 1
2026-03-30 11:22:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f048c2da-a2d9-5d01-9aab-6685a1a0f538 sending to next pipeline
2026-03-30 11:22:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f048c2da-a2d9-5d01-9aab-6685a1a0f538, identifier: CP61201
2026-03-30 11:22:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f048c2da-a2d9-5d01-9aab-6685a1a0f538 with identifier: CP61201
2026-03-30 11:22:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f048c2da-a2d9-5d01-9aab-6685a1a0f538 with identifier: CP61201
2026-03-30 11:22:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f048c2da-a2d9-5d01-9aab-6685a1a0f538 with identifier: CP61201 to the API
2026-03-30 11:22:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:23:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:23:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_c92e185d759c69f6a20d9ff4bc907b20.jpg>
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2026-03-31T15:45:35Z',
'fuel_type': 'petrol',
'id': 'f048c2da-a2d9-5d01-9aab-6685a1a0f538',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP61201',
'listing': 'auction',
'location': 'ES, Figueres',
'make': 'Peugeot',
'model': '208',
'odometer': 83377,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f048c2da-a2d9-5d01-9aab-6685a1a0f538/f048c2da-a2d9-5d01-9aab-6685a1a0f538_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75928,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_c92e185d759c69f6a20d9ff4bc907b20.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f048c2da-a2d9-5d01-9aab-6685a1a0f538/f048c2da-a2d9-5d01-9aab-6685a1a0f538_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75928,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_75fdab8adedd172f8b387ee08d579237.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f048c2da-a2d9-5d01-9aab-6685a1a0f538/f048c2da-a2d9-5d01-9aab-6685a1a0f538_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75288,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_0b4c95febcb5aaaeabf4491f19dd476e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f048c2da-a2d9-5d01-9aab-6685a1a0f538/f048c2da-a2d9-5d01-9aab-6685a1a0f538_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61919,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_905257932e25a58e769ddcd6c3f1fb34.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f048c2da-a2d9-5d01-9aab-6685a1a0f538/f048c2da-a2d9-5d01-9aab-6685a1a0f538_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67610,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_f01f02bc5bb13ac9e30ab4d5e88e1014.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f048c2da-a2d9-5d01-9aab-6685a1a0f538/f048c2da-a2d9-5d01-9aab-6685a1a0f538_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77625,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_0f13aa87af1a726a52b6290be1914f98.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f048c2da-a2d9-5d01-9aab-6685a1a0f538/f048c2da-a2d9-5d01-9aab-6685a1a0f538_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59047,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_549868074fdbd8fac741bfa8b791a93f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f048c2da-a2d9-5d01-9aab-6685a1a0f538/f048c2da-a2d9-5d01-9aab-6685a1a0f538_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73054,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_7c46506be0a552cc4f5bb491fac1e90b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f048c2da-a2d9-5d01-9aab-6685a1a0f538/f048c2da-a2d9-5d01-9aab-6685a1a0f538_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79125,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_4a04f2868b322f56f9486e437903dc93.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f048c2da-a2d9-5d01-9aab-6685a1a0f538/f048c2da-a2d9-5d01-9aab-6685a1a0f538_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73848,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/b9/39b929b4c743e67b09662d8495de65cd/pa/CP61201_2252020c966f326b05941fd775bcd5f9.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-11-24',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 VTi Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2014}
2026-03-30 11:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CP61201%27 HTTP/1.1" 200 None
2026-03-30 11:23:00 [auto1.es] INFO: Saving data for CP61201: {'created_time': 1774869780.444844, 'last_price_update_time': 1774869780.444856, 'auction_closing_time': 1774971935.0}
2026-03-30 11:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CP61201') HTTP/1.1" 204 0
2026-03-30 11:23:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05aefbfd0>
2026-03-30 11:23:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1318257-9edd-51db-8086-97096264de5e/f1318257-9edd-51db-8086-97096264de5e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F9a%252Fb39af51750cfe7b42cb217e98d1e021b%252Fpa%252FEN27378_2c797abec9f755294fde7c23df9fd012.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_2c797abec9f755294fde7c23df9fd012.jpg saved to cache
2026-03-30 11:23:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f1318257-9edd-51db-8086-97096264de5e
2026-03-30 11:23:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f1318257-9edd-51db-8086-97096264de5e, skipping ID generation
2026-03-30 11:23:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1318257-9edd-51db-8086-97096264de5e with scrape type 1
2026-03-30 11:23:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f1318257-9edd-51db-8086-97096264de5e sending to next pipeline
2026-03-30 11:23:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f1318257-9edd-51db-8086-97096264de5e, identifier: EN27378
2026-03-30 11:23:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f1318257-9edd-51db-8086-97096264de5e with identifier: EN27378
2026-03-30 11:23:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f1318257-9edd-51db-8086-97096264de5e with identifier: EN27378
2026-03-30 11:23:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f1318257-9edd-51db-8086-97096264de5e with identifier: EN27378 to the API
2026-03-30 11:23:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:23:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:23:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_2c797abec9f755294fde7c23df9fd012.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2026-03-31T15:39:29Z',
'fuel_type': 'diesel',
'id': 'f1318257-9edd-51db-8086-97096264de5e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN27378',
'listing': 'auction',
'location': 'ES, Lleida',
'make': 'Dacia',
'model': 'Duster',
'odometer': 104122,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1318257-9edd-51db-8086-97096264de5e/f1318257-9edd-51db-8086-97096264de5e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68808,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_d4a1f1451f0ef3c24251ad8348374cf8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1318257-9edd-51db-8086-97096264de5e/f1318257-9edd-51db-8086-97096264de5e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70018,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_2c797abec9f755294fde7c23df9fd012.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1318257-9edd-51db-8086-97096264de5e/f1318257-9edd-51db-8086-97096264de5e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63923,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_fdc214577fab65742c8179ed597585fa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1318257-9edd-51db-8086-97096264de5e/f1318257-9edd-51db-8086-97096264de5e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52939,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_f38f4c5a5b0f812823355ef6df7e7d0a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1318257-9edd-51db-8086-97096264de5e/f1318257-9edd-51db-8086-97096264de5e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56738,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_fe36cd183ff4a6fa095f17b2fe93d02d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1318257-9edd-51db-8086-97096264de5e/f1318257-9edd-51db-8086-97096264de5e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70343,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_0f17f2153654c0a95b47626c5a7fc31b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1318257-9edd-51db-8086-97096264de5e/f1318257-9edd-51db-8086-97096264de5e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55729,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_ff05108c0afaae8c883d053191b29b75.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1318257-9edd-51db-8086-97096264de5e/f1318257-9edd-51db-8086-97096264de5e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71340,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_b10b79fa7236c13cc7d8b7adf2b76443.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1318257-9edd-51db-8086-97096264de5e/f1318257-9edd-51db-8086-97096264de5e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68037,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_b548b91a7e6e0fca3c0e7357975ebb6f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1318257-9edd-51db-8086-97096264de5e/f1318257-9edd-51db-8086-97096264de5e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74419,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/9a/b39af51750cfe7b42cb217e98d1e021b/pa/EN27378_fdd5eefe3403d0c8d4d1a6fbeacdafe2.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-05-23',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Duster 1.5 Blue dCi Essential 4x4',
'transmission': 'manual',
'trim': 'Essential 4x4',
'year': 2022}
2026-03-30 11:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN27378%27 HTTP/1.1" 200 None
2026-03-30 11:23:00 [auto1.es] INFO: Saving data for EN27378: {'created_time': 1774869780.9553, 'last_price_update_time': 1774869780.955311, 'auction_closing_time': 1774971569.0}
2026-03-30 11:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EN27378') HTTP/1.1" 204 0
2026-03-30 11:23:02 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 268.303(s), this was the 2nd time calling it.
2026-03-30 11:23:02 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.811188892799847 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:23:04 [scrapy.extensions.logstats] INFO: Crawled 106 pages (at 11 pages/min), scraped 118 items (at 19 items/min)
2026-03-30 11:23:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 161MiB
2026-03-30 11:23:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WR66787> (referer: https://www.auto1.com/v1/car-details-view/WR66787/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:23:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:23:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4df8a987-ab73-5cb8-a11f-7c8a182cfa12 with identifier: WR66787
2026-03-30 11:23:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4df8a987-ab73-5cb8-a11f-7c8a182cfa12 with scrape type 1
2026-03-30 11:23:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 4df8a987-ab73-5cb8-a11f-7c8a182cfa12
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F18%252F681829563a634603284594c62cc7299e%252Fpa%252FWR66787_4eb7031f51eb9c135d8e34db9178fa55.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/18/681829563a634603284594c62cc7299e/pa/WR66787_4eb7031f51eb9c135d8e34db9178fa55.jpg already downloaded
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F18%252F681829563a634603284594c62cc7299e%252Fpa%252FWR66787_5d085d92394b2ffc659901b032ddffed.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/18/681829563a634603284594c62cc7299e/pa/WR66787_5d085d92394b2ffc659901b032ddffed.jpg already downloaded
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F18%252F681829563a634603284594c62cc7299e%252Fpa%252FWR66787_1fdd3b31bee14964da2f1dabddc4aba7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/18/681829563a634603284594c62cc7299e/pa/WR66787_1fdd3b31bee14964da2f1dabddc4aba7.jpg already downloaded
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F18%252F681829563a634603284594c62cc7299e%252Fpa%252FWR66787_f72e51e6c3dff606bc849bfa6062ce12.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/18/681829563a634603284594c62cc7299e/pa/WR66787_f72e51e6c3dff606bc849bfa6062ce12.jpg already downloaded
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F18%252F681829563a634603284594c62cc7299e%252Fpa%252FWR66787_ebbdebf0ba86b1eb85e97d7c672f3046.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/18/681829563a634603284594c62cc7299e/pa/WR66787_ebbdebf0ba86b1eb85e97d7c672f3046.jpg already downloaded
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F18%252F681829563a634603284594c62cc7299e%252Fpa%252FWR66787_c551dbf61953f49da54c170971e95fad.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/18/681829563a634603284594c62cc7299e/pa/WR66787_c551dbf61953f49da54c170971e95fad.jpg already downloaded
2026-03-30 11:23:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4df8a987-ab73-5cb8-a11f-7c8a182cfa12, identifier: WR66787
2026-03-30 11:23:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4df8a987-ab73-5cb8-a11f-7c8a182cfa12 with identifier: WR66787
2026-03-30 11:23:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4df8a987-ab73-5cb8-a11f-7c8a182cfa12 with identifier: WR66787
2026-03-30 11:23:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4df8a987-ab73-5cb8-a11f-7c8a182cfa12 with identifier: WR66787 to the API
2026-03-30 11:23:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:23:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:23:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WR66787>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.0L',
'engine_horse_power': 177,
'expiration_date': '2026-03-31T15:54:35Z',
'fuel_type': 'diesel',
'id': '4df8a987-ab73-5cb8-a11f-7c8a182cfa12',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR66787',
'listing': 'auction',
'location': 'ES, Alcalá de Henares, Madrid',
'make': 'BMW',
'model': '3er',
'odometer': 284432,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img68/18/681829563a634603284594c62cc7299e/pa/WR66787_4eb7031f51eb9c135d8e34db9178fa55.jpg',
'https://img-pa.auto1.com/img68/18/681829563a634603284594c62cc7299e/pa/WR66787_5d085d92394b2ffc659901b032ddffed.jpg',
'https://img-pa.auto1.com/img68/18/681829563a634603284594c62cc7299e/pa/WR66787_1fdd3b31bee14964da2f1dabddc4aba7.jpg',
'https://img-pa.auto1.com/img68/18/681829563a634603284594c62cc7299e/pa/WR66787_f72e51e6c3dff606bc849bfa6062ce12.jpg',
'https://img-pa.auto1.com/img68/18/681829563a634603284594c62cc7299e/pa/WR66787_ebbdebf0ba86b1eb85e97d7c672f3046.jpg',
'https://img-pa.auto1.com/img68/18/681829563a634603284594c62cc7299e/pa/WR66787_c551dbf61953f49da54c170971e95fad.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4df8a987-ab73-5cb8-a11f-7c8a182cfa12/4df8a987-ab73-5cb8-a11f-7c8a182cfa12_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108862,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/18/681829563a634603284594c62cc7299e/pa/WR66787_4eb7031f51eb9c135d8e34db9178fa55.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4df8a987-ab73-5cb8-a11f-7c8a182cfa12/4df8a987-ab73-5cb8-a11f-7c8a182cfa12_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 120244,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/18/681829563a634603284594c62cc7299e/pa/WR66787_5d085d92394b2ffc659901b032ddffed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4df8a987-ab73-5cb8-a11f-7c8a182cfa12/4df8a987-ab73-5cb8-a11f-7c8a182cfa12_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83194,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/18/681829563a634603284594c62cc7299e/pa/WR66787_1fdd3b31bee14964da2f1dabddc4aba7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4df8a987-ab73-5cb8-a11f-7c8a182cfa12/4df8a987-ab73-5cb8-a11f-7c8a182cfa12_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82428,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/18/681829563a634603284594c62cc7299e/pa/WR66787_f72e51e6c3dff606bc849bfa6062ce12.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4df8a987-ab73-5cb8-a11f-7c8a182cfa12/4df8a987-ab73-5cb8-a11f-7c8a182cfa12_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46243,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/18/681829563a634603284594c62cc7299e/pa/WR66787_ebbdebf0ba86b1eb85e97d7c672f3046.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4df8a987-ab73-5cb8-a11f-7c8a182cfa12/4df8a987-ab73-5cb8-a11f-7c8a182cfa12_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103749,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/18/681829563a634603284594c62cc7299e/pa/WR66787_c551dbf61953f49da54c170971e95fad.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-04-20',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 3er 320d',
'transmission': 'manual',
'trim': '',
'year': 2009}
2026-03-30 11:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WR66787%27 HTTP/1.1" 200 None
2026-03-30 11:23:06 [auto1.es] INFO: Saving data for WR66787: {'created_time': 1774869786.427047, 'last_price_update_time': 1774869786.427058, 'auction_closing_time': 1774972475.0}
2026-03-30 11:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WR66787') HTTP/1.1" 204 0
2026-03-30 11:23:06 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.038(s), this was the 1st time calling it.
2026-03-30 11:23:06 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.062519170448006 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:23:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JZ58453> (referer: https://www.auto1.com/v1/car-details-view/JZ58453/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:23:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:23:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc7bde83-13de-593f-be1d-1847714e8007 with identifier: JZ58453
2026-03-30 11:23:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc7bde83-13de-593f-be1d-1847714e8007 with scrape type 1
2026-03-30 11:23:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dc7bde83-13de-593f-be1d-1847714e8007
2026-03-30 11:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F86%252F4286f63d508733a13fe8f55786758f77%252Fpa%252FJZ58453_f96a3ee12d6a11f3e90590790729986f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_f96a3ee12d6a11f3e90590790729986f.jpg not downloaded yet
2026-03-30 11:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F86%252F4286f63d508733a13fe8f55786758f77%252Fpa%252FJZ58453_e023d2844c5042935ee257ef20dc2606.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_e023d2844c5042935ee257ef20dc2606.jpg not downloaded yet
2026-03-30 11:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F86%252F4286f63d508733a13fe8f55786758f77%252Fpa%252FJZ58453_ba52396a08cb25ca2f37795b843205ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_ba52396a08cb25ca2f37795b843205ae.jpg not downloaded yet
2026-03-30 11:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F86%252F4286f63d508733a13fe8f55786758f77%252Fpa%252FJZ58453_41a4896ba267954df3e29d55051d0534.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_41a4896ba267954df3e29d55051d0534.jpg not downloaded yet
2026-03-30 11:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F86%252F4286f63d508733a13fe8f55786758f77%252Fpa%252FJZ58453_0eb25c48b1fc2893f8d79f0bd4d77478.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_0eb25c48b1fc2893f8d79f0bd4d77478.jpg not downloaded yet
2026-03-30 11:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F86%252F4286f63d508733a13fe8f55786758f77%252Fpa%252FJZ58453_ff54a79a6bb0d95a06e740ce17522443.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_ff54a79a6bb0d95a06e740ce17522443.jpg not downloaded yet
2026-03-30 11:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F86%252F4286f63d508733a13fe8f55786758f77%252Fpa%252FJZ58453_3a398a0bd75573f4a90a9f04ad741a5a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_3a398a0bd75573f4a90a9f04ad741a5a.jpg not downloaded yet
2026-03-30 11:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F86%252F4286f63d508733a13fe8f55786758f77%252Fpa%252FJZ58453_f1f75d6b972ad03065c73a2dbf6d2623.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_f1f75d6b972ad03065c73a2dbf6d2623.jpg not downloaded yet
2026-03-30 11:23:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_f96a3ee12d6a11f3e90590790729986f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F86%252F4286f63d508733a13fe8f55786758f77%252Fpa%252FJZ58453_7705fcb53df6829aee8378c7ac25d61a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_7705fcb53df6829aee8378c7ac25d61a.jpg not downloaded yet
2026-03-30 11:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F86%252F4286f63d508733a13fe8f55786758f77%252Fpa%252FJZ58453_6d0654fb904273dc37ed6f98335d2c66.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_6d0654fb904273dc37ed6f98335d2c66.jpg not downloaded yet
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x04\x00\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x03\x00\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 46 - Data Location: 158 - value: b'samsung\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 166 - value: b'Galaxy A26 5G\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 180 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 94 - Data Location: 188 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 196 - value: b'A266BXXS4AYG9\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 130 - Data Location: 210 - value: b'2026:03:02 10:58:42\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x01\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xe6\x00\x00\x00'
2026-03-30 11:23:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3658d0>
2026-03-30 11:23:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc7bde83-13de-593f-be1d-1847714e8007/dc7bde83-13de-593f-be1d-1847714e8007_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F86%252F4286f63d508733a13fe8f55786758f77%252Fpa%252FJZ58453_f96a3ee12d6a11f3e90590790729986f.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_f96a3ee12d6a11f3e90590790729986f.jpg saved to cache
2026-03-30 11:23:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dc7bde83-13de-593f-be1d-1847714e8007
2026-03-30 11:23:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_f1f75d6b972ad03065c73a2dbf6d2623.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_6d0654fb904273dc37ed6f98335d2c66.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x04\x00\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x03\x00\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 46 - Data Location: 158 - value: b'samsung\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 166 - value: b'Galaxy A26 5G\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 180 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 94 - Data Location: 188 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 196 - value: b'A266BXXS4AYG9\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 130 - Data Location: 210 - value: b'2026:03:02 10:59:33\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x01\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xe6\x00\x00\x00'
2026-03-30 11:23:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a35bc50>
2026-03-30 11:23:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc7bde83-13de-593f-be1d-1847714e8007/dc7bde83-13de-593f-be1d-1847714e8007_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F86%252F4286f63d508733a13fe8f55786758f77%252Fpa%252FJZ58453_f1f75d6b972ad03065c73a2dbf6d2623.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_f1f75d6b972ad03065c73a2dbf6d2623.jpg saved to cache
2026-03-30 11:23:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dc7bde83-13de-593f-be1d-1847714e8007
2026-03-30 11:23:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_7705fcb53df6829aee8378c7ac25d61a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x04\x00\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x03\x00\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 46 - Data Location: 158 - value: b'samsung\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 166 - value: b'Galaxy A26 5G\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 180 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 94 - Data Location: 188 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 196 - value: b'A266BXXS4AYG9\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 130 - Data Location: 210 - value: b'2026:03:02 10:59:58\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x01\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xe6\x00\x00\x00'
2026-03-30 11:23:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a358590>
2026-03-30 11:23:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc7bde83-13de-593f-be1d-1847714e8007/dc7bde83-13de-593f-be1d-1847714e8007_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F86%252F4286f63d508733a13fe8f55786758f77%252Fpa%252FJZ58453_6d0654fb904273dc37ed6f98335d2c66.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_6d0654fb904273dc37ed6f98335d2c66.jpg saved to cache
2026-03-30 11:23:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dc7bde83-13de-593f-be1d-1847714e8007
2026-03-30 11:23:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_3a398a0bd75573f4a90a9f04ad741a5a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x04\x00\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x03\x00\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 46 - Data Location: 158 - value: b'samsung\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 166 - value: b'Galaxy A26 5G\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 180 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 94 - Data Location: 188 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 196 - value: b'A266BXXS4AYG9\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 130 - Data Location: 210 - value: b'2026:03:02 10:59:41\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x01\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xe6\x00\x00\x00'
2026-03-30 11:23:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05aebbd10>
2026-03-30 11:23:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc7bde83-13de-593f-be1d-1847714e8007/dc7bde83-13de-593f-be1d-1847714e8007_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F86%252F4286f63d508733a13fe8f55786758f77%252Fpa%252FJZ58453_7705fcb53df6829aee8378c7ac25d61a.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_7705fcb53df6829aee8378c7ac25d61a.jpg saved to cache
2026-03-30 11:23:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dc7bde83-13de-593f-be1d-1847714e8007
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x04\x00\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x03\x00\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 46 - Data Location: 158 - value: b'samsung\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 166 - value: b'Galaxy A26 5G\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 180 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 94 - Data Location: 188 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 196 - value: b'A266BXXS4AYG9\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 130 - Data Location: 210 - value: b'2026:03:02 10:58:38\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x01\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xe6\x00\x00\x00'
2026-03-30 11:23:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad7bdd0>
2026-03-30 11:23:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc7bde83-13de-593f-be1d-1847714e8007/dc7bde83-13de-593f-be1d-1847714e8007_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F86%252F4286f63d508733a13fe8f55786758f77%252Fpa%252FJZ58453_3a398a0bd75573f4a90a9f04ad741a5a.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_3a398a0bd75573f4a90a9f04ad741a5a.jpg saved to cache
2026-03-30 11:23:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dc7bde83-13de-593f-be1d-1847714e8007
2026-03-30 11:23:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_ff54a79a6bb0d95a06e740ce17522443.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_0eb25c48b1fc2893f8d79f0bd4d77478.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x04\x00\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x03\x00\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 46 - Data Location: 158 - value: b'samsung\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 166 - value: b'Galaxy A26 5G\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 180 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 94 - Data Location: 188 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 196 - value: b'A266BXXS4AYG9\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 130 - Data Location: 210 - value: b'2026:03:02 10:59:08\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x01\x00'
2026-03-30 11:23:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xe6\x00\x00\x00'
2026-03-30 11:23:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a390dd0>
2026-03-30 11:23:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc7bde83-13de-593f-be1d-1847714e8007/dc7bde83-13de-593f-be1d-1847714e8007_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:23:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F86%252F4286f63d508733a13fe8f55786758f77%252Fpa%252FJZ58453_ff54a79a6bb0d95a06e740ce17522443.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_ff54a79a6bb0d95a06e740ce17522443.jpg saved to cache
2026-03-30 11:23:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dc7bde83-13de-593f-be1d-1847714e8007
2026-03-30 11:23:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_41a4896ba267954df3e29d55051d0534.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x04\x00\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x03\x00\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 46 - Data Location: 158 - value: b'samsung\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 166 - value: b'Galaxy A26 5G\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 180 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 94 - Data Location: 188 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 196 - value: b'A266BXXS4AYG9\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 130 - Data Location: 210 - value: b'2026:03:02 10:59:02\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x01\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xe6\x00\x00\x00'
2026-03-30 11:23:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a367410>
2026-03-30 11:23:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc7bde83-13de-593f-be1d-1847714e8007/dc7bde83-13de-593f-be1d-1847714e8007_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:23:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F86%252F4286f63d508733a13fe8f55786758f77%252Fpa%252FJZ58453_0eb25c48b1fc2893f8d79f0bd4d77478.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_0eb25c48b1fc2893f8d79f0bd4d77478.jpg saved to cache
2026-03-30 11:23:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dc7bde83-13de-593f-be1d-1847714e8007
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x04\x00\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x03\x00\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 46 - Data Location: 158 - value: b'samsung\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 166 - value: b'Galaxy A26 5G\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 180 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 94 - Data Location: 188 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 196 - value: b'A266BXXS4AYG9\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 130 - Data Location: 210 - value: b'2026:03:02 10:58:59\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x01\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xe6\x00\x00\x00'
2026-03-30 11:23:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad1eb10>
2026-03-30 11:23:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc7bde83-13de-593f-be1d-1847714e8007/dc7bde83-13de-593f-be1d-1847714e8007_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:23:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F86%252F4286f63d508733a13fe8f55786758f77%252Fpa%252FJZ58453_41a4896ba267954df3e29d55051d0534.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_41a4896ba267954df3e29d55051d0534.jpg saved to cache
2026-03-30 11:23:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dc7bde83-13de-593f-be1d-1847714e8007
2026-03-30 11:23:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_ba52396a08cb25ca2f37795b843205ae.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_e023d2844c5042935ee257ef20dc2606.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x04\x00\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x03\x00\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 46 - Data Location: 158 - value: b'samsung\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 166 - value: b'Galaxy A26 5G\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 180 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 94 - Data Location: 188 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 196 - value: b'A266BXXS4AYG9\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 130 - Data Location: 210 - value: b'2026:03:02 10:58:55\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x01\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xe6\x00\x00\x00'
2026-03-30 11:23:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a35ac50>
2026-03-30 11:23:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc7bde83-13de-593f-be1d-1847714e8007/dc7bde83-13de-593f-be1d-1847714e8007_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:23:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F86%252F4286f63d508733a13fe8f55786758f77%252Fpa%252FJZ58453_ba52396a08cb25ca2f37795b843205ae.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_ba52396a08cb25ca2f37795b843205ae.jpg saved to cache
2026-03-30 11:23:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dc7bde83-13de-593f-be1d-1847714e8007
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x04\x00\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x03\x00\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 46 - Data Location: 158 - value: b'samsung\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 166 - value: b'Galaxy A26 5G\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 180 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 94 - Data Location: 188 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 196 - value: b'A266BXXS4AYG9\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 130 - Data Location: 210 - value: b'2026:03:02 10:58:42\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x01\x00'
2026-03-30 11:23:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xe6\x00\x00\x00'
2026-03-30 11:23:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a467110>
2026-03-30 11:23:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc7bde83-13de-593f-be1d-1847714e8007/dc7bde83-13de-593f-be1d-1847714e8007_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:23:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F86%252F4286f63d508733a13fe8f55786758f77%252Fpa%252FJZ58453_e023d2844c5042935ee257ef20dc2606.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_e023d2844c5042935ee257ef20dc2606.jpg saved to cache
2026-03-30 11:23:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dc7bde83-13de-593f-be1d-1847714e8007
2026-03-30 11:23:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc7bde83-13de-593f-be1d-1847714e8007, skipping ID generation
2026-03-30 11:23:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc7bde83-13de-593f-be1d-1847714e8007 with scrape type 1
2026-03-30 11:23:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dc7bde83-13de-593f-be1d-1847714e8007 sending to next pipeline
2026-03-30 11:23:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dc7bde83-13de-593f-be1d-1847714e8007, identifier: JZ58453
2026-03-30 11:23:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dc7bde83-13de-593f-be1d-1847714e8007 with identifier: JZ58453
2026-03-30 11:23:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dc7bde83-13de-593f-be1d-1847714e8007 with identifier: JZ58453
2026-03-30 11:23:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dc7bde83-13de-593f-be1d-1847714e8007 with identifier: JZ58453 to the API
2026-03-30 11:23:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:23:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:23:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_e023d2844c5042935ee257ef20dc2606.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:28:45Z',
'fuel_type': 'diesel',
'id': 'dc7bde83-13de-593f-be1d-1847714e8007',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ58453',
'listing': 'auction',
'location': 'ES',
'make': 'Renault',
'model': 'Kangoo',
'odometer': 262743,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc7bde83-13de-593f-be1d-1847714e8007/dc7bde83-13de-593f-be1d-1847714e8007_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 275973,
'Height': 768,
'OriginUrl': 'https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_f96a3ee12d6a11f3e90590790729986f.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc7bde83-13de-593f-be1d-1847714e8007/dc7bde83-13de-593f-be1d-1847714e8007_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 275973,
'Height': 768,
'OriginUrl': 'https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_e023d2844c5042935ee257ef20dc2606.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc7bde83-13de-593f-be1d-1847714e8007/dc7bde83-13de-593f-be1d-1847714e8007_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 238853,
'Height': 768,
'OriginUrl': 'https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_ba52396a08cb25ca2f37795b843205ae.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc7bde83-13de-593f-be1d-1847714e8007/dc7bde83-13de-593f-be1d-1847714e8007_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 224611,
'Height': 768,
'OriginUrl': 'https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_41a4896ba267954df3e29d55051d0534.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc7bde83-13de-593f-be1d-1847714e8007/dc7bde83-13de-593f-be1d-1847714e8007_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 263116,
'Height': 768,
'OriginUrl': 'https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_0eb25c48b1fc2893f8d79f0bd4d77478.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc7bde83-13de-593f-be1d-1847714e8007/dc7bde83-13de-593f-be1d-1847714e8007_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295845,
'Height': 768,
'OriginUrl': 'https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_ff54a79a6bb0d95a06e740ce17522443.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc7bde83-13de-593f-be1d-1847714e8007/dc7bde83-13de-593f-be1d-1847714e8007_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 261357,
'Height': 768,
'OriginUrl': 'https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_3a398a0bd75573f4a90a9f04ad741a5a.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc7bde83-13de-593f-be1d-1847714e8007/dc7bde83-13de-593f-be1d-1847714e8007_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 252523,
'Height': 768,
'OriginUrl': 'https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_f1f75d6b972ad03065c73a2dbf6d2623.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc7bde83-13de-593f-be1d-1847714e8007/dc7bde83-13de-593f-be1d-1847714e8007_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 238781,
'Height': 768,
'OriginUrl': 'https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_7705fcb53df6829aee8378c7ac25d61a.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc7bde83-13de-593f-be1d-1847714e8007/dc7bde83-13de-593f-be1d-1847714e8007_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 223741,
'Height': 768,
'OriginUrl': 'https://img-pa.auto1.com/img42/86/4286f63d508733a13fe8f55786758f77/pa/JZ58453_6d0654fb904273dc37ed6f98335d2c66.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-07-18',
'seats_number': 2,
'seller_name': None,
'title': 'Renault Kangoo 1.5 dCi Furgón Professional',
'transmission': 'manual',
'trim': 'Furgón Professional',
'year': 2019}
2026-03-30 11:23:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JZ58453%27 HTTP/1.1" 200 None
2026-03-30 11:23:09 [auto1.es] INFO: Saving data for JZ58453: {'created_time': 1774869789.952565, 'last_price_update_time': 1774869789.952578, 'auction_closing_time': 1774970925.0}
2026-03-30 11:23:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JZ58453') HTTP/1.1" 204 0
2026-03-30 11:23:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KV96950/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:23:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:23:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:23:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NN28025> (referer: https://www.auto1.com/v1/car-details-view/NN28025/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:23:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:23:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 732aaa97-a1cf-5f60-bff1-080d30b24bad with identifier: NN28025
2026-03-30 11:23:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 732aaa97-a1cf-5f60-bff1-080d30b24bad with scrape type 1
2026-03-30 11:23:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 732aaa97-a1cf-5f60-bff1-080d30b24bad
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F68%252F12689eb7e6ce2612c0c664bd48f2c49f%252Fpa%252FNN28025_10afe25b754a91415fe69236ce52bf78.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_10afe25b754a91415fe69236ce52bf78.jpg not downloaded yet
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F68%252F12689eb7e6ce2612c0c664bd48f2c49f%252Fpa%252FNN28025_727b90f34e490897616f06e83be58705.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_727b90f34e490897616f06e83be58705.jpg not downloaded yet
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F68%252F12689eb7e6ce2612c0c664bd48f2c49f%252Fpa%252FNN28025_e9d8632030273fc2462df9c2b553d47e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_e9d8632030273fc2462df9c2b553d47e.jpg not downloaded yet
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F68%252F12689eb7e6ce2612c0c664bd48f2c49f%252Fpa%252FNN28025_bb49aa5e37169f0423d7b1813d221958.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_bb49aa5e37169f0423d7b1813d221958.jpg not downloaded yet
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F68%252F12689eb7e6ce2612c0c664bd48f2c49f%252Fpa%252FNN28025_ced294bbf54eb686fdc7c199a75b2267.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_ced294bbf54eb686fdc7c199a75b2267.jpg not downloaded yet
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F68%252F12689eb7e6ce2612c0c664bd48f2c49f%252Fpa%252FNN28025_3495ab276ca5dfef68b68e512bd502c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_3495ab276ca5dfef68b68e512bd502c5.jpg not downloaded yet
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F68%252F12689eb7e6ce2612c0c664bd48f2c49f%252Fpa%252FNN28025_cd436ee0b21ca673fa630f0851de0f0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_cd436ee0b21ca673fa630f0851de0f0b.jpg not downloaded yet
2026-03-30 11:23:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_10afe25b754a91415fe69236ce52bf78.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_727b90f34e490897616f06e83be58705.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F68%252F12689eb7e6ce2612c0c664bd48f2c49f%252Fpa%252FNN28025_6e3283051d1839305c7a79efddfb79e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_6e3283051d1839305c7a79efddfb79e3.jpg not downloaded yet
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F68%252F12689eb7e6ce2612c0c664bd48f2c49f%252Fpa%252FNN28025_9e2d5ba40ae123c657652df415ebaf7d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_9e2d5ba40ae123c657652df415ebaf7d.jpg not downloaded yet
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F68%252F12689eb7e6ce2612c0c664bd48f2c49f%252Fpa%252FNN28025_313550bdf625706b7da7f24dd8c90953.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_313550bdf625706b7da7f24dd8c90953.jpg not downloaded yet
2026-03-30 11:23:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_cd436ee0b21ca673fa630f0851de0f0b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_3495ab276ca5dfef68b68e512bd502c5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a335ad0>
2026-03-30 11:23:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_732aaa97-a1cf-5f60-bff1-080d30b24bad/732aaa97-a1cf-5f60-bff1-080d30b24bad_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F68%252F12689eb7e6ce2612c0c664bd48f2c49f%252Fpa%252FNN28025_10afe25b754a91415fe69236ce52bf78.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_10afe25b754a91415fe69236ce52bf78.jpg saved to cache
2026-03-30 11:23:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 732aaa97-a1cf-5f60-bff1-080d30b24bad
2026-03-30 11:23:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_313550bdf625706b7da7f24dd8c90953.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a466590>
2026-03-30 11:23:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_732aaa97-a1cf-5f60-bff1-080d30b24bad/732aaa97-a1cf-5f60-bff1-080d30b24bad_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F68%252F12689eb7e6ce2612c0c664bd48f2c49f%252Fpa%252FNN28025_727b90f34e490897616f06e83be58705.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_727b90f34e490897616f06e83be58705.jpg saved to cache
2026-03-30 11:23:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 732aaa97-a1cf-5f60-bff1-080d30b24bad
2026-03-30 11:23:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a32ded0>
2026-03-30 11:23:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_732aaa97-a1cf-5f60-bff1-080d30b24bad/732aaa97-a1cf-5f60-bff1-080d30b24bad_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F68%252F12689eb7e6ce2612c0c664bd48f2c49f%252Fpa%252FNN28025_cd436ee0b21ca673fa630f0851de0f0b.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_cd436ee0b21ca673fa630f0851de0f0b.jpg saved to cache
2026-03-30 11:23:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 732aaa97-a1cf-5f60-bff1-080d30b24bad
2026-03-30 11:23:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a346710>
2026-03-30 11:23:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_732aaa97-a1cf-5f60-bff1-080d30b24bad/732aaa97-a1cf-5f60-bff1-080d30b24bad_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:23:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F68%252F12689eb7e6ce2612c0c664bd48f2c49f%252Fpa%252FNN28025_3495ab276ca5dfef68b68e512bd502c5.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_3495ab276ca5dfef68b68e512bd502c5.jpg saved to cache
2026-03-30 11:23:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 732aaa97-a1cf-5f60-bff1-080d30b24bad
2026-03-30 11:23:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_9e2d5ba40ae123c657652df415ebaf7d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_6e3283051d1839305c7a79efddfb79e3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a301d50>
2026-03-30 11:23:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_732aaa97-a1cf-5f60-bff1-080d30b24bad/732aaa97-a1cf-5f60-bff1-080d30b24bad_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:23:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F68%252F12689eb7e6ce2612c0c664bd48f2c49f%252Fpa%252FNN28025_313550bdf625706b7da7f24dd8c90953.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_313550bdf625706b7da7f24dd8c90953.jpg saved to cache
2026-03-30 11:23:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 732aaa97-a1cf-5f60-bff1-080d30b24bad
2026-03-30 11:23:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_ced294bbf54eb686fdc7c199a75b2267.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3376d0>
2026-03-30 11:23:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_732aaa97-a1cf-5f60-bff1-080d30b24bad/732aaa97-a1cf-5f60-bff1-080d30b24bad_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:23:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F68%252F12689eb7e6ce2612c0c664bd48f2c49f%252Fpa%252FNN28025_9e2d5ba40ae123c657652df415ebaf7d.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_9e2d5ba40ae123c657652df415ebaf7d.jpg saved to cache
2026-03-30 11:23:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 732aaa97-a1cf-5f60-bff1-080d30b24bad
2026-03-30 11:23:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_bb49aa5e37169f0423d7b1813d221958.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_e9d8632030273fc2462df9c2b553d47e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3b3e50>
2026-03-30 11:23:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_732aaa97-a1cf-5f60-bff1-080d30b24bad/732aaa97-a1cf-5f60-bff1-080d30b24bad_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:23:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F68%252F12689eb7e6ce2612c0c664bd48f2c49f%252Fpa%252FNN28025_6e3283051d1839305c7a79efddfb79e3.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_6e3283051d1839305c7a79efddfb79e3.jpg saved to cache
2026-03-30 11:23:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 732aaa97-a1cf-5f60-bff1-080d30b24bad
2026-03-30 11:23:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a33e410>
2026-03-30 11:23:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_732aaa97-a1cf-5f60-bff1-080d30b24bad/732aaa97-a1cf-5f60-bff1-080d30b24bad_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:23:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F68%252F12689eb7e6ce2612c0c664bd48f2c49f%252Fpa%252FNN28025_ced294bbf54eb686fdc7c199a75b2267.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_ced294bbf54eb686fdc7c199a75b2267.jpg saved to cache
2026-03-30 11:23:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 732aaa97-a1cf-5f60-bff1-080d30b24bad
2026-03-30 11:23:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad51750>
2026-03-30 11:23:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_732aaa97-a1cf-5f60-bff1-080d30b24bad/732aaa97-a1cf-5f60-bff1-080d30b24bad_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:23:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F68%252F12689eb7e6ce2612c0c664bd48f2c49f%252Fpa%252FNN28025_bb49aa5e37169f0423d7b1813d221958.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_bb49aa5e37169f0423d7b1813d221958.jpg saved to cache
2026-03-30 11:23:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 732aaa97-a1cf-5f60-bff1-080d30b24bad
2026-03-30 11:23:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a335a10>
2026-03-30 11:23:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_732aaa97-a1cf-5f60-bff1-080d30b24bad/732aaa97-a1cf-5f60-bff1-080d30b24bad_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:23:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F68%252F12689eb7e6ce2612c0c664bd48f2c49f%252Fpa%252FNN28025_e9d8632030273fc2462df9c2b553d47e.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_e9d8632030273fc2462df9c2b553d47e.jpg saved to cache
2026-03-30 11:23:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 732aaa97-a1cf-5f60-bff1-080d30b24bad
2026-03-30 11:23:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 732aaa97-a1cf-5f60-bff1-080d30b24bad, skipping ID generation
2026-03-30 11:23:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 732aaa97-a1cf-5f60-bff1-080d30b24bad with scrape type 1
2026-03-30 11:23:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 732aaa97-a1cf-5f60-bff1-080d30b24bad sending to next pipeline
2026-03-30 11:23:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 732aaa97-a1cf-5f60-bff1-080d30b24bad, identifier: NN28025
2026-03-30 11:23:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 732aaa97-a1cf-5f60-bff1-080d30b24bad with identifier: NN28025
2026-03-30 11:23:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 732aaa97-a1cf-5f60-bff1-080d30b24bad with identifier: NN28025
2026-03-30 11:23:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 732aaa97-a1cf-5f60-bff1-080d30b24bad with identifier: NN28025 to the API
2026-03-30 11:23:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:23:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:23:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_e9d8632030273fc2462df9c2b553d47e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 96,
'category': 'Taxi',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.8L',
'engine_horse_power': 136,
'expiration_date': '2026-03-31T15:13:05Z',
'fuel_type': 'hybrid',
'id': '732aaa97-a1cf-5f60-bff1-080d30b24bad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN28025',
'listing': 'auction',
'location': 'ES, Barcelona',
'make': 'Toyota',
'model': 'Prius+',
'odometer': 148898,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732aaa97-a1cf-5f60-bff1-080d30b24bad/732aaa97-a1cf-5f60-bff1-080d30b24bad_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76817,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_10afe25b754a91415fe69236ce52bf78.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732aaa97-a1cf-5f60-bff1-080d30b24bad/732aaa97-a1cf-5f60-bff1-080d30b24bad_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71931,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_727b90f34e490897616f06e83be58705.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732aaa97-a1cf-5f60-bff1-080d30b24bad/732aaa97-a1cf-5f60-bff1-080d30b24bad_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84859,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_e9d8632030273fc2462df9c2b553d47e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732aaa97-a1cf-5f60-bff1-080d30b24bad/732aaa97-a1cf-5f60-bff1-080d30b24bad_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62060,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_bb49aa5e37169f0423d7b1813d221958.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732aaa97-a1cf-5f60-bff1-080d30b24bad/732aaa97-a1cf-5f60-bff1-080d30b24bad_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85703,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_ced294bbf54eb686fdc7c199a75b2267.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732aaa97-a1cf-5f60-bff1-080d30b24bad/732aaa97-a1cf-5f60-bff1-080d30b24bad_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88483,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_3495ab276ca5dfef68b68e512bd502c5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732aaa97-a1cf-5f60-bff1-080d30b24bad/732aaa97-a1cf-5f60-bff1-080d30b24bad_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84192,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_cd436ee0b21ca673fa630f0851de0f0b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732aaa97-a1cf-5f60-bff1-080d30b24bad/732aaa97-a1cf-5f60-bff1-080d30b24bad_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90237,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_6e3283051d1839305c7a79efddfb79e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732aaa97-a1cf-5f60-bff1-080d30b24bad/732aaa97-a1cf-5f60-bff1-080d30b24bad_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78680,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_9e2d5ba40ae123c657652df415ebaf7d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732aaa97-a1cf-5f60-bff1-080d30b24bad/732aaa97-a1cf-5f60-bff1-080d30b24bad_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88133,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img12/68/12689eb7e6ce2612c0c664bd48f2c49f/pa/NN28025_313550bdf625706b7da7f24dd8c90953.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-12-31',
'seats_number': 7,
'seller_name': None,
'title': 'Toyota Prius+ 1.8 ECO',
'transmission': 'automatic',
'trim': 'ECO',
'year': 2016}
2026-03-30 11:23:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NN28025%27 HTTP/1.1" 200 None
2026-03-30 11:23:12 [auto1.es] INFO: Saving data for NN28025: {'created_time': 1774869792.859426, 'last_price_update_time': 1774869792.859438, 'auction_closing_time': 1774969985.0}
2026-03-30 11:23:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NN28025') HTTP/1.1" 204 0
2026-03-30 11:23:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZE12212/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:23:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:23:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:23:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:23:15 [auto1.es] INFO: Channel: 24h | Page: 8 | totalHits: 2226 | hits on page: 40
2026-03-30 11:23:15 [auto1.es] INFO: Found listing with ID: VV73300
2026-03-30 11:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV73300%27 HTTP/1.1" 200 None
2026-03-30 11:23:15 [auto1.es] INFO: Scrape type for VV73300: 0
2026-03-30 11:23:15 [auto1.es] INFO: Found listing with ID: CT70526
2026-03-30 11:23:15 [auto1.es] INFO: Found listing with ID: AT54546
2026-03-30 11:23:15 [auto1.es] INFO: Found listing with ID: JW87659
2026-03-30 11:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW87659%27 HTTP/1.1" 200 None
2026-03-30 11:23:15 [auto1.es] INFO: Scrape type for JW87659: 1
2026-03-30 11:23:15 [auto1.es] INFO: Found listing with ID: ZH70186
2026-03-30 11:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZH70186%27 HTTP/1.1" 200 None
2026-03-30 11:23:15 [auto1.es] INFO: Scrape type for ZH70186: 2
2026-03-30 11:23:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b9d9f2d-5f97-5440-8bdf-194df2e43597 with identifier: ZH70186
2026-03-30 11:23:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b9d9f2d-5f97-5440-8bdf-194df2e43597 with scrape type 2
2026-03-30 11:23:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b9d9f2d-5f97-5440-8bdf-194df2e43597 with scrape type 2
2026-03-30 11:23:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0b9d9f2d-5f97-5440-8bdf-194df2e43597, identifier: ZH70186
2026-03-30 11:23:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0b9d9f2d-5f97-5440-8bdf-194df2e43597 with identifier: ZH70186
2026-03-30 11:23:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0b9d9f2d-5f97-5440-8bdf-194df2e43597 with identifier: ZH70186
2026-03-30 11:23:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0b9d9f2d-5f97-5440-8bdf-194df2e43597 with identifier: ZH70186 to the API
2026-03-30 11:23:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:23:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:23:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:08:59Z',
'fuel_type': 'diesel',
'id': '0b9d9f2d-5f97-5440-8bdf-194df2e43597',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH70186',
'listing': 'auction',
'make': 'Honda',
'model': 'Accord',
'odometer': 193182,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-05-24',
'seller_name': None,
'title': 'Honda Accord 2.2 DTEC Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2012}
2026-03-30 11:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZH70186%27 HTTP/1.1" 200 None
2026-03-30 11:23:16 [auto1.es] INFO: Saving data for ZH70186: {'auction_closing_time': 1774969739.0, 'created_time': 1773133048.683978, 'last_price_update_time': 1774869796.081897}
2026-03-30 11:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZH70186') HTTP/1.1" 204 0
2026-03-30 11:23:16 [auto1.es] INFO: Found listing with ID: AG97977
2026-03-30 11:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG97977%27 HTTP/1.1" 200 None
2026-03-30 11:23:16 [auto1.es] INFO: Scrape type for AG97977: 1
2026-03-30 11:23:16 [auto1.es] INFO: Found listing with ID: VC29718
2026-03-30 11:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC29718%27 HTTP/1.1" 200 None
2026-03-30 11:23:16 [auto1.es] INFO: Scrape type for VC29718: 2
2026-03-30 11:23:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b37bdf8e-c826-51c5-a91b-f153215b1c72 with identifier: VC29718
2026-03-30 11:23:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b37bdf8e-c826-51c5-a91b-f153215b1c72 with scrape type 2
2026-03-30 11:23:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b37bdf8e-c826-51c5-a91b-f153215b1c72 with scrape type 2
2026-03-30 11:23:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b37bdf8e-c826-51c5-a91b-f153215b1c72, identifier: VC29718
2026-03-30 11:23:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b37bdf8e-c826-51c5-a91b-f153215b1c72 with identifier: VC29718
2026-03-30 11:23:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b37bdf8e-c826-51c5-a91b-f153215b1c72 with identifier: VC29718
2026-03-30 11:23:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b37bdf8e-c826-51c5-a91b-f153215b1c72 with identifier: VC29718 to the API
2026-03-30 11:23:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:23:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:23:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-31T15:30:25Z',
'fuel_type': 'diesel',
'id': 'b37bdf8e-c826-51c5-a91b-f153215b1c72',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC29718',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 197706,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-03-27',
'seller_name': None,
'title': 'Seat Ibiza 1.9 TDI Reference',
'transmission': 'manual',
'trim': 'Reference',
'year': 2007}
2026-03-30 11:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC29718%27 HTTP/1.1" 200 None
2026-03-30 11:23:16 [auto1.es] INFO: Saving data for VC29718: {'auction_closing_time': 1774971025.0, 'created_time': 1773248736.426646, 'last_price_update_time': 1774869796.556258}
2026-03-30 11:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VC29718') HTTP/1.1" 204 0
2026-03-30 11:23:16 [auto1.es] INFO: Found listing with ID: VN77018
2026-03-30 11:23:16 [auto1.es] INFO: Found listing with ID: UF23429
2026-03-30 11:23:16 [auto1.es] INFO: Found listing with ID: FH67818
2026-03-30 11:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FH67818%27 HTTP/1.1" 200 None
2026-03-30 11:23:16 [auto1.es] INFO: Scrape type for FH67818: 2
2026-03-30 11:23:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f8d67e9-f4dc-5b96-8e50-d5e29d459822 with identifier: FH67818
2026-03-30 11:23:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f8d67e9-f4dc-5b96-8e50-d5e29d459822 with scrape type 2
2026-03-30 11:23:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f8d67e9-f4dc-5b96-8e50-d5e29d459822 with scrape type 2
2026-03-30 11:23:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6f8d67e9-f4dc-5b96-8e50-d5e29d459822, identifier: FH67818
2026-03-30 11:23:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6f8d67e9-f4dc-5b96-8e50-d5e29d459822 with identifier: FH67818
2026-03-30 11:23:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6f8d67e9-f4dc-5b96-8e50-d5e29d459822 with identifier: FH67818
2026-03-30 11:23:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6f8d67e9-f4dc-5b96-8e50-d5e29d459822 with identifier: FH67818 to the API
2026-03-30 11:23:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:23:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:23:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:40:11Z',
'fuel_type': 'diesel',
'id': '6f8d67e9-f4dc-5b96-8e50-d5e29d459822',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH67818',
'listing': 'auction',
'make': 'Renault',
'model': 'Kangoo',
'odometer': 255772,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-08-01',
'seller_name': None,
'title': 'Renault Kangoo 1.5 dCi Profesional',
'transmission': 'manual',
'trim': 'Profesional',
'year': 2011}
2026-03-30 11:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FH67818%27 HTTP/1.1" 200 None
2026-03-30 11:23:23 [auto1.es] INFO: Saving data for FH67818: {'auction_closing_time': 1774971611.0, 'created_time': 1774382759.14031, 'last_price_update_time': 1774869803.457872}
2026-03-30 11:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FH67818') HTTP/1.1" 204 0
2026-03-30 11:23:23 [auto1.es] INFO: Found listing with ID: VL80227
2026-03-30 11:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL80227%27 HTTP/1.1" 200 None
2026-03-30 11:23:23 [auto1.es] INFO: Scrape type for VL80227: 1
2026-03-30 11:23:23 [auto1.es] INFO: Found listing with ID: WG01714
2026-03-30 11:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WG01714%27 HTTP/1.1" 200 None
2026-03-30 11:23:23 [auto1.es] INFO: Scrape type for WG01714: 2
2026-03-30 11:23:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db05ce6b-3781-5bf6-9f8d-7656c7f32a1b with identifier: WG01714
2026-03-30 11:23:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db05ce6b-3781-5bf6-9f8d-7656c7f32a1b with scrape type 2
2026-03-30 11:23:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db05ce6b-3781-5bf6-9f8d-7656c7f32a1b with scrape type 2
2026-03-30 11:23:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: db05ce6b-3781-5bf6-9f8d-7656c7f32a1b, identifier: WG01714
2026-03-30 11:23:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: db05ce6b-3781-5bf6-9f8d-7656c7f32a1b with identifier: WG01714
2026-03-30 11:23:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: db05ce6b-3781-5bf6-9f8d-7656c7f32a1b with identifier: WG01714
2026-03-30 11:23:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: db05ce6b-3781-5bf6-9f8d-7656c7f32a1b with identifier: WG01714 to the API
2026-03-30 11:23:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:23:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:23:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:58:22Z',
'fuel_type': 'diesel',
'id': 'db05ce6b-3781-5bf6-9f8d-7656c7f32a1b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG01714',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3 Aircross',
'odometer': 12472,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-10',
'seller_name': None,
'title': 'Citroen C3 Aircross 1.5 Blue-HDi Shine Pack',
'transmission': 'manual',
'trim': 'Shine Pack',
'year': 2022}
2026-03-30 11:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WG01714%27 HTTP/1.1" 200 None
2026-03-30 11:23:24 [auto1.es] INFO: Saving data for WG01714: {'auction_closing_time': 1774972702.0, 'created_time': 1773131258.764516, 'last_price_update_time': 1774869804.847605}
2026-03-30 11:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WG01714') HTTP/1.1" 204 0
2026-03-30 11:23:24 [auto1.es] INFO: Found listing with ID: VT88703
2026-03-30 11:23:24 [auto1.es] INFO: Found listing with ID: ZC57359
2026-03-30 11:23:24 [auto1.es] INFO: Found listing with ID: WB45577
2026-03-30 11:23:24 [auto1.es] INFO: Found listing with ID: LJ23140
2026-03-30 11:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LJ23140%27 HTTP/1.1" 200 None
2026-03-30 11:23:24 [auto1.es] INFO: Scrape type for LJ23140: 2
2026-03-30 11:23:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82c62eb9-b82e-5727-bb0b-285648d901f6 with identifier: LJ23140
2026-03-30 11:23:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82c62eb9-b82e-5727-bb0b-285648d901f6 with scrape type 2
2026-03-30 11:23:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82c62eb9-b82e-5727-bb0b-285648d901f6 with scrape type 2
2026-03-30 11:23:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 82c62eb9-b82e-5727-bb0b-285648d901f6, identifier: LJ23140
2026-03-30 11:23:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 82c62eb9-b82e-5727-bb0b-285648d901f6 with identifier: LJ23140
2026-03-30 11:23:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 82c62eb9-b82e-5727-bb0b-285648d901f6 with identifier: LJ23140
2026-03-30 11:23:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 82c62eb9-b82e-5727-bb0b-285648d901f6 with identifier: LJ23140 to the API
2026-03-30 11:23:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:23:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:23:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 184,
'expiration_date': '2026-03-31T15:59:18Z',
'fuel_type': 'hybrid',
'id': '82c62eb9-b82e-5727-bb0b-285648d901f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ23140',
'listing': 'auction',
'make': 'Lexus',
'model': 'UX-Serie',
'odometer': 32574,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-21',
'seller_name': None,
'title': 'Lexus UX-Serie UX 250h Business',
'transmission': 'automatic',
'trim': 'Business',
'year': 2022}
2026-03-30 11:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LJ23140%27 HTTP/1.1" 200 None
2026-03-30 11:23:25 [auto1.es] INFO: Saving data for LJ23140: {'auction_closing_time': 1774972758.0, 'created_time': 1773238732.442595, 'last_price_update_time': 1774869805.36832}
2026-03-30 11:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LJ23140') HTTP/1.1" 204 0
2026-03-30 11:23:25 [auto1.es] INFO: Found listing with ID: TV97733
2026-03-30 11:23:25 [auto1.es] INFO: Found listing with ID: JT74362
2026-03-30 11:23:25 [auto1.es] INFO: Found listing with ID: ET64130
2026-03-30 11:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ET64130%27 HTTP/1.1" 200 None
2026-03-30 11:23:25 [auto1.es] INFO: Scrape type for ET64130: 2
2026-03-30 11:23:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4573372c-75b1-55af-8c01-7edc3a0756e1 with identifier: ET64130
2026-03-30 11:23:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4573372c-75b1-55af-8c01-7edc3a0756e1 with scrape type 2
2026-03-30 11:23:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4573372c-75b1-55af-8c01-7edc3a0756e1 with scrape type 2
2026-03-30 11:23:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4573372c-75b1-55af-8c01-7edc3a0756e1, identifier: ET64130
2026-03-30 11:23:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4573372c-75b1-55af-8c01-7edc3a0756e1 with identifier: ET64130
2026-03-30 11:23:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4573372c-75b1-55af-8c01-7edc3a0756e1 with identifier: ET64130
2026-03-30 11:23:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4573372c-75b1-55af-8c01-7edc3a0756e1 with identifier: ET64130 to the API
2026-03-30 11:23:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:23:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:23:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:54:05Z',
'fuel_type': 'petrol',
'id': '4573372c-75b1-55af-8c01-7edc3a0756e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET64130',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka X',
'odometer': 28773,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-06-05',
'seller_name': None,
'title': 'Opel Mokka X 1.2 Turbo Ultimate',
'transmission': 'automatic',
'trim': 'Ultimate',
'year': 2024}
2026-03-30 11:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ET64130%27 HTTP/1.1" 200 None
2026-03-30 11:23:26 [auto1.es] INFO: Saving data for ET64130: {'auction_closing_time': 1774972445.0, 'created_time': 1773131373.845968, 'last_price_update_time': 1774869806.030586}
2026-03-30 11:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ET64130') HTTP/1.1" 204 0
2026-03-30 11:23:26 [auto1.es] INFO: Found listing with ID: NZ17850
2026-03-30 11:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NZ17850%27 HTTP/1.1" 200 None
2026-03-30 11:23:26 [auto1.es] INFO: Scrape type for NZ17850: 2
2026-03-30 11:23:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b324cb6f-d2e9-5bb9-8ba9-8a1fc35cdabc with identifier: NZ17850
2026-03-30 11:23:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b324cb6f-d2e9-5bb9-8ba9-8a1fc35cdabc with scrape type 2
2026-03-30 11:23:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b324cb6f-d2e9-5bb9-8ba9-8a1fc35cdabc with scrape type 2
2026-03-30 11:23:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b324cb6f-d2e9-5bb9-8ba9-8a1fc35cdabc, identifier: NZ17850
2026-03-30 11:23:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b324cb6f-d2e9-5bb9-8ba9-8a1fc35cdabc with identifier: NZ17850
2026-03-30 11:23:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b324cb6f-d2e9-5bb9-8ba9-8a1fc35cdabc with identifier: NZ17850
2026-03-30 11:23:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b324cb6f-d2e9-5bb9-8ba9-8a1fc35cdabc with identifier: NZ17850 to the API
2026-03-30 11:23:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:23:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:23:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-31T15:26:24Z',
'fuel_type': 'diesel',
'id': 'b324cb6f-d2e9-5bb9-8ba9-8a1fc35cdabc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ17850',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 267801,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-09-27',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.6 TDI Highline',
'transmission': 'manual',
'trim': 'Highline',
'year': 2012}
2026-03-30 11:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NZ17850%27 HTTP/1.1" 200 None
2026-03-30 11:23:26 [auto1.es] INFO: Saving data for NZ17850: {'auction_closing_time': 1774970784.0, 'created_time': 1773129213.402825, 'last_price_update_time': 1774869806.514162}
2026-03-30 11:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NZ17850') HTTP/1.1" 204 0
2026-03-30 11:23:26 [auto1.es] INFO: Found listing with ID: WL07406
2026-03-30 11:23:26 [auto1.es] INFO: Found listing with ID: TK17628
2026-03-30 11:23:26 [auto1.es] INFO: Found listing with ID: JL80339
2026-03-30 11:23:26 [auto1.es] INFO: Found listing with ID: WC29009
2026-03-30 11:23:26 [auto1.es] INFO: Found listing with ID: BW36517
2026-03-30 11:23:26 [auto1.es] INFO: Found listing with ID: ST19382
2026-03-30 11:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ST19382%27 HTTP/1.1" 200 None
2026-03-30 11:23:26 [auto1.es] INFO: Scrape type for ST19382: 1
2026-03-30 11:23:26 [auto1.es] INFO: Found listing with ID: AR65980
2026-03-30 11:23:26 [auto1.es] INFO: Found listing with ID: LH72320
2026-03-30 11:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LH72320%27 HTTP/1.1" 200 None
2026-03-30 11:23:26 [auto1.es] INFO: Scrape type for LH72320: 2
2026-03-30 11:23:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ed18371-138e-59ad-8ea1-e8303e3db770 with identifier: LH72320
2026-03-30 11:23:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ed18371-138e-59ad-8ea1-e8303e3db770 with scrape type 2
2026-03-30 11:23:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ed18371-138e-59ad-8ea1-e8303e3db770 with scrape type 2
2026-03-30 11:23:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7ed18371-138e-59ad-8ea1-e8303e3db770, identifier: LH72320
2026-03-30 11:23:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AP30441/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:23:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/US78299/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:23:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LH46678> (referer: https://www.auto1.com/v1/car-details-view/LH46678/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:23:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7ed18371-138e-59ad-8ea1-e8303e3db770 with identifier: LH72320
2026-03-30 11:23:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7ed18371-138e-59ad-8ea1-e8303e3db770 with identifier: LH72320
2026-03-30 11:23:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7ed18371-138e-59ad-8ea1-e8303e3db770 with identifier: LH72320 to the API
2026-03-30 11:23:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:23:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:23:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:32:18Z',
'fuel_type': 'diesel',
'id': '7ed18371-138e-59ad-8ea1-e8303e3db770',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH72320',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 103021,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-29',
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Dynamique',
'transmission': 'automatic',
'trim': 'Dynamique',
'year': 2015}
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LH72320%27 HTTP/1.1" 200 None
2026-03-30 11:23:27 [auto1.es] INFO: Saving data for LH72320: {'auction_closing_time': 1774971138.0, 'created_time': 1773181234.550555, 'last_price_update_time': 1774869807.059343}
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LH72320') HTTP/1.1" 204 0
2026-03-30 11:23:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:23:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:23:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: YJ93473
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ93473%27 HTTP/1.1" 200 None
2026-03-30 11:23:27 [auto1.es] INFO: Scrape type for YJ93473: 1
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: YZ56503
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YZ56503%27 HTTP/1.1" 200 None
2026-03-30 11:23:27 [auto1.es] INFO: Scrape type for YZ56503: 1
2026-03-30 11:23:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8133e65-c307-5755-a57a-9aacdd16a950 with identifier: LH46678
2026-03-30 11:23:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8133e65-c307-5755-a57a-9aacdd16a950 with scrape type 1
2026-03-30 11:23:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a8133e65-c307-5755-a57a-9aacdd16a950
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa9%252Fc3a9e22411f406d2e6b3a24627907630%252Fpa%252FLH46678_718e56971bff12cf93561d68977d360e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_718e56971bff12cf93561d68977d360e.jpg not downloaded yet
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: SJ54893
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SJ54893%27 HTTP/1.1" 200 None
2026-03-30 11:23:27 [auto1.es] INFO: Scrape type for SJ54893: 2
2026-03-30 11:23:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fad2506-7a10-5794-b91f-c43fb0a23a9e with identifier: SJ54893
2026-03-30 11:23:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fad2506-7a10-5794-b91f-c43fb0a23a9e with scrape type 2
2026-03-30 11:23:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2fad2506-7a10-5794-b91f-c43fb0a23a9e with scrape type 2
2026-03-30 11:23:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2fad2506-7a10-5794-b91f-c43fb0a23a9e, identifier: SJ54893
2026-03-30 11:23:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2fad2506-7a10-5794-b91f-c43fb0a23a9e with identifier: SJ54893
2026-03-30 11:23:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2fad2506-7a10-5794-b91f-c43fb0a23a9e with identifier: SJ54893
2026-03-30 11:23:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2fad2506-7a10-5794-b91f-c43fb0a23a9e with identifier: SJ54893 to the API
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:23:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 100,
'expiration_date': '2026-03-31T15:05:39Z',
'fuel_type': 'diesel',
'id': '2fad2506-7a10-5794-b91f-c43fb0a23a9e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ54893',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 227773,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-02',
'seller_name': None,
'title': 'Opel Astra 1.7 CDTI Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2007}
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SJ54893%27 HTTP/1.1" 200 None
2026-03-30 11:23:27 [auto1.es] INFO: Saving data for SJ54893: {'auction_closing_time': 1774969539.0, 'created_time': 1774642122.975083, 'last_price_update_time': 1774869807.962524}
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SJ54893') HTTP/1.1" 204 0
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa9%252Fc3a9e22411f406d2e6b3a24627907630%252Fpa%252FLH46678_103d7565593a778bd445256309497393.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_103d7565593a778bd445256309497393.jpg not downloaded yet
2026-03-30 11:23:27 [auto1.es] INFO: Found listing with ID: ZA20245
2026-03-30 11:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZA20245%27 HTTP/1.1" 200 None
2026-03-30 11:23:28 [auto1.es] INFO: Scrape type for ZA20245: 2
2026-03-30 11:23:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc1781cb-fff3-546f-91df-a6927e0f917a with identifier: ZA20245
2026-03-30 11:23:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc1781cb-fff3-546f-91df-a6927e0f917a with scrape type 2
2026-03-30 11:23:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc1781cb-fff3-546f-91df-a6927e0f917a with scrape type 2
2026-03-30 11:23:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cc1781cb-fff3-546f-91df-a6927e0f917a, identifier: ZA20245
2026-03-30 11:23:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cc1781cb-fff3-546f-91df-a6927e0f917a with identifier: ZA20245
2026-03-30 11:23:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cc1781cb-fff3-546f-91df-a6927e0f917a with identifier: ZA20245
2026-03-30 11:23:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cc1781cb-fff3-546f-91df-a6927e0f917a with identifier: ZA20245 to the API
2026-03-30 11:23:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:23:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:23:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:48:12Z',
'fuel_type': 'diesel',
'id': 'cc1781cb-fff3-546f-91df-a6927e0f917a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA20245',
'listing': 'auction',
'make': 'Peugeot',
'model': '508',
'odometer': 149574,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-23',
'seller_name': None,
'title': 'Peugeot 508 1.5 Blue-HDi Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2021}
2026-03-30 11:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZA20245%27 HTTP/1.1" 200 None
2026-03-30 11:23:28 [auto1.es] INFO: Saving data for ZA20245: {'auction_closing_time': 1774972092.0, 'created_time': 1774436852.858755, 'last_price_update_time': 1774869808.429569}
2026-03-30 11:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZA20245') HTTP/1.1" 204 0
2026-03-30 11:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa9%252Fc3a9e22411f406d2e6b3a24627907630%252Fpa%252FLH46678_78a0a6fa96c59713b81ef9f2bd9cb079.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_78a0a6fa96c59713b81ef9f2bd9cb079.jpg not downloaded yet
2026-03-30 11:23:28 [auto1.es] INFO: Found listing with ID: SV24674
2026-03-30 11:23:28 [auto1.es] INFO: Found listing with ID: YP48986
2026-03-30 11:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YP48986%27 HTTP/1.1" 200 None
2026-03-30 11:23:28 [auto1.es] INFO: Scrape type for YP48986: 2
2026-03-30 11:23:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 490cc340-2433-5a85-8813-9b211d129b08 with identifier: YP48986
2026-03-30 11:23:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 490cc340-2433-5a85-8813-9b211d129b08 with scrape type 2
2026-03-30 11:23:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 490cc340-2433-5a85-8813-9b211d129b08 with scrape type 2
2026-03-30 11:23:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 490cc340-2433-5a85-8813-9b211d129b08, identifier: YP48986
2026-03-30 11:23:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 490cc340-2433-5a85-8813-9b211d129b08 with identifier: YP48986
2026-03-30 11:23:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 490cc340-2433-5a85-8813-9b211d129b08 with identifier: YP48986
2026-03-30 11:23:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 490cc340-2433-5a85-8813-9b211d129b08 with identifier: YP48986 to the API
2026-03-30 11:23:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:23:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:23:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-31T15:25:34Z',
'fuel_type': 'diesel',
'id': '490cc340-2433-5a85-8813-9b211d129b08',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP48986',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit Connect',
'odometer': 148173,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-28',
'seller_name': None,
'title': 'Ford Transit Connect 1.5 EcoBlue TDCi Kombi Trend',
'transmission': 'manual',
'trim': 'Kombi Trend',
'year': 2022}
2026-03-30 11:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YP48986%27 HTTP/1.1" 200 None
2026-03-30 11:23:28 [auto1.es] INFO: Saving data for YP48986: {'auction_closing_time': 1774970734.0, 'created_time': 1774436795.758557, 'last_price_update_time': 1774869808.94772}
2026-03-30 11:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YP48986') HTTP/1.1" 204 0
2026-03-30 11:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa9%252Fc3a9e22411f406d2e6b3a24627907630%252Fpa%252FLH46678_14a1db92adcd712b72ea49d4cf619c29.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_14a1db92adcd712b72ea49d4cf619c29.jpg not downloaded yet
2026-03-30 11:23:28 [auto1.es] INFO: Found listing with ID: KU70052
2026-03-30 11:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KU70052%27 HTTP/1.1" 200 None
2026-03-30 11:23:29 [auto1.es] INFO: Scrape type for KU70052: 2
2026-03-30 11:23:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45f8e10e-1e42-5f0d-9d53-76d6a930fb2e with identifier: KU70052
2026-03-30 11:23:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45f8e10e-1e42-5f0d-9d53-76d6a930fb2e with scrape type 2
2026-03-30 11:23:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45f8e10e-1e42-5f0d-9d53-76d6a930fb2e with scrape type 2
2026-03-30 11:23:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 45f8e10e-1e42-5f0d-9d53-76d6a930fb2e, identifier: KU70052
2026-03-30 11:23:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 45f8e10e-1e42-5f0d-9d53-76d6a930fb2e with identifier: KU70052
2026-03-30 11:23:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 45f8e10e-1e42-5f0d-9d53-76d6a930fb2e with identifier: KU70052
2026-03-30 11:23:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 45f8e10e-1e42-5f0d-9d53-76d6a930fb2e with identifier: KU70052 to the API
2026-03-30 11:23:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:23:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:23:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 88,
'expiration_date': '2026-03-31T15:30:05Z',
'fuel_type': 'petrol',
'id': '45f8e10e-1e42-5f0d-9d53-76d6a930fb2e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU70052',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4',
'odometer': 56007,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-07-20',
'seller_name': None,
'title': 'Citroen C4 1.4 Collection',
'transmission': 'manual',
'trim': 'Collection',
'year': 2006}
2026-03-30 11:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KU70052%27 HTTP/1.1" 200 None
2026-03-30 11:23:29 [auto1.es] INFO: Saving data for KU70052: {'auction_closing_time': 1774971005.0, 'created_time': 1774382823.503277, 'last_price_update_time': 1774869809.468794}
2026-03-30 11:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KU70052') HTTP/1.1" 204 0
2026-03-30 11:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa9%252Fc3a9e22411f406d2e6b3a24627907630%252Fpa%252FLH46678_9ab27691d151369c8ede4f9949c3005e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_9ab27691d151369c8ede4f9949c3005e.jpg not downloaded yet
2026-03-30 11:23:29 [auto1.es] INFO: Found listing with ID: VL95678
2026-03-30 11:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL95678%27 HTTP/1.1" 200 None
2026-03-30 11:23:29 [auto1.es] INFO: Scrape type for VL95678: 1
2026-03-30 11:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa9%252Fc3a9e22411f406d2e6b3a24627907630%252Fpa%252FLH46678_a3c3e82118decda4f43859e70ead6d09.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_a3c3e82118decda4f43859e70ead6d09.jpg not downloaded yet
2026-03-30 11:23:29 [auto1.es] INFO: Found listing with ID: DC03614
2026-03-30 11:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DC03614%27 HTTP/1.1" 200 None
2026-03-30 11:23:29 [auto1.es] INFO: Scrape type for DC03614: 2
2026-03-30 11:23:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6f1fbbb-e28d-5229-8a5a-fd467be43c81 with identifier: DC03614
2026-03-30 11:23:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6f1fbbb-e28d-5229-8a5a-fd467be43c81 with scrape type 2
2026-03-30 11:23:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6f1fbbb-e28d-5229-8a5a-fd467be43c81 with scrape type 2
2026-03-30 11:23:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d6f1fbbb-e28d-5229-8a5a-fd467be43c81, identifier: DC03614
2026-03-30 11:23:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HJ95484> (referer: https://www.auto1.com/v1/car-details-view/HJ95484/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:23:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d6f1fbbb-e28d-5229-8a5a-fd467be43c81 with identifier: DC03614
2026-03-30 11:23:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d6f1fbbb-e28d-5229-8a5a-fd467be43c81 with identifier: DC03614
2026-03-30 11:23:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d6f1fbbb-e28d-5229-8a5a-fd467be43c81 with identifier: DC03614 to the API
2026-03-30 11:23:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:23:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:23:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 122,
'expiration_date': '2026-03-31T15:46:59Z',
'fuel_type': 'petrol',
'id': 'd6f1fbbb-e28d-5229-8a5a-fd467be43c81',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC03614',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 189792,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-04',
'seller_name': None,
'title': 'MINI Cooper',
'transmission': 'manual',
'trim': '',
'year': 2012}
2026-03-30 11:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DC03614%27 HTTP/1.1" 200 None
2026-03-30 11:23:29 [auto1.es] INFO: Saving data for DC03614: {'auction_closing_time': 1774972019.0, 'created_time': 1774296377.954458, 'last_price_update_time': 1774869809.974382}
2026-03-30 11:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DC03614') HTTP/1.1" 204 0
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa9%252Fc3a9e22411f406d2e6b3a24627907630%252Fpa%252FLH46678_4cb40fb656a22d4d5df7c3950b4550d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_4cb40fb656a22d4d5df7c3950b4550d0.jpg already downloaded
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa9%252Fc3a9e22411f406d2e6b3a24627907630%252Fpa%252FLH46678_0fbfb3ade08adb5fe7327296ad95ae91.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_0fbfb3ade08adb5fe7327296ad95ae91.jpg not downloaded yet
2026-03-30 11:23:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:23:30 [auto1.es] INFO: Found listing with ID: DJ81292
2026-03-30 11:23:30 [auto1.es] INFO: Found listing with ID: ZK75464
2026-03-30 11:23:30 [auto1.es] INFO: Found listing with ID: TD39535
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa9%252Fc3a9e22411f406d2e6b3a24627907630%252Fpa%252FLH46678_839f1233255bda0a0a79ef7805afc2b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_839f1233255bda0a0a79ef7805afc2b7.jpg not downloaded yet
2026-03-30 11:23:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65f67fa7-0577-5ab9-a85e-2a62a0c882fc with identifier: HJ95484
2026-03-30 11:23:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65f67fa7-0577-5ab9-a85e-2a62a0c882fc with scrape type 1
2026-03-30 11:23:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 65f67fa7-0577-5ab9-a85e-2a62a0c882fc
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fb8%252Fefb898a507081cb02624efaa827d473e%252Fpa%252FHJ95484_4b191898831fc929844376f0020efe50.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/b8/efb898a507081cb02624efaa827d473e/pa/HJ95484_4b191898831fc929844376f0020efe50.jpg not downloaded yet
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa9%252Fc3a9e22411f406d2e6b3a24627907630%252Fpa%252FLH46678_07b4d25c0e92e9caf646b2efe512f860.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_07b4d25c0e92e9caf646b2efe512f860.jpg not downloaded yet
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fb8%252Fefb898a507081cb02624efaa827d473e%252Fpa%252FHJ95484_44196930f62a3caf1df9a139904462ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/b8/efb898a507081cb02624efaa827d473e/pa/HJ95484_44196930f62a3caf1df9a139904462ce.jpg not downloaded yet
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fb8%252Fefb898a507081cb02624efaa827d473e%252Fpa%252FHJ95484_541e728acb6ce84768c0c64f77e83f2a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/b8/efb898a507081cb02624efaa827d473e/pa/HJ95484_541e728acb6ce84768c0c64f77e83f2a.jpg not downloaded yet
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fb8%252Fefb898a507081cb02624efaa827d473e%252Fpa%252FHJ95484_139048294dce68894ad30b61ccf5d7ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/b8/efb898a507081cb02624efaa827d473e/pa/HJ95484_139048294dce68894ad30b61ccf5d7ed.jpg not downloaded yet
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fb8%252Fefb898a507081cb02624efaa827d473e%252Fpa%252FHJ95484_da8fbfaf3aef8c20621c4c4a624cdd5c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/b8/efb898a507081cb02624efaa827d473e/pa/HJ95484_da8fbfaf3aef8c20621c4c4a624cdd5c.jpg not downloaded yet
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fb8%252Fefb898a507081cb02624efaa827d473e%252Fpa%252FHJ95484_f67135f994406168adb9a6645725ac44.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/b8/efb898a507081cb02624efaa827d473e/pa/HJ95484_f67135f994406168adb9a6645725ac44.jpg not downloaded yet
2026-03-30 11:23:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_a3c3e82118decda4f43859e70ead6d09.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/b8/efb898a507081cb02624efaa827d473e/pa/HJ95484_f67135f994406168adb9a6645725ac44.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3c3610>
2026-03-30 11:23:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8133e65-c307-5755-a57a-9aacdd16a950/a8133e65-c307-5755-a57a-9aacdd16a950_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa9%252Fc3a9e22411f406d2e6b3a24627907630%252Fpa%252FLH46678_a3c3e82118decda4f43859e70ead6d09.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_a3c3e82118decda4f43859e70ead6d09.jpg saved to cache
2026-03-30 11:23:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a8133e65-c307-5755-a57a-9aacdd16a950
2026-03-30 11:23:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/b8/efb898a507081cb02624efaa827d473e/pa/HJ95484_da8fbfaf3aef8c20621c4c4a624cdd5c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4e0710>
2026-03-30 11:23:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65f67fa7-0577-5ab9-a85e-2a62a0c882fc/65f67fa7-0577-5ab9-a85e-2a62a0c882fc_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fb8%252Fefb898a507081cb02624efaa827d473e%252Fpa%252FHJ95484_f67135f994406168adb9a6645725ac44.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/b8/efb898a507081cb02624efaa827d473e/pa/HJ95484_f67135f994406168adb9a6645725ac44.jpg saved to cache
2026-03-30 11:23:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 65f67fa7-0577-5ab9-a85e-2a62a0c882fc
2026-03-30 11:23:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3ee4d0>
2026-03-30 11:23:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65f67fa7-0577-5ab9-a85e-2a62a0c882fc/65f67fa7-0577-5ab9-a85e-2a62a0c882fc_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fb8%252Fefb898a507081cb02624efaa827d473e%252Fpa%252FHJ95484_da8fbfaf3aef8c20621c4c4a624cdd5c.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/b8/efb898a507081cb02624efaa827d473e/pa/HJ95484_da8fbfaf3aef8c20621c4c4a624cdd5c.jpg saved to cache
2026-03-30 11:23:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 65f67fa7-0577-5ab9-a85e-2a62a0c882fc
2026-03-30 11:23:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/b8/efb898a507081cb02624efaa827d473e/pa/HJ95484_139048294dce68894ad30b61ccf5d7ed.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/b8/efb898a507081cb02624efaa827d473e/pa/HJ95484_541e728acb6ce84768c0c64f77e83f2a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a300090>
2026-03-30 11:23:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65f67fa7-0577-5ab9-a85e-2a62a0c882fc/65f67fa7-0577-5ab9-a85e-2a62a0c882fc_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fb8%252Fefb898a507081cb02624efaa827d473e%252Fpa%252FHJ95484_139048294dce68894ad30b61ccf5d7ed.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/b8/efb898a507081cb02624efaa827d473e/pa/HJ95484_139048294dce68894ad30b61ccf5d7ed.jpg saved to cache
2026-03-30 11:23:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 65f67fa7-0577-5ab9-a85e-2a62a0c882fc
2026-03-30 11:23:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EH47401/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:23:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:23:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ae71950>
2026-03-30 11:23:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65f67fa7-0577-5ab9-a85e-2a62a0c882fc/65f67fa7-0577-5ab9-a85e-2a62a0c882fc_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fb8%252Fefb898a507081cb02624efaa827d473e%252Fpa%252FHJ95484_541e728acb6ce84768c0c64f77e83f2a.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/b8/efb898a507081cb02624efaa827d473e/pa/HJ95484_541e728acb6ce84768c0c64f77e83f2a.jpg saved to cache
2026-03-30 11:23:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 65f67fa7-0577-5ab9-a85e-2a62a0c882fc
2026-03-30 11:23:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/b8/efb898a507081cb02624efaa827d473e/pa/HJ95484_44196930f62a3caf1df9a139904462ce.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_07b4d25c0e92e9caf646b2efe512f860.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4e1390>
2026-03-30 11:23:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65f67fa7-0577-5ab9-a85e-2a62a0c882fc/65f67fa7-0577-5ab9-a85e-2a62a0c882fc_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fb8%252Fefb898a507081cb02624efaa827d473e%252Fpa%252FHJ95484_44196930f62a3caf1df9a139904462ce.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/b8/efb898a507081cb02624efaa827d473e/pa/HJ95484_44196930f62a3caf1df9a139904462ce.jpg saved to cache
2026-03-30 11:23:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 65f67fa7-0577-5ab9-a85e-2a62a0c882fc
2026-03-30 11:23:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/b8/efb898a507081cb02624efaa827d473e/pa/HJ95484_4b191898831fc929844376f0020efe50.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060feab10>
2026-03-30 11:23:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8133e65-c307-5755-a57a-9aacdd16a950/a8133e65-c307-5755-a57a-9aacdd16a950_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa9%252Fc3a9e22411f406d2e6b3a24627907630%252Fpa%252FLH46678_07b4d25c0e92e9caf646b2efe512f860.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_07b4d25c0e92e9caf646b2efe512f860.jpg saved to cache
2026-03-30 11:23:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a8133e65-c307-5755-a57a-9aacdd16a950
2026-03-30 11:23:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a374cd0>
2026-03-30 11:23:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65f67fa7-0577-5ab9-a85e-2a62a0c882fc/65f67fa7-0577-5ab9-a85e-2a62a0c882fc_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fb8%252Fefb898a507081cb02624efaa827d473e%252Fpa%252FHJ95484_4b191898831fc929844376f0020efe50.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/b8/efb898a507081cb02624efaa827d473e/pa/HJ95484_4b191898831fc929844376f0020efe50.jpg saved to cache
2026-03-30 11:23:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 65f67fa7-0577-5ab9-a85e-2a62a0c882fc
2026-03-30 11:23:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 65f67fa7-0577-5ab9-a85e-2a62a0c882fc, skipping ID generation
2026-03-30 11:23:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65f67fa7-0577-5ab9-a85e-2a62a0c882fc with scrape type 1
2026-03-30 11:23:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 65f67fa7-0577-5ab9-a85e-2a62a0c882fc sending to next pipeline
2026-03-30 11:23:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 65f67fa7-0577-5ab9-a85e-2a62a0c882fc, identifier: HJ95484
2026-03-30 11:23:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 65f67fa7-0577-5ab9-a85e-2a62a0c882fc with identifier: HJ95484
2026-03-30 11:23:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 65f67fa7-0577-5ab9-a85e-2a62a0c882fc with identifier: HJ95484
2026-03-30 11:23:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 65f67fa7-0577-5ab9-a85e-2a62a0c882fc with identifier: HJ95484 to the API
2026-03-30 11:23:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:23:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:23:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgef/b8/efb898a507081cb02624efaa827d473e/pa/HJ95484_4b191898831fc929844376f0020efe50.jpg>
{'auction_title': '',
'c_o_2_emission_value': 155,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 147,
'expiration_date': '2026-03-31T15:41:22Z',
'fuel_type': 'diesel',
'id': '65f67fa7-0577-5ab9-a85e-2a62a0c882fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ95484',
'listing': 'auction',
'location': 'ES, Huelva',
'make': 'Subaru',
'model': 'Forester',
'odometer': 317295,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65f67fa7-0577-5ab9-a85e-2a62a0c882fc/65f67fa7-0577-5ab9-a85e-2a62a0c882fc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87739,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/b8/efb898a507081cb02624efaa827d473e/pa/HJ95484_4b191898831fc929844376f0020efe50.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65f67fa7-0577-5ab9-a85e-2a62a0c882fc/65f67fa7-0577-5ab9-a85e-2a62a0c882fc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84166,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/b8/efb898a507081cb02624efaa827d473e/pa/HJ95484_44196930f62a3caf1df9a139904462ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65f67fa7-0577-5ab9-a85e-2a62a0c882fc/65f67fa7-0577-5ab9-a85e-2a62a0c882fc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80248,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/b8/efb898a507081cb02624efaa827d473e/pa/HJ95484_541e728acb6ce84768c0c64f77e83f2a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65f67fa7-0577-5ab9-a85e-2a62a0c882fc/65f67fa7-0577-5ab9-a85e-2a62a0c882fc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46758,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/b8/efb898a507081cb02624efaa827d473e/pa/HJ95484_139048294dce68894ad30b61ccf5d7ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65f67fa7-0577-5ab9-a85e-2a62a0c882fc/65f67fa7-0577-5ab9-a85e-2a62a0c882fc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70448,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/b8/efb898a507081cb02624efaa827d473e/pa/HJ95484_da8fbfaf3aef8c20621c4c4a624cdd5c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65f67fa7-0577-5ab9-a85e-2a62a0c882fc/65f67fa7-0577-5ab9-a85e-2a62a0c882fc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102739,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/b8/efb898a507081cb02624efaa827d473e/pa/HJ95484_f67135f994406168adb9a6645725ac44.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-06-30',
'seats_number': 5,
'seller_name': None,
'title': 'Subaru Forester 2.0 Diesel Executive',
'transmission': 'manual',
'trim': 'Executive',
'year': 2012}
2026-03-30 11:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HJ95484%27 HTTP/1.1" 200 None
2026-03-30 11:23:32 [auto1.es] INFO: Saving data for HJ95484: {'created_time': 1774869812.163128, 'last_price_update_time': 1774869812.163138, 'auction_closing_time': 1774971682.0}
2026-03-30 11:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HJ95484') HTTP/1.1" 204 0
2026-03-30 11:23:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_839f1233255bda0a0a79ef7805afc2b7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3cce50>
2026-03-30 11:23:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8133e65-c307-5755-a57a-9aacdd16a950/a8133e65-c307-5755-a57a-9aacdd16a950_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa9%252Fc3a9e22411f406d2e6b3a24627907630%252Fpa%252FLH46678_839f1233255bda0a0a79ef7805afc2b7.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_839f1233255bda0a0a79ef7805afc2b7.jpg saved to cache
2026-03-30 11:23:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a8133e65-c307-5755-a57a-9aacdd16a950
2026-03-30 11:23:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_0fbfb3ade08adb5fe7327296ad95ae91.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060fec250>
2026-03-30 11:23:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8133e65-c307-5755-a57a-9aacdd16a950/a8133e65-c307-5755-a57a-9aacdd16a950_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa9%252Fc3a9e22411f406d2e6b3a24627907630%252Fpa%252FLH46678_0fbfb3ade08adb5fe7327296ad95ae91.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_0fbfb3ade08adb5fe7327296ad95ae91.jpg saved to cache
2026-03-30 11:23:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a8133e65-c307-5755-a57a-9aacdd16a950
2026-03-30 11:23:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZE12212> (referer: https://www.auto1.com/v1/car-details-view/ZE12212/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:23:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:23:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4163f652-1d50-5d14-8162-6e0425beddf7 with identifier: ZE12212
2026-03-30 11:23:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4163f652-1d50-5d14-8162-6e0425beddf7 with scrape type 1
2026-03-30 11:23:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4163f652-1d50-5d14-8162-6e0425beddf7
2026-03-30 11:23:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F29%252F4029cc04f68b0c73310ee4df61379673%252Fpa%252FZE12212_8294fa1d1244aebff14d43790509c0e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/29/4029cc04f68b0c73310ee4df61379673/pa/ZE12212_8294fa1d1244aebff14d43790509c0e5.jpg already downloaded
2026-03-30 11:23:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F29%252F4029cc04f68b0c73310ee4df61379673%252Fpa%252FZE12212_da3f7592a23be60b3d1936b551e6ab44.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/29/4029cc04f68b0c73310ee4df61379673/pa/ZE12212_da3f7592a23be60b3d1936b551e6ab44.jpg already downloaded
2026-03-30 11:23:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F29%252F4029cc04f68b0c73310ee4df61379673%252Fpa%252FZE12212_d6c05bda16084c4a1d5445bb2684f575.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/29/4029cc04f68b0c73310ee4df61379673/pa/ZE12212_d6c05bda16084c4a1d5445bb2684f575.jpg already downloaded
2026-03-30 11:23:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F29%252F4029cc04f68b0c73310ee4df61379673%252Fpa%252FZE12212_1d6dd145372c7fa59926d4a3836732d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/29/4029cc04f68b0c73310ee4df61379673/pa/ZE12212_1d6dd145372c7fa59926d4a3836732d1.jpg already downloaded
2026-03-30 11:23:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F29%252F4029cc04f68b0c73310ee4df61379673%252Fpa%252FZE12212_56e24de76400d807d6b4d8676277f6e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/29/4029cc04f68b0c73310ee4df61379673/pa/ZE12212_56e24de76400d807d6b4d8676277f6e8.jpg already downloaded
2026-03-30 11:23:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F29%252F4029cc04f68b0c73310ee4df61379673%252Fpa%252FZE12212_ceeaef1075db2b828a8214beff192caa.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/29/4029cc04f68b0c73310ee4df61379673/pa/ZE12212_ceeaef1075db2b828a8214beff192caa.jpg already downloaded
2026-03-30 11:23:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F29%252F4029cc04f68b0c73310ee4df61379673%252Fpa%252FZE12212_ad01c30c009bb875d486c0756d733f00.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/29/4029cc04f68b0c73310ee4df61379673/pa/ZE12212_ad01c30c009bb875d486c0756d733f00.jpg already downloaded
2026-03-30 11:23:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F29%252F4029cc04f68b0c73310ee4df61379673%252Fpa%252FZE12212_bf730d2e7126280d5b0669867e2bea7b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/29/4029cc04f68b0c73310ee4df61379673/pa/ZE12212_bf730d2e7126280d5b0669867e2bea7b.jpg already downloaded
2026-03-30 11:23:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F29%252F4029cc04f68b0c73310ee4df61379673%252Fpa%252FZE12212_f4c49e776ed56158bdaa6fb158b3adfa.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/29/4029cc04f68b0c73310ee4df61379673/pa/ZE12212_f4c49e776ed56158bdaa6fb158b3adfa.jpg already downloaded
2026-03-30 11:23:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F29%252F4029cc04f68b0c73310ee4df61379673%252Fpa%252FZE12212_e6d1bdd76370e0963fe44a41ce8ee338.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/29/4029cc04f68b0c73310ee4df61379673/pa/ZE12212_e6d1bdd76370e0963fe44a41ce8ee338.jpg not downloaded yet
2026-03-30 11:23:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_9ab27691d151369c8ede4f9949c3005e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a32d750>
2026-03-30 11:23:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8133e65-c307-5755-a57a-9aacdd16a950/a8133e65-c307-5755-a57a-9aacdd16a950_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:23:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa9%252Fc3a9e22411f406d2e6b3a24627907630%252Fpa%252FLH46678_9ab27691d151369c8ede4f9949c3005e.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_9ab27691d151369c8ede4f9949c3005e.jpg saved to cache
2026-03-30 11:23:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a8133e65-c307-5755-a57a-9aacdd16a950
2026-03-30 11:23:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/29/4029cc04f68b0c73310ee4df61379673/pa/ZE12212_e6d1bdd76370e0963fe44a41ce8ee338.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05aee2f50>
2026-03-30 11:23:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4163f652-1d50-5d14-8162-6e0425beddf7/4163f652-1d50-5d14-8162-6e0425beddf7_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:23:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F29%252F4029cc04f68b0c73310ee4df61379673%252Fpa%252FZE12212_e6d1bdd76370e0963fe44a41ce8ee338.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/29/4029cc04f68b0c73310ee4df61379673/pa/ZE12212_e6d1bdd76370e0963fe44a41ce8ee338.jpg saved to cache
2026-03-30 11:23:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4163f652-1d50-5d14-8162-6e0425beddf7
2026-03-30 11:23:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4163f652-1d50-5d14-8162-6e0425beddf7, skipping ID generation
2026-03-30 11:23:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4163f652-1d50-5d14-8162-6e0425beddf7 with scrape type 1
2026-03-30 11:23:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4163f652-1d50-5d14-8162-6e0425beddf7 sending to next pipeline
2026-03-30 11:23:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4163f652-1d50-5d14-8162-6e0425beddf7, identifier: ZE12212
2026-03-30 11:23:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4163f652-1d50-5d14-8162-6e0425beddf7 with identifier: ZE12212
2026-03-30 11:23:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4163f652-1d50-5d14-8162-6e0425beddf7 with identifier: ZE12212
2026-03-30 11:23:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4163f652-1d50-5d14-8162-6e0425beddf7 with identifier: ZE12212 to the API
2026-03-30 11:23:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:23:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:23:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img40/29/4029cc04f68b0c73310ee4df61379673/pa/ZE12212_e6d1bdd76370e0963fe44a41ce8ee338.jpg>
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': 'Rental',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:05:50Z',
'fuel_type': 'diesel',
'id': '4163f652-1d50-5d14-8162-6e0425beddf7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE12212',
'listing': 'auction',
'location': 'ES, Araia',
'make': 'Nissan',
'model': 'Juke',
'odometer': 38280,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4163f652-1d50-5d14-8162-6e0425beddf7/4163f652-1d50-5d14-8162-6e0425beddf7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72828,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/29/4029cc04f68b0c73310ee4df61379673/pa/ZE12212_8294fa1d1244aebff14d43790509c0e5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4163f652-1d50-5d14-8162-6e0425beddf7/4163f652-1d50-5d14-8162-6e0425beddf7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75213,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/29/4029cc04f68b0c73310ee4df61379673/pa/ZE12212_da3f7592a23be60b3d1936b551e6ab44.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4163f652-1d50-5d14-8162-6e0425beddf7/4163f652-1d50-5d14-8162-6e0425beddf7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65103,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/29/4029cc04f68b0c73310ee4df61379673/pa/ZE12212_d6c05bda16084c4a1d5445bb2684f575.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4163f652-1d50-5d14-8162-6e0425beddf7/4163f652-1d50-5d14-8162-6e0425beddf7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59624,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/29/4029cc04f68b0c73310ee4df61379673/pa/ZE12212_1d6dd145372c7fa59926d4a3836732d1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4163f652-1d50-5d14-8162-6e0425beddf7/4163f652-1d50-5d14-8162-6e0425beddf7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57248,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/29/4029cc04f68b0c73310ee4df61379673/pa/ZE12212_56e24de76400d807d6b4d8676277f6e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4163f652-1d50-5d14-8162-6e0425beddf7/4163f652-1d50-5d14-8162-6e0425beddf7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66446,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/29/4029cc04f68b0c73310ee4df61379673/pa/ZE12212_ceeaef1075db2b828a8214beff192caa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4163f652-1d50-5d14-8162-6e0425beddf7/4163f652-1d50-5d14-8162-6e0425beddf7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44069,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/29/4029cc04f68b0c73310ee4df61379673/pa/ZE12212_ad01c30c009bb875d486c0756d733f00.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4163f652-1d50-5d14-8162-6e0425beddf7/4163f652-1d50-5d14-8162-6e0425beddf7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54277,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/29/4029cc04f68b0c73310ee4df61379673/pa/ZE12212_bf730d2e7126280d5b0669867e2bea7b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4163f652-1d50-5d14-8162-6e0425beddf7/4163f652-1d50-5d14-8162-6e0425beddf7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73149,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/29/4029cc04f68b0c73310ee4df61379673/pa/ZE12212_f4c49e776ed56158bdaa6fb158b3adfa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4163f652-1d50-5d14-8162-6e0425beddf7/4163f652-1d50-5d14-8162-6e0425beddf7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51755,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/29/4029cc04f68b0c73310ee4df61379673/pa/ZE12212_e6d1bdd76370e0963fe44a41ce8ee338.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-05-30',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Juke 1.5 Turbodiesel Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2016}
2026-03-30 11:23:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZE12212%27 HTTP/1.1" 200 None
2026-03-30 11:23:35 [auto1.es] INFO: Saving data for ZE12212: {'created_time': 1774869815.985165, 'last_price_update_time': 1774869815.985174, 'auction_closing_time': 1774969550.0}
2026-03-30 11:23:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZE12212') HTTP/1.1" 204 0
2026-03-30 11:23:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_14a1db92adcd712b72ea49d4cf619c29.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a488ad0>
2026-03-30 11:23:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8133e65-c307-5755-a57a-9aacdd16a950/a8133e65-c307-5755-a57a-9aacdd16a950_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa9%252Fc3a9e22411f406d2e6b3a24627907630%252Fpa%252FLH46678_14a1db92adcd712b72ea49d4cf619c29.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_14a1db92adcd712b72ea49d4cf619c29.jpg saved to cache
2026-03-30 11:23:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a8133e65-c307-5755-a57a-9aacdd16a950
2026-03-30 11:23:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_78a0a6fa96c59713b81ef9f2bd9cb079.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05aee2010>
2026-03-30 11:23:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8133e65-c307-5755-a57a-9aacdd16a950/a8133e65-c307-5755-a57a-9aacdd16a950_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa9%252Fc3a9e22411f406d2e6b3a24627907630%252Fpa%252FLH46678_78a0a6fa96c59713b81ef9f2bd9cb079.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_78a0a6fa96c59713b81ef9f2bd9cb079.jpg saved to cache
2026-03-30 11:23:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a8133e65-c307-5755-a57a-9aacdd16a950
2026-03-30 11:23:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_103d7565593a778bd445256309497393.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_718e56971bff12cf93561d68977d360e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc0610b6850>
2026-03-30 11:23:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8133e65-c307-5755-a57a-9aacdd16a950/a8133e65-c307-5755-a57a-9aacdd16a950_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa9%252Fc3a9e22411f406d2e6b3a24627907630%252Fpa%252FLH46678_103d7565593a778bd445256309497393.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_103d7565593a778bd445256309497393.jpg saved to cache
2026-03-30 11:23:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a8133e65-c307-5755-a57a-9aacdd16a950
2026-03-30 11:23:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3eedd0>
2026-03-30 11:23:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8133e65-c307-5755-a57a-9aacdd16a950/a8133e65-c307-5755-a57a-9aacdd16a950_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fa9%252Fc3a9e22411f406d2e6b3a24627907630%252Fpa%252FLH46678_718e56971bff12cf93561d68977d360e.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_718e56971bff12cf93561d68977d360e.jpg saved to cache
2026-03-30 11:23:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a8133e65-c307-5755-a57a-9aacdd16a950
2026-03-30 11:23:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a8133e65-c307-5755-a57a-9aacdd16a950, skipping ID generation
2026-03-30 11:23:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8133e65-c307-5755-a57a-9aacdd16a950 with scrape type 1
2026-03-30 11:23:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a8133e65-c307-5755-a57a-9aacdd16a950 sending to next pipeline
2026-03-30 11:23:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a8133e65-c307-5755-a57a-9aacdd16a950, identifier: LH46678
2026-03-30 11:23:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a8133e65-c307-5755-a57a-9aacdd16a950 with identifier: LH46678
2026-03-30 11:23:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a8133e65-c307-5755-a57a-9aacdd16a950 with identifier: LH46678
2026-03-30 11:23:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a8133e65-c307-5755-a57a-9aacdd16a950 with identifier: LH46678 to the API
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:23:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:23:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_718e56971bff12cf93561d68977d360e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 133,
'category': 'Rental',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-03-31T15:37:19Z',
'fuel_type': 'diesel',
'id': 'a8133e65-c307-5755-a57a-9aacdd16a950',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH46678',
'listing': 'auction',
'location': 'ES, El Rebolledo (Alicante)',
'make': 'Audi',
'model': 'Q5',
'odometer': 146747,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8133e65-c307-5755-a57a-9aacdd16a950/a8133e65-c307-5755-a57a-9aacdd16a950_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89631,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_718e56971bff12cf93561d68977d360e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8133e65-c307-5755-a57a-9aacdd16a950/a8133e65-c307-5755-a57a-9aacdd16a950_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78532,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_103d7565593a778bd445256309497393.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8133e65-c307-5755-a57a-9aacdd16a950/a8133e65-c307-5755-a57a-9aacdd16a950_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88909,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_78a0a6fa96c59713b81ef9f2bd9cb079.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8133e65-c307-5755-a57a-9aacdd16a950/a8133e65-c307-5755-a57a-9aacdd16a950_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71772,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_14a1db92adcd712b72ea49d4cf619c29.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8133e65-c307-5755-a57a-9aacdd16a950/a8133e65-c307-5755-a57a-9aacdd16a950_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80294,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_9ab27691d151369c8ede4f9949c3005e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8133e65-c307-5755-a57a-9aacdd16a950/a8133e65-c307-5755-a57a-9aacdd16a950_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84389,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_a3c3e82118decda4f43859e70ead6d09.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8133e65-c307-5755-a57a-9aacdd16a950/a8133e65-c307-5755-a57a-9aacdd16a950_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64899,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_4cb40fb656a22d4d5df7c3950b4550d0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8133e65-c307-5755-a57a-9aacdd16a950/a8133e65-c307-5755-a57a-9aacdd16a950_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79186,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_0fbfb3ade08adb5fe7327296ad95ae91.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8133e65-c307-5755-a57a-9aacdd16a950/a8133e65-c307-5755-a57a-9aacdd16a950_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87997,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_839f1233255bda0a0a79ef7805afc2b7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8133e65-c307-5755-a57a-9aacdd16a950/a8133e65-c307-5755-a57a-9aacdd16a950_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61149,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/a9/c3a9e22411f406d2e6b3a24627907630/pa/LH46678_07b4d25c0e92e9caf646b2efe512f860.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-11-20',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q5 2.0 TDI quattro S Line',
'transmission': 'automatic',
'trim': 'quattro S Line',
'year': 2017}
2026-03-30 11:23:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LH46678%27 HTTP/1.1" 200 None
2026-03-30 11:23:37 [auto1.es] INFO: Saving data for LH46678: {'created_time': 1774869817.170989, 'last_price_update_time': 1774869817.171, 'auction_closing_time': 1774971439.0}
2026-03-30 11:23:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LH46678') HTTP/1.1" 204 0
2026-03-30 11:23:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AT55590> (referer: https://www.auto1.com/v1/car-details-view/AT55590/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:23:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:23:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0513b8af-a015-5986-b968-cd97aac48aee with identifier: AT55590
2026-03-30 11:23:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0513b8af-a015-5986-b968-cd97aac48aee with scrape type 1
2026-03-30 11:23:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0513b8af-a015-5986-b968-cd97aac48aee
2026-03-30 11:23:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F92%252F32924c3faa5efd8069ce163bdae779e6%252Fpa%252FAT55590_d80e8309785772e19f874d53835854c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/92/32924c3faa5efd8069ce163bdae779e6/pa/AT55590_d80e8309785772e19f874d53835854c4.jpg already downloaded
2026-03-30 11:23:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F92%252F32924c3faa5efd8069ce163bdae779e6%252Fpa%252FAT55590_e693f4a3f96b1ec90713a36509e308e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/92/32924c3faa5efd8069ce163bdae779e6/pa/AT55590_e693f4a3f96b1ec90713a36509e308e2.jpg already downloaded
2026-03-30 11:23:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F92%252F32924c3faa5efd8069ce163bdae779e6%252Fpa%252FAT55590_3d6188e5fa0b4d6719d3a6c7ae30358d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/92/32924c3faa5efd8069ce163bdae779e6/pa/AT55590_3d6188e5fa0b4d6719d3a6c7ae30358d.jpg already downloaded
2026-03-30 11:23:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F92%252F32924c3faa5efd8069ce163bdae779e6%252Fpa%252FAT55590_c1024dcfea30391a7675de20a435c816.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/92/32924c3faa5efd8069ce163bdae779e6/pa/AT55590_c1024dcfea30391a7675de20a435c816.jpg already downloaded
2026-03-30 11:23:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F92%252F32924c3faa5efd8069ce163bdae779e6%252Fpa%252FAT55590_5e15550dba16afdcd3978c11664aac81.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/92/32924c3faa5efd8069ce163bdae779e6/pa/AT55590_5e15550dba16afdcd3978c11664aac81.jpg already downloaded
2026-03-30 11:23:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F92%252F32924c3faa5efd8069ce163bdae779e6%252Fpa%252FAT55590_5a4ecba90fa8d6767cb5a0b818cfcc45.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/92/32924c3faa5efd8069ce163bdae779e6/pa/AT55590_5a4ecba90fa8d6767cb5a0b818cfcc45.jpg already downloaded
2026-03-30 11:23:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F92%252F32924c3faa5efd8069ce163bdae779e6%252Fpa%252FAT55590_67adb6031a4ddf6c6d309d47dd465b00.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/92/32924c3faa5efd8069ce163bdae779e6/pa/AT55590_67adb6031a4ddf6c6d309d47dd465b00.jpg not downloaded yet
2026-03-30 11:23:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F92%252F32924c3faa5efd8069ce163bdae779e6%252Fpa%252FAT55590_dc86dc45f199f86daaa7effbd97447dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/92/32924c3faa5efd8069ce163bdae779e6/pa/AT55590_dc86dc45f199f86daaa7effbd97447dc.jpg already downloaded
2026-03-30 11:23:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F92%252F32924c3faa5efd8069ce163bdae779e6%252Fpa%252FAT55590_adc5d414ee97bf55e4eada43ae68d93c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/92/32924c3faa5efd8069ce163bdae779e6/pa/AT55590_adc5d414ee97bf55e4eada43ae68d93c.jpg already downloaded
2026-03-30 11:23:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F92%252F32924c3faa5efd8069ce163bdae779e6%252Fpa%252FAT55590_f715a379ae5916ceca7e83f31b9f8a3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/92/32924c3faa5efd8069ce163bdae779e6/pa/AT55590_f715a379ae5916ceca7e83f31b9f8a3a.jpg already downloaded
2026-03-30 11:23:45 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 267.837(s), this was the 2nd time calling it.
2026-03-30 11:23:45 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.0520492821145435 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:23:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PH66754> (referer: https://www.auto1.com/v1/car-details-view/PH66754/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:23:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:23:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecc0ec4c-fa42-5dc6-b49c-594ea93732fa with identifier: PH66754
2026-03-30 11:23:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecc0ec4c-fa42-5dc6-b49c-594ea93732fa with scrape type 1
2026-03-30 11:23:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ecc0ec4c-fa42-5dc6-b49c-594ea93732fa
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F5a%252Fb95a86facdff53620a9cdf18c41a5085%252Fpa%252FPH66754_cd7aaf721b466264f24e8d302e3dbfed.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/5a/b95a86facdff53620a9cdf18c41a5085/pa/PH66754_cd7aaf721b466264f24e8d302e3dbfed.jpg already downloaded
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F5a%252Fb95a86facdff53620a9cdf18c41a5085%252Fpa%252FPH66754_06c7e86e8255bfa384953db83780429a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/5a/b95a86facdff53620a9cdf18c41a5085/pa/PH66754_06c7e86e8255bfa384953db83780429a.jpg already downloaded
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F5a%252Fb95a86facdff53620a9cdf18c41a5085%252Fpa%252FPH66754_14e562f637bff29b802658b250b90914.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/5a/b95a86facdff53620a9cdf18c41a5085/pa/PH66754_14e562f637bff29b802658b250b90914.jpg already downloaded
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F5a%252Fb95a86facdff53620a9cdf18c41a5085%252Fpa%252FPH66754_897b1416664855ec0034ac9591d28031.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/5a/b95a86facdff53620a9cdf18c41a5085/pa/PH66754_897b1416664855ec0034ac9591d28031.jpg already downloaded
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F5a%252Fb95a86facdff53620a9cdf18c41a5085%252Fpa%252FPH66754_cfd2b016c06b3dac62dbf82604348cb9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/5a/b95a86facdff53620a9cdf18c41a5085/pa/PH66754_cfd2b016c06b3dac62dbf82604348cb9.jpg already downloaded
2026-03-30 11:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F5a%252Fb95a86facdff53620a9cdf18c41a5085%252Fpa%252FPH66754_38f8feaf973174da0eaac8016283d357.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/5a/b95a86facdff53620a9cdf18c41a5085/pa/PH66754_38f8feaf973174da0eaac8016283d357.jpg already downloaded
2026-03-30 11:23:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F5a%252Fb95a86facdff53620a9cdf18c41a5085%252Fpa%252FPH66754_d3f4e591374f79d8e7a4581aacf59462.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/5a/b95a86facdff53620a9cdf18c41a5085/pa/PH66754_d3f4e591374f79d8e7a4581aacf59462.jpg already downloaded
2026-03-30 11:23:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F5a%252Fb95a86facdff53620a9cdf18c41a5085%252Fpa%252FPH66754_477e7ea2710ba4c77dadedf160722fa3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/5a/b95a86facdff53620a9cdf18c41a5085/pa/PH66754_477e7ea2710ba4c77dadedf160722fa3.jpg already downloaded
2026-03-30 11:23:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F5a%252Fb95a86facdff53620a9cdf18c41a5085%252Fpa%252FPH66754_6a7ebdb606ed5976ea38949cd122c002.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/5a/b95a86facdff53620a9cdf18c41a5085/pa/PH66754_6a7ebdb606ed5976ea38949cd122c002.jpg already downloaded
2026-03-30 11:23:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F5a%252Fb95a86facdff53620a9cdf18c41a5085%252Fpa%252FPH66754_1cef54d4bbcd16a6b9b596116fd4a861.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/5a/b95a86facdff53620a9cdf18c41a5085/pa/PH66754_1cef54d4bbcd16a6b9b596116fd4a861.jpg already downloaded
2026-03-30 11:23:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ecc0ec4c-fa42-5dc6-b49c-594ea93732fa, identifier: PH66754
2026-03-30 11:23:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ecc0ec4c-fa42-5dc6-b49c-594ea93732fa with identifier: PH66754
2026-03-30 11:23:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ecc0ec4c-fa42-5dc6-b49c-594ea93732fa with identifier: PH66754
2026-03-30 11:23:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ecc0ec4c-fa42-5dc6-b49c-594ea93732fa with identifier: PH66754 to the API
2026-03-30 11:23:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:23:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:23:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PH66754>
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 100,
'expiration_date': '2026-03-31T15:41:29Z',
'fuel_type': 'diesel',
'id': 'ecc0ec4c-fa42-5dc6-b49c-594ea93732fa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH66754',
'listing': 'auction',
'location': 'ES, Aldaya',
'make': 'Peugeot',
'model': 'Partner',
'odometer': 188992,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgb9/5a/b95a86facdff53620a9cdf18c41a5085/pa/PH66754_cd7aaf721b466264f24e8d302e3dbfed.jpg',
'https://img-pa.auto1.com/imgb9/5a/b95a86facdff53620a9cdf18c41a5085/pa/PH66754_06c7e86e8255bfa384953db83780429a.jpg',
'https://img-pa.auto1.com/imgb9/5a/b95a86facdff53620a9cdf18c41a5085/pa/PH66754_14e562f637bff29b802658b250b90914.jpg',
'https://img-pa.auto1.com/imgb9/5a/b95a86facdff53620a9cdf18c41a5085/pa/PH66754_897b1416664855ec0034ac9591d28031.jpg',
'https://img-pa.auto1.com/imgb9/5a/b95a86facdff53620a9cdf18c41a5085/pa/PH66754_cfd2b016c06b3dac62dbf82604348cb9.jpg',
'https://img-pa.auto1.com/imgb9/5a/b95a86facdff53620a9cdf18c41a5085/pa/PH66754_38f8feaf973174da0eaac8016283d357.jpg',
'https://img-pa.auto1.com/imgb9/5a/b95a86facdff53620a9cdf18c41a5085/pa/PH66754_d3f4e591374f79d8e7a4581aacf59462.jpg',
'https://img-pa.auto1.com/imgb9/5a/b95a86facdff53620a9cdf18c41a5085/pa/PH66754_477e7ea2710ba4c77dadedf160722fa3.jpg',
'https://img-pa.auto1.com/imgb9/5a/b95a86facdff53620a9cdf18c41a5085/pa/PH66754_6a7ebdb606ed5976ea38949cd122c002.jpg',
'https://img-pa.auto1.com/imgb9/5a/b95a86facdff53620a9cdf18c41a5085/pa/PH66754_1cef54d4bbcd16a6b9b596116fd4a861.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc0ec4c-fa42-5dc6-b49c-594ea93732fa/ecc0ec4c-fa42-5dc6-b49c-594ea93732fa_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84252,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/5a/b95a86facdff53620a9cdf18c41a5085/pa/PH66754_cd7aaf721b466264f24e8d302e3dbfed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc0ec4c-fa42-5dc6-b49c-594ea93732fa/ecc0ec4c-fa42-5dc6-b49c-594ea93732fa_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87816,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/5a/b95a86facdff53620a9cdf18c41a5085/pa/PH66754_06c7e86e8255bfa384953db83780429a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc0ec4c-fa42-5dc6-b49c-594ea93732fa/ecc0ec4c-fa42-5dc6-b49c-594ea93732fa_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84585,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/5a/b95a86facdff53620a9cdf18c41a5085/pa/PH66754_14e562f637bff29b802658b250b90914.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc0ec4c-fa42-5dc6-b49c-594ea93732fa/ecc0ec4c-fa42-5dc6-b49c-594ea93732fa_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66938,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/5a/b95a86facdff53620a9cdf18c41a5085/pa/PH66754_897b1416664855ec0034ac9591d28031.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc0ec4c-fa42-5dc6-b49c-594ea93732fa/ecc0ec4c-fa42-5dc6-b49c-594ea93732fa_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76130,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/5a/b95a86facdff53620a9cdf18c41a5085/pa/PH66754_cfd2b016c06b3dac62dbf82604348cb9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc0ec4c-fa42-5dc6-b49c-594ea93732fa/ecc0ec4c-fa42-5dc6-b49c-594ea93732fa_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84136,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/5a/b95a86facdff53620a9cdf18c41a5085/pa/PH66754_38f8feaf973174da0eaac8016283d357.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc0ec4c-fa42-5dc6-b49c-594ea93732fa/ecc0ec4c-fa42-5dc6-b49c-594ea93732fa_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67661,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/5a/b95a86facdff53620a9cdf18c41a5085/pa/PH66754_d3f4e591374f79d8e7a4581aacf59462.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc0ec4c-fa42-5dc6-b49c-594ea93732fa/ecc0ec4c-fa42-5dc6-b49c-594ea93732fa_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86175,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/5a/b95a86facdff53620a9cdf18c41a5085/pa/PH66754_477e7ea2710ba4c77dadedf160722fa3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc0ec4c-fa42-5dc6-b49c-594ea93732fa/ecc0ec4c-fa42-5dc6-b49c-594ea93732fa_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81475,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/5a/b95a86facdff53620a9cdf18c41a5085/pa/PH66754_6a7ebdb606ed5976ea38949cd122c002.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc0ec4c-fa42-5dc6-b49c-594ea93732fa/ecc0ec4c-fa42-5dc6-b49c-594ea93732fa_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86452,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/5a/b95a86facdff53620a9cdf18c41a5085/pa/PH66754_1cef54d4bbcd16a6b9b596116fd4a861.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-01-15',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot Partner 1.6 Blue-HDi Outdoor',
'transmission': 'manual',
'trim': 'Outdoor',
'year': 2017}
2026-03-30 11:23:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PH66754%27 HTTP/1.1" 200 None
2026-03-30 11:23:46 [auto1.es] INFO: Saving data for PH66754: {'created_time': 1774869826.643437, 'last_price_update_time': 1774869826.643451, 'auction_closing_time': 1774971689.0}
2026-03-30 11:23:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PH66754') HTTP/1.1" 204 0
2026-03-30 11:23:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/92/32924c3faa5efd8069ce163bdae779e6/pa/AT55590_67adb6031a4ddf6c6d309d47dd465b00.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KV96950> (referer: https://www.auto1.com/v1/car-details-view/KV96950/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:23:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:23:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3ce310>
2026-03-30 11:23:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0513b8af-a015-5986-b968-cd97aac48aee/0513b8af-a015-5986-b968-cd97aac48aee_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:23:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F92%252F32924c3faa5efd8069ce163bdae779e6%252Fpa%252FAT55590_67adb6031a4ddf6c6d309d47dd465b00.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/92/32924c3faa5efd8069ce163bdae779e6/pa/AT55590_67adb6031a4ddf6c6d309d47dd465b00.jpg saved to cache
2026-03-30 11:23:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0513b8af-a015-5986-b968-cd97aac48aee
2026-03-30 11:23:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0513b8af-a015-5986-b968-cd97aac48aee, skipping ID generation
2026-03-30 11:23:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0513b8af-a015-5986-b968-cd97aac48aee with scrape type 1
2026-03-30 11:23:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0513b8af-a015-5986-b968-cd97aac48aee sending to next pipeline
2026-03-30 11:23:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0513b8af-a015-5986-b968-cd97aac48aee, identifier: AT55590
2026-03-30 11:23:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0513b8af-a015-5986-b968-cd97aac48aee with identifier: AT55590
2026-03-30 11:23:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0513b8af-a015-5986-b968-cd97aac48aee with identifier: AT55590
2026-03-30 11:23:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0513b8af-a015-5986-b968-cd97aac48aee with identifier: AT55590 to the API
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:23:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img32/92/32924c3faa5efd8069ce163bdae779e6/pa/AT55590_67adb6031a4ddf6c6d309d47dd465b00.jpg>
{'auction_title': '',
'c_o_2_emission_value': 159,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 177,
'expiration_date': '2026-03-31T15:57:12Z',
'fuel_type': 'diesel',
'id': '0513b8af-a015-5986-b968-cd97aac48aee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT55590',
'listing': 'auction',
'location': 'ES, El Prat de Llobregat (Barcelona)',
'make': 'Audi',
'model': 'Q5',
'odometer': 123347,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0513b8af-a015-5986-b968-cd97aac48aee/0513b8af-a015-5986-b968-cd97aac48aee_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71799,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img32/92/32924c3faa5efd8069ce163bdae779e6/pa/AT55590_d80e8309785772e19f874d53835854c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0513b8af-a015-5986-b968-cd97aac48aee/0513b8af-a015-5986-b968-cd97aac48aee_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74727,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img32/92/32924c3faa5efd8069ce163bdae779e6/pa/AT55590_e693f4a3f96b1ec90713a36509e308e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0513b8af-a015-5986-b968-cd97aac48aee/0513b8af-a015-5986-b968-cd97aac48aee_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65732,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img32/92/32924c3faa5efd8069ce163bdae779e6/pa/AT55590_3d6188e5fa0b4d6719d3a6c7ae30358d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0513b8af-a015-5986-b968-cd97aac48aee/0513b8af-a015-5986-b968-cd97aac48aee_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56841,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img32/92/32924c3faa5efd8069ce163bdae779e6/pa/AT55590_c1024dcfea30391a7675de20a435c816.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0513b8af-a015-5986-b968-cd97aac48aee/0513b8af-a015-5986-b968-cd97aac48aee_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58770,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img32/92/32924c3faa5efd8069ce163bdae779e6/pa/AT55590_5e15550dba16afdcd3978c11664aac81.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0513b8af-a015-5986-b968-cd97aac48aee/0513b8af-a015-5986-b968-cd97aac48aee_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67587,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img32/92/32924c3faa5efd8069ce163bdae779e6/pa/AT55590_5a4ecba90fa8d6767cb5a0b818cfcc45.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0513b8af-a015-5986-b968-cd97aac48aee/0513b8af-a015-5986-b968-cd97aac48aee_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67530,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img32/92/32924c3faa5efd8069ce163bdae779e6/pa/AT55590_67adb6031a4ddf6c6d309d47dd465b00.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0513b8af-a015-5986-b968-cd97aac48aee/0513b8af-a015-5986-b968-cd97aac48aee_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71882,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img32/92/32924c3faa5efd8069ce163bdae779e6/pa/AT55590_dc86dc45f199f86daaa7effbd97447dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0513b8af-a015-5986-b968-cd97aac48aee/0513b8af-a015-5986-b968-cd97aac48aee_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75727,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img32/92/32924c3faa5efd8069ce163bdae779e6/pa/AT55590_adc5d414ee97bf55e4eada43ae68d93c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0513b8af-a015-5986-b968-cd97aac48aee/0513b8af-a015-5986-b968-cd97aac48aee_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65060,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img32/92/32924c3faa5efd8069ce163bdae779e6/pa/AT55590_f715a379ae5916ceca7e83f31b9f8a3a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-03-06',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q5 2.0 TDI quattro Advance',
'transmission': 'automatic',
'trim': 'quattro Advance',
'year': 2014}
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AT55590%27 HTTP/1.1" 200 None
2026-03-30 11:23:47 [auto1.es] INFO: Saving data for AT55590: {'created_time': 1774869827.259367, 'last_price_update_time': 1774869827.259379, 'auction_closing_time': 1774972632.0}
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AT55590') HTTP/1.1" 204 0
2026-03-30 11:23:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a31eca48-b7f6-5d47-823c-296941ba004f with identifier: KV96950
2026-03-30 11:23:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a31eca48-b7f6-5d47-823c-296941ba004f with scrape type 1
2026-03-30 11:23:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item a31eca48-b7f6-5d47-823c-296941ba004f
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F5a%252F075a9911c4ec4f330ebe3ea67322a260%252Fpa%252FKV96950_da9d1f0a1c060ee6fcdc730a2502d316.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/5a/075a9911c4ec4f330ebe3ea67322a260/pa/KV96950_da9d1f0a1c060ee6fcdc730a2502d316.jpg not downloaded yet
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F5a%252F075a9911c4ec4f330ebe3ea67322a260%252Fpa%252FKV96950_4876d6f0c2c6566de657e17cee64d7f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/5a/075a9911c4ec4f330ebe3ea67322a260/pa/KV96950_4876d6f0c2c6566de657e17cee64d7f9.jpg not downloaded yet
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F5a%252F075a9911c4ec4f330ebe3ea67322a260%252Fpa%252FKV96950_edb08e92d21594c5de90020715f5a16a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/5a/075a9911c4ec4f330ebe3ea67322a260/pa/KV96950_edb08e92d21594c5de90020715f5a16a.jpg not downloaded yet
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F5a%252F075a9911c4ec4f330ebe3ea67322a260%252Fpa%252FKV96950_5e5dda3dacd314b33afc6a70472b5126.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/5a/075a9911c4ec4f330ebe3ea67322a260/pa/KV96950_5e5dda3dacd314b33afc6a70472b5126.jpg not downloaded yet
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F5a%252F075a9911c4ec4f330ebe3ea67322a260%252Fpa%252FKV96950_4f671e8589542c83384f5cef04e3b121.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/5a/075a9911c4ec4f330ebe3ea67322a260/pa/KV96950_4f671e8589542c83384f5cef04e3b121.jpg not downloaded yet
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F5a%252F075a9911c4ec4f330ebe3ea67322a260%252Fpa%252FKV96950_fdc8d495579a5193f99d67651fc99136.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:23:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/5a/075a9911c4ec4f330ebe3ea67322a260/pa/KV96950_fdc8d495579a5193f99d67651fc99136.jpg not downloaded yet
2026-03-30 11:23:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/5a/075a9911c4ec4f330ebe3ea67322a260/pa/KV96950_da9d1f0a1c060ee6fcdc730a2502d316.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/5a/075a9911c4ec4f330ebe3ea67322a260/pa/KV96950_fdc8d495579a5193f99d67651fc99136.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05aee0d10>
2026-03-30 11:23:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a31eca48-b7f6-5d47-823c-296941ba004f/a31eca48-b7f6-5d47-823c-296941ba004f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F5a%252F075a9911c4ec4f330ebe3ea67322a260%252Fpa%252FKV96950_da9d1f0a1c060ee6fcdc730a2502d316.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/5a/075a9911c4ec4f330ebe3ea67322a260/pa/KV96950_da9d1f0a1c060ee6fcdc730a2502d316.jpg saved to cache
2026-03-30 11:23:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a31eca48-b7f6-5d47-823c-296941ba004f
2026-03-30 11:23:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/5a/075a9911c4ec4f330ebe3ea67322a260/pa/KV96950_4f671e8589542c83384f5cef04e3b121.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a457b10>
2026-03-30 11:23:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a31eca48-b7f6-5d47-823c-296941ba004f/a31eca48-b7f6-5d47-823c-296941ba004f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F5a%252F075a9911c4ec4f330ebe3ea67322a260%252Fpa%252FKV96950_fdc8d495579a5193f99d67651fc99136.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/5a/075a9911c4ec4f330ebe3ea67322a260/pa/KV96950_fdc8d495579a5193f99d67651fc99136.jpg saved to cache
2026-03-30 11:23:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a31eca48-b7f6-5d47-823c-296941ba004f
2026-03-30 11:23:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/5a/075a9911c4ec4f330ebe3ea67322a260/pa/KV96950_5e5dda3dacd314b33afc6a70472b5126.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4b76d0>
2026-03-30 11:23:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a31eca48-b7f6-5d47-823c-296941ba004f/a31eca48-b7f6-5d47-823c-296941ba004f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F5a%252F075a9911c4ec4f330ebe3ea67322a260%252Fpa%252FKV96950_4f671e8589542c83384f5cef04e3b121.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/5a/075a9911c4ec4f330ebe3ea67322a260/pa/KV96950_4f671e8589542c83384f5cef04e3b121.jpg saved to cache
2026-03-30 11:23:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a31eca48-b7f6-5d47-823c-296941ba004f
2026-03-30 11:23:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/5a/075a9911c4ec4f330ebe3ea67322a260/pa/KV96950_edb08e92d21594c5de90020715f5a16a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4e1a50>
2026-03-30 11:23:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a31eca48-b7f6-5d47-823c-296941ba004f/a31eca48-b7f6-5d47-823c-296941ba004f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F5a%252F075a9911c4ec4f330ebe3ea67322a260%252Fpa%252FKV96950_5e5dda3dacd314b33afc6a70472b5126.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/5a/075a9911c4ec4f330ebe3ea67322a260/pa/KV96950_5e5dda3dacd314b33afc6a70472b5126.jpg saved to cache
2026-03-30 11:23:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a31eca48-b7f6-5d47-823c-296941ba004f
2026-03-30 11:23:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/5a/075a9911c4ec4f330ebe3ea67322a260/pa/KV96950_4876d6f0c2c6566de657e17cee64d7f9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:23:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05aee3650>
2026-03-30 11:23:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a31eca48-b7f6-5d47-823c-296941ba004f/a31eca48-b7f6-5d47-823c-296941ba004f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F5a%252F075a9911c4ec4f330ebe3ea67322a260%252Fpa%252FKV96950_edb08e92d21594c5de90020715f5a16a.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/5a/075a9911c4ec4f330ebe3ea67322a260/pa/KV96950_edb08e92d21594c5de90020715f5a16a.jpg saved to cache
2026-03-30 11:23:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a31eca48-b7f6-5d47-823c-296941ba004f
2026-03-30 11:23:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:23:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05aee0ed0>
2026-03-30 11:23:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:23:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a31eca48-b7f6-5d47-823c-296941ba004f/a31eca48-b7f6-5d47-823c-296941ba004f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F5a%252F075a9911c4ec4f330ebe3ea67322a260%252Fpa%252FKV96950_4876d6f0c2c6566de657e17cee64d7f9.jpg') HTTP/1.1" 204 0
2026-03-30 11:23:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/5a/075a9911c4ec4f330ebe3ea67322a260/pa/KV96950_4876d6f0c2c6566de657e17cee64d7f9.jpg saved to cache
2026-03-30 11:23:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a31eca48-b7f6-5d47-823c-296941ba004f
2026-03-30 11:23:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a31eca48-b7f6-5d47-823c-296941ba004f, skipping ID generation
2026-03-30 11:23:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a31eca48-b7f6-5d47-823c-296941ba004f with scrape type 1
2026-03-30 11:23:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a31eca48-b7f6-5d47-823c-296941ba004f sending to next pipeline
2026-03-30 11:23:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a31eca48-b7f6-5d47-823c-296941ba004f, identifier: KV96950
2026-03-30 11:23:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a31eca48-b7f6-5d47-823c-296941ba004f with identifier: KV96950
2026-03-30 11:23:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a31eca48-b7f6-5d47-823c-296941ba004f with identifier: KV96950
2026-03-30 11:23:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a31eca48-b7f6-5d47-823c-296941ba004f with identifier: KV96950 to the API
2026-03-30 11:23:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:23:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:23:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img07/5a/075a9911c4ec4f330ebe3ea67322a260/pa/KV96950_4876d6f0c2c6566de657e17cee64d7f9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine': '1.9L',
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:50:45Z',
'fuel_type': 'diesel',
'id': 'a31eca48-b7f6-5d47-823c-296941ba004f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV96950',
'listing': 'auction',
'location': 'ES, San Juan de Aznalfarache, Sevilla',
'make': 'Audi',
'model': 'A4',
'odometer': 287259,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a31eca48-b7f6-5d47-823c-296941ba004f/a31eca48-b7f6-5d47-823c-296941ba004f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111001,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/5a/075a9911c4ec4f330ebe3ea67322a260/pa/KV96950_da9d1f0a1c060ee6fcdc730a2502d316.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a31eca48-b7f6-5d47-823c-296941ba004f/a31eca48-b7f6-5d47-823c-296941ba004f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92232,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/5a/075a9911c4ec4f330ebe3ea67322a260/pa/KV96950_4876d6f0c2c6566de657e17cee64d7f9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a31eca48-b7f6-5d47-823c-296941ba004f/a31eca48-b7f6-5d47-823c-296941ba004f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87298,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/5a/075a9911c4ec4f330ebe3ea67322a260/pa/KV96950_edb08e92d21594c5de90020715f5a16a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a31eca48-b7f6-5d47-823c-296941ba004f/a31eca48-b7f6-5d47-823c-296941ba004f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61001,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/5a/075a9911c4ec4f330ebe3ea67322a260/pa/KV96950_5e5dda3dacd314b33afc6a70472b5126.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a31eca48-b7f6-5d47-823c-296941ba004f/a31eca48-b7f6-5d47-823c-296941ba004f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69765,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/5a/075a9911c4ec4f330ebe3ea67322a260/pa/KV96950_4f671e8589542c83384f5cef04e3b121.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a31eca48-b7f6-5d47-823c-296941ba004f/a31eca48-b7f6-5d47-823c-296941ba004f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96600,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/5a/075a9911c4ec4f330ebe3ea67322a260/pa/KV96950_fdc8d495579a5193f99d67651fc99136.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2001-05-28',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A4 1.9 TDI',
'transmission': 'manual',
'trim': '',
'year': 2001}
2026-03-30 11:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KV96950%27 HTTP/1.1" 200 None
2026-03-30 11:23:48 [auto1.es] INFO: Saving data for KV96950: {'created_time': 1774869828.456724, 'last_price_update_time': 1774869828.456735, 'auction_closing_time': 1774972245.0}
2026-03-30 11:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KV96950') HTTP/1.1" 204 0
2026-03-30 11:23:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 11:23:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ST19382/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:23:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:23:55 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.252(s), this was the 1st time calling it.
2026-03-30 11:23:55 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.227693035010808 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:23:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JW87659/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:23:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:24:04 [scrapy.extensions.logstats] INFO: Crawled 123 pages (at 17 pages/min), scraped 140 items (at 22 items/min)
2026-03-30 11:24:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 161MiB
2026-03-30 11:24:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LP52549/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:24:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VL80227/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:24:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EH47401> (referer: https://www.auto1.com/v1/car-details-view/EH47401/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:24:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3dc67943-229e-575f-b5c3-a6a72e775c20 with identifier: EH47401
2026-03-30 11:24:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3dc67943-229e-575f-b5c3-a6a72e775c20 with scrape type 1
2026-03-30 11:24:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3dc67943-229e-575f-b5c3-a6a72e775c20
2026-03-30 11:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fc6%252F8ac686874933e33d5f16b98e7dd3a279%252Fpa%252FEH47401_7ea6c173670e377acd25960b7ceab071.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/c6/8ac686874933e33d5f16b98e7dd3a279/pa/EH47401_7ea6c173670e377acd25960b7ceab071.jpg already downloaded
2026-03-30 11:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fc6%252F8ac686874933e33d5f16b98e7dd3a279%252Fpa%252FEH47401_a998c2a943fd1988c6a06db61dd56d15.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/c6/8ac686874933e33d5f16b98e7dd3a279/pa/EH47401_a998c2a943fd1988c6a06db61dd56d15.jpg already downloaded
2026-03-30 11:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fc6%252F8ac686874933e33d5f16b98e7dd3a279%252Fpa%252FEH47401_9d51f4cadeb775c9a60521f51739c5b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/c6/8ac686874933e33d5f16b98e7dd3a279/pa/EH47401_9d51f4cadeb775c9a60521f51739c5b1.jpg already downloaded
2026-03-30 11:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fc6%252F8ac686874933e33d5f16b98e7dd3a279%252Fpa%252FEH47401_81774d153c7e9ec21f505ec17bb63e1d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/c6/8ac686874933e33d5f16b98e7dd3a279/pa/EH47401_81774d153c7e9ec21f505ec17bb63e1d.jpg already downloaded
2026-03-30 11:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fc6%252F8ac686874933e33d5f16b98e7dd3a279%252Fpa%252FEH47401_bc23f7353e516375388d6332a65475fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/c6/8ac686874933e33d5f16b98e7dd3a279/pa/EH47401_bc23f7353e516375388d6332a65475fe.jpg already downloaded
2026-03-30 11:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fc6%252F8ac686874933e33d5f16b98e7dd3a279%252Fpa%252FEH47401_9eb7591b6e648ada720b71626b243915.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/c6/8ac686874933e33d5f16b98e7dd3a279/pa/EH47401_9eb7591b6e648ada720b71626b243915.jpg already downloaded
2026-03-30 11:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fc6%252F8ac686874933e33d5f16b98e7dd3a279%252Fpa%252FEH47401_b9246f6776c61c54f15ee90057d5b5f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/c6/8ac686874933e33d5f16b98e7dd3a279/pa/EH47401_b9246f6776c61c54f15ee90057d5b5f3.jpg already downloaded
2026-03-30 11:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fc6%252F8ac686874933e33d5f16b98e7dd3a279%252Fpa%252FEH47401_b12ff1a443ace600b7f1bb7fb4052461.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/c6/8ac686874933e33d5f16b98e7dd3a279/pa/EH47401_b12ff1a443ace600b7f1bb7fb4052461.jpg already downloaded
2026-03-30 11:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fc6%252F8ac686874933e33d5f16b98e7dd3a279%252Fpa%252FEH47401_b91b725f2cbd8c450ca43cf0a9bf1c3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/c6/8ac686874933e33d5f16b98e7dd3a279/pa/EH47401_b91b725f2cbd8c450ca43cf0a9bf1c3a.jpg already downloaded
2026-03-30 11:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fc6%252F8ac686874933e33d5f16b98e7dd3a279%252Fpa%252FEH47401_8d0be677ff95e095fd45a0db28877c98.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/c6/8ac686874933e33d5f16b98e7dd3a279/pa/EH47401_8d0be677ff95e095fd45a0db28877c98.jpg already downloaded
2026-03-30 11:24:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3dc67943-229e-575f-b5c3-a6a72e775c20, identifier: EH47401
2026-03-30 11:24:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3dc67943-229e-575f-b5c3-a6a72e775c20 with identifier: EH47401
2026-03-30 11:24:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3dc67943-229e-575f-b5c3-a6a72e775c20 with identifier: EH47401
2026-03-30 11:24:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3dc67943-229e-575f-b5c3-a6a72e775c20 with identifier: EH47401 to the API
2026-03-30 11:24:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:24:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:24:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EH47401>
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:46:21Z',
'fuel_type': 'diesel',
'id': '3dc67943-229e-575f-b5c3-a6a72e775c20',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH47401',
'listing': 'auction',
'location': 'ES, Caldes de Malavella (Girona)',
'make': 'Ford',
'model': 'Kuga',
'odometer': 272960,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img8a/c6/8ac686874933e33d5f16b98e7dd3a279/pa/EH47401_7ea6c173670e377acd25960b7ceab071.jpg',
'https://img-pa.auto1.com/img8a/c6/8ac686874933e33d5f16b98e7dd3a279/pa/EH47401_a998c2a943fd1988c6a06db61dd56d15.jpg',
'https://img-pa.auto1.com/img8a/c6/8ac686874933e33d5f16b98e7dd3a279/pa/EH47401_9d51f4cadeb775c9a60521f51739c5b1.jpg',
'https://img-pa.auto1.com/img8a/c6/8ac686874933e33d5f16b98e7dd3a279/pa/EH47401_81774d153c7e9ec21f505ec17bb63e1d.jpg',
'https://img-pa.auto1.com/img8a/c6/8ac686874933e33d5f16b98e7dd3a279/pa/EH47401_bc23f7353e516375388d6332a65475fe.jpg',
'https://img-pa.auto1.com/img8a/c6/8ac686874933e33d5f16b98e7dd3a279/pa/EH47401_9eb7591b6e648ada720b71626b243915.jpg',
'https://img-pa.auto1.com/img8a/c6/8ac686874933e33d5f16b98e7dd3a279/pa/EH47401_b9246f6776c61c54f15ee90057d5b5f3.jpg',
'https://img-pa.auto1.com/img8a/c6/8ac686874933e33d5f16b98e7dd3a279/pa/EH47401_b12ff1a443ace600b7f1bb7fb4052461.jpg',
'https://img-pa.auto1.com/img8a/c6/8ac686874933e33d5f16b98e7dd3a279/pa/EH47401_b91b725f2cbd8c450ca43cf0a9bf1c3a.jpg',
'https://img-pa.auto1.com/img8a/c6/8ac686874933e33d5f16b98e7dd3a279/pa/EH47401_8d0be677ff95e095fd45a0db28877c98.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dc67943-229e-575f-b5c3-a6a72e775c20/3dc67943-229e-575f-b5c3-a6a72e775c20_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103499,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/c6/8ac686874933e33d5f16b98e7dd3a279/pa/EH47401_7ea6c173670e377acd25960b7ceab071.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dc67943-229e-575f-b5c3-a6a72e775c20/3dc67943-229e-575f-b5c3-a6a72e775c20_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89199,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/c6/8ac686874933e33d5f16b98e7dd3a279/pa/EH47401_a998c2a943fd1988c6a06db61dd56d15.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dc67943-229e-575f-b5c3-a6a72e775c20/3dc67943-229e-575f-b5c3-a6a72e775c20_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92863,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/c6/8ac686874933e33d5f16b98e7dd3a279/pa/EH47401_9d51f4cadeb775c9a60521f51739c5b1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dc67943-229e-575f-b5c3-a6a72e775c20/3dc67943-229e-575f-b5c3-a6a72e775c20_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83343,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/c6/8ac686874933e33d5f16b98e7dd3a279/pa/EH47401_81774d153c7e9ec21f505ec17bb63e1d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dc67943-229e-575f-b5c3-a6a72e775c20/3dc67943-229e-575f-b5c3-a6a72e775c20_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87231,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/c6/8ac686874933e33d5f16b98e7dd3a279/pa/EH47401_bc23f7353e516375388d6332a65475fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dc67943-229e-575f-b5c3-a6a72e775c20/3dc67943-229e-575f-b5c3-a6a72e775c20_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88967,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/c6/8ac686874933e33d5f16b98e7dd3a279/pa/EH47401_9eb7591b6e648ada720b71626b243915.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dc67943-229e-575f-b5c3-a6a72e775c20/3dc67943-229e-575f-b5c3-a6a72e775c20_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75973,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/c6/8ac686874933e33d5f16b98e7dd3a279/pa/EH47401_b9246f6776c61c54f15ee90057d5b5f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dc67943-229e-575f-b5c3-a6a72e775c20/3dc67943-229e-575f-b5c3-a6a72e775c20_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97424,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/c6/8ac686874933e33d5f16b98e7dd3a279/pa/EH47401_b12ff1a443ace600b7f1bb7fb4052461.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dc67943-229e-575f-b5c3-a6a72e775c20/3dc67943-229e-575f-b5c3-a6a72e775c20_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96191,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/c6/8ac686874933e33d5f16b98e7dd3a279/pa/EH47401_b91b725f2cbd8c450ca43cf0a9bf1c3a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dc67943-229e-575f-b5c3-a6a72e775c20/3dc67943-229e-575f-b5c3-a6a72e775c20_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87220,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/c6/8ac686874933e33d5f16b98e7dd3a279/pa/EH47401_8d0be677ff95e095fd45a0db28877c98.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-12-27',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi EcoBlue Mild-Hybrid ST-Line X',
'transmission': 'manual',
'trim': 'ST-Line X',
'year': 2020}
2026-03-30 11:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EH47401%27 HTTP/1.1" 200 None
2026-03-30 11:24:15 [auto1.es] INFO: Saving data for EH47401: {'created_time': 1774869855.634338, 'last_price_update_time': 1774869855.634348, 'auction_closing_time': 1774971981.0}
2026-03-30 11:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EH47401') HTTP/1.1" 204 0
2026-03-30 11:24:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/US78299> (referer: https://www.auto1.com/v1/car-details-view/US78299/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:24:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a40f39d1-70a9-5fca-80fa-ead077372cf0 with identifier: US78299
2026-03-30 11:24:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a40f39d1-70a9-5fca-80fa-ead077372cf0 with scrape type 1
2026-03-30 11:24:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item a40f39d1-70a9-5fca-80fa-ead077372cf0
2026-03-30 11:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F12%252F6c12f8cb7f219b7793f1eb47363c7795%252Fpa%252FUS78299_f0098e25496ac811568fac19a026433b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/12/6c12f8cb7f219b7793f1eb47363c7795/pa/US78299_f0098e25496ac811568fac19a026433b.jpg not downloaded yet
2026-03-30 11:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F12%252F6c12f8cb7f219b7793f1eb47363c7795%252Fpa%252FUS78299_aed1d06f5f0bc4f063b2b30bb6a4f03e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/12/6c12f8cb7f219b7793f1eb47363c7795/pa/US78299_aed1d06f5f0bc4f063b2b30bb6a4f03e.jpg not downloaded yet
2026-03-30 11:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F12%252F6c12f8cb7f219b7793f1eb47363c7795%252Fpa%252FUS78299_7beb670a796088d939f01c2f9db9f5e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/12/6c12f8cb7f219b7793f1eb47363c7795/pa/US78299_7beb670a796088d939f01c2f9db9f5e3.jpg not downloaded yet
2026-03-30 11:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F12%252F6c12f8cb7f219b7793f1eb47363c7795%252Fpa%252FUS78299_6d85c0384188134cbe7697c94b4a9cd3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/12/6c12f8cb7f219b7793f1eb47363c7795/pa/US78299_6d85c0384188134cbe7697c94b4a9cd3.jpg not downloaded yet
2026-03-30 11:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F12%252F6c12f8cb7f219b7793f1eb47363c7795%252Fpa%252FUS78299_f278b463cb422b9197441b63799cb175.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/12/6c12f8cb7f219b7793f1eb47363c7795/pa/US78299_f278b463cb422b9197441b63799cb175.jpg not downloaded yet
2026-03-30 11:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F12%252F6c12f8cb7f219b7793f1eb47363c7795%252Fpa%252FUS78299_652ac8f67d4dc823a700431109d0b78e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/12/6c12f8cb7f219b7793f1eb47363c7795/pa/US78299_652ac8f67d4dc823a700431109d0b78e.jpg not downloaded yet
2026-03-30 11:24:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/12/6c12f8cb7f219b7793f1eb47363c7795/pa/US78299_f0098e25496ac811568fac19a026433b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/12/6c12f8cb7f219b7793f1eb47363c7795/pa/US78299_aed1d06f5f0bc4f063b2b30bb6a4f03e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/12/6c12f8cb7f219b7793f1eb47363c7795/pa/US78299_f278b463cb422b9197441b63799cb175.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/12/6c12f8cb7f219b7793f1eb47363c7795/pa/US78299_6d85c0384188134cbe7697c94b4a9cd3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3cce50>
2026-03-30 11:24:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a40f39d1-70a9-5fca-80fa-ead077372cf0/a40f39d1-70a9-5fca-80fa-ead077372cf0_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F12%252F6c12f8cb7f219b7793f1eb47363c7795%252Fpa%252FUS78299_f0098e25496ac811568fac19a026433b.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/12/6c12f8cb7f219b7793f1eb47363c7795/pa/US78299_f0098e25496ac811568fac19a026433b.jpg saved to cache
2026-03-30 11:24:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a40f39d1-70a9-5fca-80fa-ead077372cf0
2026-03-30 11:24:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a387dd0>
2026-03-30 11:24:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a40f39d1-70a9-5fca-80fa-ead077372cf0/a40f39d1-70a9-5fca-80fa-ead077372cf0_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F12%252F6c12f8cb7f219b7793f1eb47363c7795%252Fpa%252FUS78299_aed1d06f5f0bc4f063b2b30bb6a4f03e.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/12/6c12f8cb7f219b7793f1eb47363c7795/pa/US78299_aed1d06f5f0bc4f063b2b30bb6a4f03e.jpg saved to cache
2026-03-30 11:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a40f39d1-70a9-5fca-80fa-ead077372cf0
2026-03-30 11:24:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3c1410>
2026-03-30 11:24:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a40f39d1-70a9-5fca-80fa-ead077372cf0/a40f39d1-70a9-5fca-80fa-ead077372cf0_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F12%252F6c12f8cb7f219b7793f1eb47363c7795%252Fpa%252FUS78299_f278b463cb422b9197441b63799cb175.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/12/6c12f8cb7f219b7793f1eb47363c7795/pa/US78299_f278b463cb422b9197441b63799cb175.jpg saved to cache
2026-03-30 11:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a40f39d1-70a9-5fca-80fa-ead077372cf0
2026-03-30 11:24:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a385990>
2026-03-30 11:24:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a40f39d1-70a9-5fca-80fa-ead077372cf0/a40f39d1-70a9-5fca-80fa-ead077372cf0_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F12%252F6c12f8cb7f219b7793f1eb47363c7795%252Fpa%252FUS78299_6d85c0384188134cbe7697c94b4a9cd3.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/12/6c12f8cb7f219b7793f1eb47363c7795/pa/US78299_6d85c0384188134cbe7697c94b4a9cd3.jpg saved to cache
2026-03-30 11:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a40f39d1-70a9-5fca-80fa-ead077372cf0
2026-03-30 11:24:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/12/6c12f8cb7f219b7793f1eb47363c7795/pa/US78299_652ac8f67d4dc823a700431109d0b78e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/12/6c12f8cb7f219b7793f1eb47363c7795/pa/US78299_7beb670a796088d939f01c2f9db9f5e3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3ec0d0>
2026-03-30 11:24:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a40f39d1-70a9-5fca-80fa-ead077372cf0/a40f39d1-70a9-5fca-80fa-ead077372cf0_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F12%252F6c12f8cb7f219b7793f1eb47363c7795%252Fpa%252FUS78299_652ac8f67d4dc823a700431109d0b78e.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/12/6c12f8cb7f219b7793f1eb47363c7795/pa/US78299_652ac8f67d4dc823a700431109d0b78e.jpg saved to cache
2026-03-30 11:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a40f39d1-70a9-5fca-80fa-ead077372cf0
2026-03-30 11:24:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3cb3d0>
2026-03-30 11:24:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a40f39d1-70a9-5fca-80fa-ead077372cf0/a40f39d1-70a9-5fca-80fa-ead077372cf0_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F12%252F6c12f8cb7f219b7793f1eb47363c7795%252Fpa%252FUS78299_7beb670a796088d939f01c2f9db9f5e3.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/12/6c12f8cb7f219b7793f1eb47363c7795/pa/US78299_7beb670a796088d939f01c2f9db9f5e3.jpg saved to cache
2026-03-30 11:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a40f39d1-70a9-5fca-80fa-ead077372cf0
2026-03-30 11:24:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a40f39d1-70a9-5fca-80fa-ead077372cf0, skipping ID generation
2026-03-30 11:24:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a40f39d1-70a9-5fca-80fa-ead077372cf0 with scrape type 1
2026-03-30 11:24:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a40f39d1-70a9-5fca-80fa-ead077372cf0 sending to next pipeline
2026-03-30 11:24:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a40f39d1-70a9-5fca-80fa-ead077372cf0, identifier: US78299
2026-03-30 11:24:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a40f39d1-70a9-5fca-80fa-ead077372cf0 with identifier: US78299
2026-03-30 11:24:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a40f39d1-70a9-5fca-80fa-ead077372cf0 with identifier: US78299
2026-03-30 11:24:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a40f39d1-70a9-5fca-80fa-ead077372cf0 with identifier: US78299 to the API
2026-03-30 11:24:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:24:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:24:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6c/12/6c12f8cb7f219b7793f1eb47363c7795/pa/US78299_7beb670a796088d939f01c2f9db9f5e3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 143,
'expiration_date': '2026-03-31T15:58:28Z',
'fuel_type': 'diesel',
'id': 'a40f39d1-70a9-5fca-80fa-ead077372cf0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US78299',
'listing': 'auction',
'location': 'ES, Santa Marta de Tormes',
'make': 'Seat',
'model': 'Exeo',
'odometer': 323393,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a40f39d1-70a9-5fca-80fa-ead077372cf0/a40f39d1-70a9-5fca-80fa-ead077372cf0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98504,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/12/6c12f8cb7f219b7793f1eb47363c7795/pa/US78299_f0098e25496ac811568fac19a026433b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a40f39d1-70a9-5fca-80fa-ead077372cf0/a40f39d1-70a9-5fca-80fa-ead077372cf0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99031,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/12/6c12f8cb7f219b7793f1eb47363c7795/pa/US78299_aed1d06f5f0bc4f063b2b30bb6a4f03e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a40f39d1-70a9-5fca-80fa-ead077372cf0/a40f39d1-70a9-5fca-80fa-ead077372cf0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80793,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/12/6c12f8cb7f219b7793f1eb47363c7795/pa/US78299_7beb670a796088d939f01c2f9db9f5e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a40f39d1-70a9-5fca-80fa-ead077372cf0/a40f39d1-70a9-5fca-80fa-ead077372cf0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59901,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/12/6c12f8cb7f219b7793f1eb47363c7795/pa/US78299_6d85c0384188134cbe7697c94b4a9cd3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a40f39d1-70a9-5fca-80fa-ead077372cf0/a40f39d1-70a9-5fca-80fa-ead077372cf0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82864,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/12/6c12f8cb7f219b7793f1eb47363c7795/pa/US78299_f278b463cb422b9197441b63799cb175.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a40f39d1-70a9-5fca-80fa-ead077372cf0/a40f39d1-70a9-5fca-80fa-ead077372cf0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117740,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/12/6c12f8cb7f219b7793f1eb47363c7795/pa/US78299_652ac8f67d4dc823a700431109d0b78e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-04-18',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Exeo 2.0 TDI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2010}
2026-03-30 11:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US78299%27 HTTP/1.1" 200 None
2026-03-30 11:24:23 [auto1.es] INFO: Saving data for US78299: {'created_time': 1774869863.806022, 'last_price_update_time': 1774869863.806032, 'auction_closing_time': 1774972708.0}
2026-03-30 11:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='US78299') HTTP/1.1" 204 0
2026-03-30 11:24:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AP30441> (referer: https://www.auto1.com/v1/car-details-view/AP30441/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:24:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e679fec-17fe-51e5-a9bc-790935bb7c97 with identifier: AP30441
2026-03-30 11:24:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e679fec-17fe-51e5-a9bc-790935bb7c97 with scrape type 1
2026-03-30 11:24:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9e679fec-17fe-51e5-a9bc-790935bb7c97
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F59%252Fe159553254428b3d16930779d550b30a%252Fpa%252FAP30441_45b5818e8e66f7e895e62080ce66476a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_45b5818e8e66f7e895e62080ce66476a.jpg not downloaded yet
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F59%252Fe159553254428b3d16930779d550b30a%252Fpa%252FAP30441_f9e274ce83070eba5274e86bf32fe143.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_f9e274ce83070eba5274e86bf32fe143.jpg not downloaded yet
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F59%252Fe159553254428b3d16930779d550b30a%252Fpa%252FAP30441_12b0ee80ab956aa5c33afff0c4e7e5a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_12b0ee80ab956aa5c33afff0c4e7e5a0.jpg not downloaded yet
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F59%252Fe159553254428b3d16930779d550b30a%252Fpa%252FAP30441_2273b47633f002709a145a3aa00fb3c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_2273b47633f002709a145a3aa00fb3c7.jpg not downloaded yet
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F59%252Fe159553254428b3d16930779d550b30a%252Fpa%252FAP30441_cb34cf79e971ce9e5a361be5522dddb5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_cb34cf79e971ce9e5a361be5522dddb5.jpg not downloaded yet
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F59%252Fe159553254428b3d16930779d550b30a%252Fpa%252FAP30441_3b0d0b0952ac48e874dcef37e101053b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_3b0d0b0952ac48e874dcef37e101053b.jpg not downloaded yet
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F59%252Fe159553254428b3d16930779d550b30a%252Fpa%252FAP30441_661101899450b5459a788ea48aee6a63.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_661101899450b5459a788ea48aee6a63.jpg not downloaded yet
2026-03-30 11:24:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_f9e274ce83070eba5274e86bf32fe143.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_45b5818e8e66f7e895e62080ce66476a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F59%252Fe159553254428b3d16930779d550b30a%252Fpa%252FAP30441_69ddec092eb0a30fe7c69af233d070bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_69ddec092eb0a30fe7c69af233d070bb.jpg not downloaded yet
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F59%252Fe159553254428b3d16930779d550b30a%252Fpa%252FAP30441_ddba84abadca6f4ead1b9a0a02cb45a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_ddba84abadca6f4ead1b9a0a02cb45a1.jpg not downloaded yet
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F59%252Fe159553254428b3d16930779d550b30a%252Fpa%252FAP30441_f2980c04d7d87edb696e3cd53f12b2e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:24:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_f2980c04d7d87edb696e3cd53f12b2e7.jpg not downloaded yet
2026-03-30 11:24:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_661101899450b5459a788ea48aee6a63.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_3b0d0b0952ac48e874dcef37e101053b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a487dd0>
2026-03-30 11:24:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e679fec-17fe-51e5-a9bc-790935bb7c97/9e679fec-17fe-51e5-a9bc-790935bb7c97_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F59%252Fe159553254428b3d16930779d550b30a%252Fpa%252FAP30441_f9e274ce83070eba5274e86bf32fe143.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_f9e274ce83070eba5274e86bf32fe143.jpg saved to cache
2026-03-30 11:24:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9e679fec-17fe-51e5-a9bc-790935bb7c97
2026-03-30 11:24:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3e8bd0>
2026-03-30 11:24:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e679fec-17fe-51e5-a9bc-790935bb7c97/9e679fec-17fe-51e5-a9bc-790935bb7c97_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F59%252Fe159553254428b3d16930779d550b30a%252Fpa%252FAP30441_45b5818e8e66f7e895e62080ce66476a.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_45b5818e8e66f7e895e62080ce66476a.jpg saved to cache
2026-03-30 11:24:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9e679fec-17fe-51e5-a9bc-790935bb7c97
2026-03-30 11:24:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_12b0ee80ab956aa5c33afff0c4e7e5a0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_f2980c04d7d87edb696e3cd53f12b2e7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_ddba84abadca6f4ead1b9a0a02cb45a1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad50bd0>
2026-03-30 11:24:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e679fec-17fe-51e5-a9bc-790935bb7c97/9e679fec-17fe-51e5-a9bc-790935bb7c97_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F59%252Fe159553254428b3d16930779d550b30a%252Fpa%252FAP30441_661101899450b5459a788ea48aee6a63.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_661101899450b5459a788ea48aee6a63.jpg saved to cache
2026-03-30 11:24:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9e679fec-17fe-51e5-a9bc-790935bb7c97
2026-03-30 11:24:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060fec190>
2026-03-30 11:24:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e679fec-17fe-51e5-a9bc-790935bb7c97/9e679fec-17fe-51e5-a9bc-790935bb7c97_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F59%252Fe159553254428b3d16930779d550b30a%252Fpa%252FAP30441_3b0d0b0952ac48e874dcef37e101053b.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_3b0d0b0952ac48e874dcef37e101053b.jpg saved to cache
2026-03-30 11:24:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9e679fec-17fe-51e5-a9bc-790935bb7c97
2026-03-30 11:24:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_2273b47633f002709a145a3aa00fb3c7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_cb34cf79e971ce9e5a361be5522dddb5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060cffed0>
2026-03-30 11:24:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e679fec-17fe-51e5-a9bc-790935bb7c97/9e679fec-17fe-51e5-a9bc-790935bb7c97_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F59%252Fe159553254428b3d16930779d550b30a%252Fpa%252FAP30441_12b0ee80ab956aa5c33afff0c4e7e5a0.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_12b0ee80ab956aa5c33afff0c4e7e5a0.jpg saved to cache
2026-03-30 11:24:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9e679fec-17fe-51e5-a9bc-790935bb7c97
2026-03-30 11:24:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad416d0>
2026-03-30 11:24:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e679fec-17fe-51e5-a9bc-790935bb7c97/9e679fec-17fe-51e5-a9bc-790935bb7c97_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F59%252Fe159553254428b3d16930779d550b30a%252Fpa%252FAP30441_f2980c04d7d87edb696e3cd53f12b2e7.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_f2980c04d7d87edb696e3cd53f12b2e7.jpg saved to cache
2026-03-30 11:24:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9e679fec-17fe-51e5-a9bc-790935bb7c97
2026-03-30 11:24:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a375050>
2026-03-30 11:24:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e679fec-17fe-51e5-a9bc-790935bb7c97/9e679fec-17fe-51e5-a9bc-790935bb7c97_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F59%252Fe159553254428b3d16930779d550b30a%252Fpa%252FAP30441_ddba84abadca6f4ead1b9a0a02cb45a1.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_ddba84abadca6f4ead1b9a0a02cb45a1.jpg saved to cache
2026-03-30 11:24:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9e679fec-17fe-51e5-a9bc-790935bb7c97
2026-03-30 11:24:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_69ddec092eb0a30fe7c69af233d070bb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:24:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a461d10>
2026-03-30 11:24:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e679fec-17fe-51e5-a9bc-790935bb7c97/9e679fec-17fe-51e5-a9bc-790935bb7c97_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F59%252Fe159553254428b3d16930779d550b30a%252Fpa%252FAP30441_2273b47633f002709a145a3aa00fb3c7.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_2273b47633f002709a145a3aa00fb3c7.jpg saved to cache
2026-03-30 11:24:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9e679fec-17fe-51e5-a9bc-790935bb7c97
2026-03-30 11:24:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3c4450>
2026-03-30 11:24:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e679fec-17fe-51e5-a9bc-790935bb7c97/9e679fec-17fe-51e5-a9bc-790935bb7c97_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:24:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F59%252Fe159553254428b3d16930779d550b30a%252Fpa%252FAP30441_cb34cf79e971ce9e5a361be5522dddb5.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_cb34cf79e971ce9e5a361be5522dddb5.jpg saved to cache
2026-03-30 11:24:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9e679fec-17fe-51e5-a9bc-790935bb7c97
2026-03-30 11:24:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:24:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4d7d10>
2026-03-30 11:24:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:24:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:24:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:24:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e679fec-17fe-51e5-a9bc-790935bb7c97/9e679fec-17fe-51e5-a9bc-790935bb7c97_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:24:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F59%252Fe159553254428b3d16930779d550b30a%252Fpa%252FAP30441_69ddec092eb0a30fe7c69af233d070bb.jpg') HTTP/1.1" 204 0
2026-03-30 11:24:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_69ddec092eb0a30fe7c69af233d070bb.jpg saved to cache
2026-03-30 11:24:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9e679fec-17fe-51e5-a9bc-790935bb7c97
2026-03-30 11:24:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9e679fec-17fe-51e5-a9bc-790935bb7c97, skipping ID generation
2026-03-30 11:24:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e679fec-17fe-51e5-a9bc-790935bb7c97 with scrape type 1
2026-03-30 11:24:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9e679fec-17fe-51e5-a9bc-790935bb7c97 sending to next pipeline
2026-03-30 11:24:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9e679fec-17fe-51e5-a9bc-790935bb7c97, identifier: AP30441
2026-03-30 11:24:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9e679fec-17fe-51e5-a9bc-790935bb7c97 with identifier: AP30441
2026-03-30 11:24:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9e679fec-17fe-51e5-a9bc-790935bb7c97 with identifier: AP30441
2026-03-30 11:24:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9e679fec-17fe-51e5-a9bc-790935bb7c97 with identifier: AP30441 to the API
2026-03-30 11:24:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:24:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:24:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_69ddec092eb0a30fe7c69af233d070bb.jpg>
{'auction_title': '',
'c_o_2_emission_value': 127,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:59:33Z',
'fuel_type': 'diesel',
'id': '9e679fec-17fe-51e5-a9bc-790935bb7c97',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP30441',
'listing': 'auction',
'location': 'ES, Córdoba',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 236031,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e679fec-17fe-51e5-a9bc-790935bb7c97/9e679fec-17fe-51e5-a9bc-790935bb7c97_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59977,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_45b5818e8e66f7e895e62080ce66476a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e679fec-17fe-51e5-a9bc-790935bb7c97/9e679fec-17fe-51e5-a9bc-790935bb7c97_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59812,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_f9e274ce83070eba5274e86bf32fe143.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e679fec-17fe-51e5-a9bc-790935bb7c97/9e679fec-17fe-51e5-a9bc-790935bb7c97_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54164,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_12b0ee80ab956aa5c33afff0c4e7e5a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e679fec-17fe-51e5-a9bc-790935bb7c97/9e679fec-17fe-51e5-a9bc-790935bb7c97_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54756,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_2273b47633f002709a145a3aa00fb3c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e679fec-17fe-51e5-a9bc-790935bb7c97/9e679fec-17fe-51e5-a9bc-790935bb7c97_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51349,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_cb34cf79e971ce9e5a361be5522dddb5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e679fec-17fe-51e5-a9bc-790935bb7c97/9e679fec-17fe-51e5-a9bc-790935bb7c97_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52004,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_3b0d0b0952ac48e874dcef37e101053b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e679fec-17fe-51e5-a9bc-790935bb7c97/9e679fec-17fe-51e5-a9bc-790935bb7c97_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48269,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_661101899450b5459a788ea48aee6a63.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e679fec-17fe-51e5-a9bc-790935bb7c97/9e679fec-17fe-51e5-a9bc-790935bb7c97_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52696,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_69ddec092eb0a30fe7c69af233d070bb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e679fec-17fe-51e5-a9bc-790935bb7c97/9e679fec-17fe-51e5-a9bc-790935bb7c97_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51552,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_ddba84abadca6f4ead1b9a0a02cb45a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e679fec-17fe-51e5-a9bc-790935bb7c97/9e679fec-17fe-51e5-a9bc-790935bb7c97_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52677,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/59/e159553254428b3d16930779d550b30a/pa/AP30441_f2980c04d7d87edb696e3cd53f12b2e7.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-04-28',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Business',
'transmission': 'manual',
'trim': 'Business',
'year': 2022}
2026-03-30 11:24:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AP30441%27 HTTP/1.1" 200 None
2026-03-30 11:24:41 [auto1.es] INFO: Saving data for AP30441: {'created_time': 1774869881.496148, 'last_price_update_time': 1774869881.49616, 'auction_closing_time': 1774972773.0}
2026-03-30 11:24:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AP30441') HTTP/1.1" 204 0
2026-03-30 11:24:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YZ56503/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:24:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:24:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:44 [auto1.es] INFO: Channel: 24h | Page: 9 | totalHits: 2232 | hits on page: 40
2026-03-30 11:24:44 [auto1.es] INFO: Found listing with ID: KU70052
2026-03-30 11:24:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KU70052%27 HTTP/1.1" 200 None
2026-03-30 11:24:44 [auto1.es] INFO: Scrape type for KU70052: 0
2026-03-30 11:24:44 [auto1.es] INFO: Found listing with ID: VL95678
2026-03-30 11:24:44 [auto1.es] INFO: Found listing with ID: DC03614
2026-03-30 11:24:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DC03614%27 HTTP/1.1" 200 None
2026-03-30 11:24:44 [auto1.es] INFO: Scrape type for DC03614: 0
2026-03-30 11:24:44 [auto1.es] INFO: Found listing with ID: DJ81292
2026-03-30 11:24:44 [auto1.es] INFO: Found listing with ID: ZK75464
2026-03-30 11:24:44 [auto1.es] INFO: Found listing with ID: TD39535
2026-03-30 11:24:44 [auto1.es] INFO: Found listing with ID: ZR84162
2026-03-30 11:24:44 [auto1.es] INFO: Found listing with ID: TR12651
2026-03-30 11:24:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TR12651%27 HTTP/1.1" 200 None
2026-03-30 11:24:44 [auto1.es] INFO: Scrape type for TR12651: 2
2026-03-30 11:24:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8c9ac70-d34b-5a45-9592-e6e4983f83a5 with identifier: TR12651
2026-03-30 11:24:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8c9ac70-d34b-5a45-9592-e6e4983f83a5 with scrape type 2
2026-03-30 11:24:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8c9ac70-d34b-5a45-9592-e6e4983f83a5 with scrape type 2
2026-03-30 11:24:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e8c9ac70-d34b-5a45-9592-e6e4983f83a5, identifier: TR12651
2026-03-30 11:24:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e8c9ac70-d34b-5a45-9592-e6e4983f83a5 with identifier: TR12651
2026-03-30 11:24:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e8c9ac70-d34b-5a45-9592-e6e4983f83a5 with identifier: TR12651
2026-03-30 11:24:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e8c9ac70-d34b-5a45-9592-e6e4983f83a5 with identifier: TR12651 to the API
2026-03-30 11:24:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:24:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:39:52Z',
'fuel_type': 'diesel',
'id': 'e8c9ac70-d34b-5a45-9592-e6e4983f83a5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR12651',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 158373,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-02-10',
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2011}
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TR12651%27 HTTP/1.1" 200 None
2026-03-30 11:24:45 [auto1.es] INFO: Saving data for TR12651: {'auction_closing_time': 1774971592.0, 'created_time': 1774555823.868355, 'last_price_update_time': 1774869885.187676}
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TR12651') HTTP/1.1" 204 0
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: JH23969
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JH23969%27 HTTP/1.1" 200 None
2026-03-30 11:24:45 [auto1.es] INFO: Scrape type for JH23969: 2
2026-03-30 11:24:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bf9bc8d-490a-5267-b43e-7aead072ce8f with identifier: JH23969
2026-03-30 11:24:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bf9bc8d-490a-5267-b43e-7aead072ce8f with scrape type 2
2026-03-30 11:24:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bf9bc8d-490a-5267-b43e-7aead072ce8f with scrape type 2
2026-03-30 11:24:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7bf9bc8d-490a-5267-b43e-7aead072ce8f, identifier: JH23969
2026-03-30 11:24:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7bf9bc8d-490a-5267-b43e-7aead072ce8f with identifier: JH23969
2026-03-30 11:24:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7bf9bc8d-490a-5267-b43e-7aead072ce8f with identifier: JH23969
2026-03-30 11:24:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7bf9bc8d-490a-5267-b43e-7aead072ce8f with identifier: JH23969 to the API
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:24:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:21:18Z',
'fuel_type': 'diesel',
'id': '7bf9bc8d-490a-5267-b43e-7aead072ce8f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH23969',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia',
'odometer': 176568,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-08',
'seller_name': None,
'title': 'Opel Insignia 2.0 CDTI Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2013}
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JH23969%27 HTTP/1.1" 200 None
2026-03-30 11:24:45 [auto1.es] INFO: Saving data for JH23969: {'auction_closing_time': 1774970478.0, 'created_time': 1774620351.921663, 'last_price_update_time': 1774869885.681225}
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JH23969') HTTP/1.1" 204 0
2026-03-30 11:24:45 [auto1.es] INFO: Found listing with ID: SN94812
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SN94812%27 HTTP/1.1" 200 None
2026-03-30 11:24:45 [auto1.es] INFO: Scrape type for SN94812: 2
2026-03-30 11:24:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ddaa115-ba71-5632-8d8b-2d6560fefb53 with identifier: SN94812
2026-03-30 11:24:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ddaa115-ba71-5632-8d8b-2d6560fefb53 with scrape type 2
2026-03-30 11:24:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ddaa115-ba71-5632-8d8b-2d6560fefb53 with scrape type 2
2026-03-30 11:24:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5ddaa115-ba71-5632-8d8b-2d6560fefb53, identifier: SN94812
2026-03-30 11:24:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5ddaa115-ba71-5632-8d8b-2d6560fefb53 with identifier: SN94812
2026-03-30 11:24:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5ddaa115-ba71-5632-8d8b-2d6560fefb53 with identifier: SN94812
2026-03-30 11:24:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5ddaa115-ba71-5632-8d8b-2d6560fefb53 with identifier: SN94812 to the API
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:24:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:24:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 163,
'expiration_date': '2026-03-31T15:51:18Z',
'fuel_type': 'diesel',
'id': '5ddaa115-ba71-5632-8d8b-2d6560fefb53',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN94812',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 273335,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-07-14',
'seller_name': None,
'title': 'BMW 3er 320d',
'transmission': 'manual',
'trim': '',
'year': 2005}
2026-03-30 11:24:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SN94812%27 HTTP/1.1" 200 None
2026-03-30 11:24:46 [auto1.es] INFO: Saving data for SN94812: {'auction_closing_time': 1774972278.0, 'created_time': 1774436843.917388, 'last_price_update_time': 1774869886.096251}
2026-03-30 11:24:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SN94812') HTTP/1.1" 204 0
2026-03-30 11:24:46 [auto1.es] INFO: Found listing with ID: LV69921
2026-03-30 11:24:46 [auto1.es] INFO: Found listing with ID: VH11492
2026-03-30 11:24:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VH11492%27 HTTP/1.1" 200 None
2026-03-30 11:24:46 [auto1.es] INFO: Scrape type for VH11492: 2
2026-03-30 11:24:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3dba0323-e9ff-5a4b-a990-b16cf4612967 with identifier: VH11492
2026-03-30 11:24:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3dba0323-e9ff-5a4b-a990-b16cf4612967 with scrape type 2
2026-03-30 11:24:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3dba0323-e9ff-5a4b-a990-b16cf4612967 with scrape type 2
2026-03-30 11:24:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3dba0323-e9ff-5a4b-a990-b16cf4612967, identifier: VH11492
2026-03-30 11:24:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3dba0323-e9ff-5a4b-a990-b16cf4612967 with identifier: VH11492
2026-03-30 11:24:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3dba0323-e9ff-5a4b-a990-b16cf4612967 with identifier: VH11492
2026-03-30 11:24:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3dba0323-e9ff-5a4b-a990-b16cf4612967 with identifier: VH11492 to the API
2026-03-30 11:24:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:24:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:24:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 82,
'expiration_date': '2026-03-31T15:07:19Z',
'fuel_type': 'petrol',
'id': '3dba0323-e9ff-5a4b-a990-b16cf4612967',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH11492',
'listing': 'auction',
'make': 'Citroen',
'model': 'C-Elysée',
'odometer': 75430,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-02-10',
'seller_name': None,
'title': 'Citroen C-Elysée 1.2 VTi Exclusive',
'transmission': 'manual',
'trim': 'Exclusive',
'year': 2016}
2026-03-30 11:24:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VH11492%27 HTTP/1.1" 200 None
2026-03-30 11:24:46 [auto1.es] INFO: Saving data for VH11492: {'auction_closing_time': 1774969639.0, 'created_time': 1774436839.359746, 'last_price_update_time': 1774869886.544275}
2026-03-30 11:24:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VH11492') HTTP/1.1" 204 0
2026-03-30 11:24:46 [auto1.es] INFO: Found listing with ID: RK33204
2026-03-30 11:24:46 [auto1.es] INFO: Found listing with ID: MF04433
2026-03-30 11:24:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MF04433%27 HTTP/1.1" 200 None
2026-03-30 11:24:46 [auto1.es] INFO: Scrape type for MF04433: 2
2026-03-30 11:24:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2a5cd2b-0591-5b75-ad14-801ff31ec982 with identifier: MF04433
2026-03-30 11:24:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2a5cd2b-0591-5b75-ad14-801ff31ec982 with scrape type 2
2026-03-30 11:24:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2a5cd2b-0591-5b75-ad14-801ff31ec982 with scrape type 2
2026-03-30 11:24:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b2a5cd2b-0591-5b75-ad14-801ff31ec982, identifier: MF04433
2026-03-30 11:24:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b2a5cd2b-0591-5b75-ad14-801ff31ec982 with identifier: MF04433
2026-03-30 11:24:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b2a5cd2b-0591-5b75-ad14-801ff31ec982 with identifier: MF04433
2026-03-30 11:24:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b2a5cd2b-0591-5b75-ad14-801ff31ec982 with identifier: MF04433 to the API
2026-03-30 11:24:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:24:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:24:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:00:56Z',
'fuel_type': 'diesel',
'id': 'b2a5cd2b-0591-5b75-ad14-801ff31ec982',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF04433',
'listing': 'auction',
'make': 'Kia',
'model': 'Venga',
'odometer': 210806,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-08',
'seller_name': None,
'title': 'Kia Venga 1.6 CRDi Concept',
'transmission': 'manual',
'trim': 'Concept',
'year': 2014}
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MF04433%27 HTTP/1.1" 200 None
2026-03-30 11:24:47 [auto1.es] INFO: Saving data for MF04433: {'auction_closing_time': 1774969256.0, 'created_time': 1773131037.837134, 'last_price_update_time': 1774869887.103729}
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MF04433') HTTP/1.1" 204 0
2026-03-30 11:24:47 [auto1.es] INFO: Found listing with ID: CW24130
2026-03-30 11:24:47 [auto1.es] INFO: Found listing with ID: YG81758
2026-03-30 11:24:47 [auto1.es] INFO: Found listing with ID: PV35004
2026-03-30 11:24:47 [auto1.es] INFO: Found listing with ID: SB83788
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SB83788%27 HTTP/1.1" 200 None
2026-03-30 11:24:47 [auto1.es] INFO: Scrape type for SB83788: 1
2026-03-30 11:24:47 [auto1.es] INFO: Found listing with ID: NW30144
2026-03-30 11:24:47 [auto1.es] INFO: Found listing with ID: UT90004
2026-03-30 11:24:47 [auto1.es] INFO: Found listing with ID: NE81448
2026-03-30 11:24:47 [auto1.es] INFO: Found listing with ID: BK85695
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK85695%27 HTTP/1.1" 200 None
2026-03-30 11:24:47 [auto1.es] INFO: Scrape type for BK85695: 1
2026-03-30 11:24:47 [auto1.es] INFO: Found listing with ID: GZ30272
2026-03-30 11:24:47 [auto1.es] INFO: Found listing with ID: NF79265
2026-03-30 11:24:47 [auto1.es] INFO: Found listing with ID: RJ04030
2026-03-30 11:24:47 [auto1.es] INFO: Found listing with ID: PG52964
2026-03-30 11:24:47 [auto1.es] INFO: Found listing with ID: YM64147
2026-03-30 11:24:47 [auto1.es] INFO: Found listing with ID: XA84962
2026-03-30 11:24:47 [auto1.es] INFO: Found listing with ID: XX24085
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XX24085%27 HTTP/1.1" 200 None
2026-03-30 11:24:47 [auto1.es] INFO: Scrape type for XX24085: 1
2026-03-30 11:24:47 [auto1.es] INFO: Found listing with ID: BV86161
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BV86161%27 HTTP/1.1" 200 None
2026-03-30 11:24:47 [auto1.es] INFO: Scrape type for BV86161: 1
2026-03-30 11:24:47 [auto1.es] INFO: Found listing with ID: WX23682
2026-03-30 11:24:47 [auto1.es] INFO: Found listing with ID: RN47557
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RN47557%27 HTTP/1.1" 200 None
2026-03-30 11:24:47 [auto1.es] INFO: Scrape type for RN47557: 1
2026-03-30 11:24:47 [auto1.es] INFO: Found listing with ID: WM40400
2026-03-30 11:24:47 [auto1.es] INFO: Found listing with ID: TU76767
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TU76767%27 HTTP/1.1" 200 None
2026-03-30 11:24:47 [auto1.es] INFO: Scrape type for TU76767: 2
2026-03-30 11:24:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa17a640-6bac-5b32-8c03-19dc1973a1ed with identifier: TU76767
2026-03-30 11:24:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa17a640-6bac-5b32-8c03-19dc1973a1ed with scrape type 2
2026-03-30 11:24:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa17a640-6bac-5b32-8c03-19dc1973a1ed with scrape type 2
2026-03-30 11:24:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fa17a640-6bac-5b32-8c03-19dc1973a1ed, identifier: TU76767
2026-03-30 11:24:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fa17a640-6bac-5b32-8c03-19dc1973a1ed with identifier: TU76767
2026-03-30 11:24:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fa17a640-6bac-5b32-8c03-19dc1973a1ed with identifier: TU76767
2026-03-30 11:24:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fa17a640-6bac-5b32-8c03-19dc1973a1ed with identifier: TU76767 to the API
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:24:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 252,
'expiration_date': '2026-03-31T15:23:04Z',
'fuel_type': 'hybrid',
'id': 'fa17a640-6bac-5b32-8c03-19dc1973a1ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU76767',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 129536,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-28',
'seller_name': None,
'title': 'BMW 5er 530e M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2020}
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TU76767%27 HTTP/1.1" 200 None
2026-03-30 11:24:47 [auto1.es] INFO: Saving data for TU76767: {'auction_closing_time': 1774970584.0, 'created_time': 1774296650.37029, 'last_price_update_time': 1774869887.69068}
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TU76767') HTTP/1.1" 204 0
2026-03-30 11:24:47 [auto1.es] INFO: Found listing with ID: RK47874
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK47874%27 HTTP/1.1" 200 None
2026-03-30 11:24:47 [auto1.es] INFO: Scrape type for RK47874: 1
2026-03-30 11:24:47 [auto1.es] INFO: Found listing with ID: LA75479
2026-03-30 11:24:47 [auto1.es] INFO: Found listing with ID: UX44517
2026-03-30 11:24:47 [auto1.es] INFO: Found listing with ID: UG86344
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG86344%27 HTTP/1.1" 200 None
2026-03-30 11:24:47 [auto1.es] INFO: Scrape type for UG86344: 1
2026-03-30 11:24:47 [auto1.es] INFO: Found listing with ID: YK20837
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YK20837%27 HTTP/1.1" 200 None
2026-03-30 11:24:47 [auto1.es] INFO: Scrape type for YK20837: 2
2026-03-30 11:24:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a059210-210f-569d-a9d0-e99192316ccc with identifier: YK20837
2026-03-30 11:24:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a059210-210f-569d-a9d0-e99192316ccc with scrape type 2
2026-03-30 11:24:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a059210-210f-569d-a9d0-e99192316ccc with scrape type 2
2026-03-30 11:24:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6a059210-210f-569d-a9d0-e99192316ccc, identifier: YK20837
2026-03-30 11:24:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6a059210-210f-569d-a9d0-e99192316ccc with identifier: YK20837
2026-03-30 11:24:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6a059210-210f-569d-a9d0-e99192316ccc with identifier: YK20837
2026-03-30 11:24:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6a059210-210f-569d-a9d0-e99192316ccc with identifier: YK20837 to the API
2026-03-30 11:24:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:24:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:24:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-31T15:32:16Z',
'fuel_type': 'diesel',
'id': '6a059210-210f-569d-a9d0-e99192316ccc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK20837',
'listing': 'auction',
'make': 'BMW',
'model': 'X5',
'odometer': 186447,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-27',
'seller_name': None,
'title': 'BMW X5 xDrive 30d',
'transmission': 'automatic',
'trim': '',
'year': 2018}
2026-03-30 11:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YK20837%27 HTTP/1.1" 200 None
2026-03-30 11:24:48 [auto1.es] INFO: Saving data for YK20837: {'auction_closing_time': 1774971136.0, 'created_time': 1773400003.178698, 'last_price_update_time': 1774869888.309206}
2026-03-30 11:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YK20837') HTTP/1.1" 204 0
2026-03-30 11:24:48 [auto1.es] INFO: Found listing with ID: BA34469
2026-03-30 11:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BA34469%27 HTTP/1.1" 200 None
2026-03-30 11:24:48 [auto1.es] INFO: Scrape type for BA34469: 2
2026-03-30 11:24:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61d5ff49-c7f6-5013-819d-e29a193c9b57 with identifier: BA34469
2026-03-30 11:24:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61d5ff49-c7f6-5013-819d-e29a193c9b57 with scrape type 2
2026-03-30 11:24:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61d5ff49-c7f6-5013-819d-e29a193c9b57 with scrape type 2
2026-03-30 11:24:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 61d5ff49-c7f6-5013-819d-e29a193c9b57, identifier: BA34469
2026-03-30 11:24:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 61d5ff49-c7f6-5013-819d-e29a193c9b57 with identifier: BA34469
2026-03-30 11:24:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 61d5ff49-c7f6-5013-819d-e29a193c9b57 with identifier: BA34469
2026-03-30 11:24:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 61d5ff49-c7f6-5013-819d-e29a193c9b57 with identifier: BA34469 to the API
2026-03-30 11:24:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:24:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:24:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:47:25Z',
'fuel_type': 'petrol',
'id': '61d5ff49-c7f6-5013-819d-e29a193c9b57',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA34469',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 96796,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-16',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 TSI Advance',
'transmission': 'manual',
'trim': 'Advance',
'year': 2012}
2026-03-30 11:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BA34469%27 HTTP/1.1" 200 None
2026-03-30 11:24:48 [auto1.es] INFO: Saving data for BA34469: {'auction_closing_time': 1774972045.0, 'created_time': 1773777946.810499, 'last_price_update_time': 1774869888.728927}
2026-03-30 11:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BA34469') HTTP/1.1" 204 0
2026-03-30 11:25:04 [scrapy.extensions.logstats] INFO: Crawled 130 pages (at 7 pages/min), scraped 151 items (at 11 items/min)
2026-03-30 11:25:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 161MiB
2026-03-30 11:25:06 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.551(s), this was the 1st time calling it.
2026-03-30 11:25:06 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.028833627372425 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:25:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:25:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SA67244/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ST19382> (referer: https://www.auto1.com/v1/car-details-view/ST19382/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5390cfd1-d10b-5890-ad94-6b5021f35dbe with identifier: ST19382
2026-03-30 11:25:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5390cfd1-d10b-5890-ad94-6b5021f35dbe with scrape type 1
2026-03-30 11:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 5390cfd1-d10b-5890-ad94-6b5021f35dbe
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fa6%252F55a6c36c5f5a3e11b3ea84696b0763c0%252Fpa%252FST19382_831a0956da010e24bc28a351db880fdb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/a6/55a6c36c5f5a3e11b3ea84696b0763c0/pa/ST19382_831a0956da010e24bc28a351db880fdb.jpg not downloaded yet
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fa6%252F55a6c36c5f5a3e11b3ea84696b0763c0%252Fpa%252FST19382_b7111836166da8a96b8daa9711ec9aa8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/a6/55a6c36c5f5a3e11b3ea84696b0763c0/pa/ST19382_b7111836166da8a96b8daa9711ec9aa8.jpg not downloaded yet
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fa6%252F55a6c36c5f5a3e11b3ea84696b0763c0%252Fpa%252FST19382_df81816afb614a5fd551a46983904559.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/a6/55a6c36c5f5a3e11b3ea84696b0763c0/pa/ST19382_df81816afb614a5fd551a46983904559.jpg not downloaded yet
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fa6%252F55a6c36c5f5a3e11b3ea84696b0763c0%252Fpa%252FST19382_18e250a4900ccab509a3696460e0cebd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/a6/55a6c36c5f5a3e11b3ea84696b0763c0/pa/ST19382_18e250a4900ccab509a3696460e0cebd.jpg not downloaded yet
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fa6%252F55a6c36c5f5a3e11b3ea84696b0763c0%252Fpa%252FST19382_910fc9b687e5c07d2de3a9edbe38be47.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/a6/55a6c36c5f5a3e11b3ea84696b0763c0/pa/ST19382_910fc9b687e5c07d2de3a9edbe38be47.jpg not downloaded yet
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fa6%252F55a6c36c5f5a3e11b3ea84696b0763c0%252Fpa%252FST19382_2931f16ea79db10a7808348268dbccec.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/a6/55a6c36c5f5a3e11b3ea84696b0763c0/pa/ST19382_2931f16ea79db10a7808348268dbccec.jpg not downloaded yet
2026-03-30 11:25:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VL80227> (referer: https://www.auto1.com/v1/car-details-view/VL80227/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d373c71a-7f16-51b0-a08d-2d6b89fa466a with identifier: VL80227
2026-03-30 11:25:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d373c71a-7f16-51b0-a08d-2d6b89fa466a with scrape type 1
2026-03-30 11:25:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d373c71a-7f16-51b0-a08d-2d6b89fa466a
2026-03-30 11:25:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F93%252F2193411aeae17df7be69872e43c40dad%252Fpa%252FVL80227_d0d91c5ca688e338b8f1f96153597fb8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_d0d91c5ca688e338b8f1f96153597fb8.jpg not downloaded yet
2026-03-30 11:25:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F93%252F2193411aeae17df7be69872e43c40dad%252Fpa%252FVL80227_097d670887052316464329980d2814b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_097d670887052316464329980d2814b8.jpg not downloaded yet
2026-03-30 11:25:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F93%252F2193411aeae17df7be69872e43c40dad%252Fpa%252FVL80227_c3cf3393d0da9bc4b050e9e6fdfc2b1f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_c3cf3393d0da9bc4b050e9e6fdfc2b1f.jpg not downloaded yet
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F93%252F2193411aeae17df7be69872e43c40dad%252Fpa%252FVL80227_f2e732c2357b197452c54646298a3a22.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_f2e732c2357b197452c54646298a3a22.jpg not downloaded yet
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F93%252F2193411aeae17df7be69872e43c40dad%252Fpa%252FVL80227_465f89df6b5f3f082b185f381d0937cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_465f89df6b5f3f082b185f381d0937cf.jpg not downloaded yet
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F93%252F2193411aeae17df7be69872e43c40dad%252Fpa%252FVL80227_cd0a849473a051f0f8c92a88e49c979b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_cd0a849473a051f0f8c92a88e49c979b.jpg not downloaded yet
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F93%252F2193411aeae17df7be69872e43c40dad%252Fpa%252FVL80227_5c2128c1e5ab7280cb276064818e2cb8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_5c2128c1e5ab7280cb276064818e2cb8.jpg not downloaded yet
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F93%252F2193411aeae17df7be69872e43c40dad%252Fpa%252FVL80227_dafb72acc84e4c470afc38293775ba91.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_dafb72acc84e4c470afc38293775ba91.jpg not downloaded yet
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F93%252F2193411aeae17df7be69872e43c40dad%252Fpa%252FVL80227_b33812ab58de5a6e3d6f9ec5f3550117.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_b33812ab58de5a6e3d6f9ec5f3550117.jpg not downloaded yet
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F93%252F2193411aeae17df7be69872e43c40dad%252Fpa%252FVL80227_cb09951b431b1ba477c5cf813dd49c74.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_cb09951b431b1ba477c5cf813dd49c74.jpg not downloaded yet
2026-03-30 11:25:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/a6/55a6c36c5f5a3e11b3ea84696b0763c0/pa/ST19382_2931f16ea79db10a7808348268dbccec.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_cb09951b431b1ba477c5cf813dd49c74.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_b33812ab58de5a6e3d6f9ec5f3550117.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_dafb72acc84e4c470afc38293775ba91.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060fefd50>
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5390cfd1-d10b-5890-ad94-6b5021f35dbe/5390cfd1-d10b-5890-ad94-6b5021f35dbe_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fa6%252F55a6c36c5f5a3e11b3ea84696b0763c0%252Fpa%252FST19382_2931f16ea79db10a7808348268dbccec.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/a6/55a6c36c5f5a3e11b3ea84696b0763c0/pa/ST19382_2931f16ea79db10a7808348268dbccec.jpg saved to cache
2026-03-30 11:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5390cfd1-d10b-5890-ad94-6b5021f35dbe
2026-03-30 11:25:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_5c2128c1e5ab7280cb276064818e2cb8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060d04e50>
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d373c71a-7f16-51b0-a08d-2d6b89fa466a/d373c71a-7f16-51b0-a08d-2d6b89fa466a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F93%252F2193411aeae17df7be69872e43c40dad%252Fpa%252FVL80227_cb09951b431b1ba477c5cf813dd49c74.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_cb09951b431b1ba477c5cf813dd49c74.jpg saved to cache
2026-03-30 11:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d373c71a-7f16-51b0-a08d-2d6b89fa466a
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060fb1990>
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d373c71a-7f16-51b0-a08d-2d6b89fa466a/d373c71a-7f16-51b0-a08d-2d6b89fa466a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F93%252F2193411aeae17df7be69872e43c40dad%252Fpa%252FVL80227_b33812ab58de5a6e3d6f9ec5f3550117.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_b33812ab58de5a6e3d6f9ec5f3550117.jpg saved to cache
2026-03-30 11:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d373c71a-7f16-51b0-a08d-2d6b89fa466a
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4a5ed0>
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d373c71a-7f16-51b0-a08d-2d6b89fa466a/d373c71a-7f16-51b0-a08d-2d6b89fa466a_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F93%252F2193411aeae17df7be69872e43c40dad%252Fpa%252FVL80227_dafb72acc84e4c470afc38293775ba91.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_dafb72acc84e4c470afc38293775ba91.jpg saved to cache
2026-03-30 11:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d373c71a-7f16-51b0-a08d-2d6b89fa466a
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad78090>
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d373c71a-7f16-51b0-a08d-2d6b89fa466a/d373c71a-7f16-51b0-a08d-2d6b89fa466a_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F93%252F2193411aeae17df7be69872e43c40dad%252Fpa%252FVL80227_5c2128c1e5ab7280cb276064818e2cb8.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_5c2128c1e5ab7280cb276064818e2cb8.jpg saved to cache
2026-03-30 11:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d373c71a-7f16-51b0-a08d-2d6b89fa466a
2026-03-30 11:25:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_cd0a849473a051f0f8c92a88e49c979b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_465f89df6b5f3f082b185f381d0937cf.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_f2e732c2357b197452c54646298a3a22.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060ff2690>
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d373c71a-7f16-51b0-a08d-2d6b89fa466a/d373c71a-7f16-51b0-a08d-2d6b89fa466a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F93%252F2193411aeae17df7be69872e43c40dad%252Fpa%252FVL80227_cd0a849473a051f0f8c92a88e49c979b.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_cd0a849473a051f0f8c92a88e49c979b.jpg saved to cache
2026-03-30 11:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d373c71a-7f16-51b0-a08d-2d6b89fa466a
2026-03-30 11:25:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_c3cf3393d0da9bc4b050e9e6fdfc2b1f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a35d6d0>
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d373c71a-7f16-51b0-a08d-2d6b89fa466a/d373c71a-7f16-51b0-a08d-2d6b89fa466a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F93%252F2193411aeae17df7be69872e43c40dad%252Fpa%252FVL80227_465f89df6b5f3f082b185f381d0937cf.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_465f89df6b5f3f082b185f381d0937cf.jpg saved to cache
2026-03-30 11:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d373c71a-7f16-51b0-a08d-2d6b89fa466a
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4a7210>
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d373c71a-7f16-51b0-a08d-2d6b89fa466a/d373c71a-7f16-51b0-a08d-2d6b89fa466a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F93%252F2193411aeae17df7be69872e43c40dad%252Fpa%252FVL80227_f2e732c2357b197452c54646298a3a22.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_f2e732c2357b197452c54646298a3a22.jpg saved to cache
2026-03-30 11:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d373c71a-7f16-51b0-a08d-2d6b89fa466a
2026-03-30 11:25:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_097d670887052316464329980d2814b8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad88f10>
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d373c71a-7f16-51b0-a08d-2d6b89fa466a/d373c71a-7f16-51b0-a08d-2d6b89fa466a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F93%252F2193411aeae17df7be69872e43c40dad%252Fpa%252FVL80227_c3cf3393d0da9bc4b050e9e6fdfc2b1f.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_c3cf3393d0da9bc4b050e9e6fdfc2b1f.jpg saved to cache
2026-03-30 11:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d373c71a-7f16-51b0-a08d-2d6b89fa466a
2026-03-30 11:25:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_d0d91c5ca688e338b8f1f96153597fb8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4b7850>
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d373c71a-7f16-51b0-a08d-2d6b89fa466a/d373c71a-7f16-51b0-a08d-2d6b89fa466a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F93%252F2193411aeae17df7be69872e43c40dad%252Fpa%252FVL80227_097d670887052316464329980d2814b8.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_097d670887052316464329980d2814b8.jpg saved to cache
2026-03-30 11:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d373c71a-7f16-51b0-a08d-2d6b89fa466a
2026-03-30 11:25:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a385fd0>
2026-03-30 11:25:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d373c71a-7f16-51b0-a08d-2d6b89fa466a/d373c71a-7f16-51b0-a08d-2d6b89fa466a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F93%252F2193411aeae17df7be69872e43c40dad%252Fpa%252FVL80227_d0d91c5ca688e338b8f1f96153597fb8.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_d0d91c5ca688e338b8f1f96153597fb8.jpg saved to cache
2026-03-30 11:25:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d373c71a-7f16-51b0-a08d-2d6b89fa466a
2026-03-30 11:25:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d373c71a-7f16-51b0-a08d-2d6b89fa466a, skipping ID generation
2026-03-30 11:25:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d373c71a-7f16-51b0-a08d-2d6b89fa466a with scrape type 1
2026-03-30 11:25:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d373c71a-7f16-51b0-a08d-2d6b89fa466a sending to next pipeline
2026-03-30 11:25:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d373c71a-7f16-51b0-a08d-2d6b89fa466a, identifier: VL80227
2026-03-30 11:25:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d373c71a-7f16-51b0-a08d-2d6b89fa466a with identifier: VL80227
2026-03-30 11:25:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d373c71a-7f16-51b0-a08d-2d6b89fa466a with identifier: VL80227
2026-03-30 11:25:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d373c71a-7f16-51b0-a08d-2d6b89fa466a with identifier: VL80227 to the API
2026-03-30 11:25:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:25:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:25:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_d0d91c5ca688e338b8f1f96153597fb8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 156,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.8L',
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:33:36Z',
'fuel_type': 'petrol',
'id': 'd373c71a-7f16-51b0-a08d-2d6b89fa466a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL80227',
'listing': 'auction',
'location': 'ES, Sevilla',
'make': 'Honda',
'model': 'Civic',
'odometer': 97336,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d373c71a-7f16-51b0-a08d-2d6b89fa466a/d373c71a-7f16-51b0-a08d-2d6b89fa466a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74361,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_d0d91c5ca688e338b8f1f96153597fb8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d373c71a-7f16-51b0-a08d-2d6b89fa466a/d373c71a-7f16-51b0-a08d-2d6b89fa466a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72182,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_097d670887052316464329980d2814b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d373c71a-7f16-51b0-a08d-2d6b89fa466a/d373c71a-7f16-51b0-a08d-2d6b89fa466a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70386,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_c3cf3393d0da9bc4b050e9e6fdfc2b1f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d373c71a-7f16-51b0-a08d-2d6b89fa466a/d373c71a-7f16-51b0-a08d-2d6b89fa466a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67686,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_f2e732c2357b197452c54646298a3a22.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d373c71a-7f16-51b0-a08d-2d6b89fa466a/d373c71a-7f16-51b0-a08d-2d6b89fa466a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73141,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_465f89df6b5f3f082b185f381d0937cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d373c71a-7f16-51b0-a08d-2d6b89fa466a/d373c71a-7f16-51b0-a08d-2d6b89fa466a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77102,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_cd0a849473a051f0f8c92a88e49c979b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d373c71a-7f16-51b0-a08d-2d6b89fa466a/d373c71a-7f16-51b0-a08d-2d6b89fa466a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70682,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_5c2128c1e5ab7280cb276064818e2cb8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d373c71a-7f16-51b0-a08d-2d6b89fa466a/d373c71a-7f16-51b0-a08d-2d6b89fa466a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76469,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_dafb72acc84e4c470afc38293775ba91.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d373c71a-7f16-51b0-a08d-2d6b89fa466a/d373c71a-7f16-51b0-a08d-2d6b89fa466a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80620,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_b33812ab58de5a6e3d6f9ec5f3550117.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d373c71a-7f16-51b0-a08d-2d6b89fa466a/d373c71a-7f16-51b0-a08d-2d6b89fa466a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73563,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/93/2193411aeae17df7be69872e43c40dad/pa/VL80227_cb09951b431b1ba477c5cf813dd49c74.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2008-06-02',
'seats_number': 5,
'seller_name': None,
'title': 'Honda Civic 1.8 VTEC Executive',
'transmission': 'manual',
'trim': 'Executive',
'year': 2008}
2026-03-30 11:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL80227%27 HTTP/1.1" 200 None
2026-03-30 11:25:36 [auto1.es] INFO: Saving data for VL80227: {'created_time': 1774869936.401109, 'last_price_update_time': 1774869936.401118, 'auction_closing_time': 1774971216.0}
2026-03-30 11:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VL80227') HTTP/1.1" 204 0
2026-03-30 11:25:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/a6/55a6c36c5f5a3e11b3ea84696b0763c0/pa/ST19382_910fc9b687e5c07d2de3a9edbe38be47.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad50d10>
2026-03-30 11:25:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5390cfd1-d10b-5890-ad94-6b5021f35dbe/5390cfd1-d10b-5890-ad94-6b5021f35dbe_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fa6%252F55a6c36c5f5a3e11b3ea84696b0763c0%252Fpa%252FST19382_910fc9b687e5c07d2de3a9edbe38be47.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/a6/55a6c36c5f5a3e11b3ea84696b0763c0/pa/ST19382_910fc9b687e5c07d2de3a9edbe38be47.jpg saved to cache
2026-03-30 11:25:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5390cfd1-d10b-5890-ad94-6b5021f35dbe
2026-03-30 11:25:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/a6/55a6c36c5f5a3e11b3ea84696b0763c0/pa/ST19382_18e250a4900ccab509a3696460e0cebd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3ea450>
2026-03-30 11:25:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5390cfd1-d10b-5890-ad94-6b5021f35dbe/5390cfd1-d10b-5890-ad94-6b5021f35dbe_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fa6%252F55a6c36c5f5a3e11b3ea84696b0763c0%252Fpa%252FST19382_18e250a4900ccab509a3696460e0cebd.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/a6/55a6c36c5f5a3e11b3ea84696b0763c0/pa/ST19382_18e250a4900ccab509a3696460e0cebd.jpg saved to cache
2026-03-30 11:25:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5390cfd1-d10b-5890-ad94-6b5021f35dbe
2026-03-30 11:25:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/a6/55a6c36c5f5a3e11b3ea84696b0763c0/pa/ST19382_df81816afb614a5fd551a46983904559.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a48c8d0>
2026-03-30 11:25:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5390cfd1-d10b-5890-ad94-6b5021f35dbe/5390cfd1-d10b-5890-ad94-6b5021f35dbe_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fa6%252F55a6c36c5f5a3e11b3ea84696b0763c0%252Fpa%252FST19382_df81816afb614a5fd551a46983904559.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/a6/55a6c36c5f5a3e11b3ea84696b0763c0/pa/ST19382_df81816afb614a5fd551a46983904559.jpg saved to cache
2026-03-30 11:25:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5390cfd1-d10b-5890-ad94-6b5021f35dbe
2026-03-30 11:25:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/a6/55a6c36c5f5a3e11b3ea84696b0763c0/pa/ST19382_b7111836166da8a96b8daa9711ec9aa8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/a6/55a6c36c5f5a3e11b3ea84696b0763c0/pa/ST19382_831a0956da010e24bc28a351db880fdb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060ff3f50>
2026-03-30 11:25:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5390cfd1-d10b-5890-ad94-6b5021f35dbe/5390cfd1-d10b-5890-ad94-6b5021f35dbe_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fa6%252F55a6c36c5f5a3e11b3ea84696b0763c0%252Fpa%252FST19382_b7111836166da8a96b8daa9711ec9aa8.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/a6/55a6c36c5f5a3e11b3ea84696b0763c0/pa/ST19382_b7111836166da8a96b8daa9711ec9aa8.jpg saved to cache
2026-03-30 11:25:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5390cfd1-d10b-5890-ad94-6b5021f35dbe
2026-03-30 11:25:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a42dc10>
2026-03-30 11:25:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5390cfd1-d10b-5890-ad94-6b5021f35dbe/5390cfd1-d10b-5890-ad94-6b5021f35dbe_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fa6%252F55a6c36c5f5a3e11b3ea84696b0763c0%252Fpa%252FST19382_831a0956da010e24bc28a351db880fdb.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/a6/55a6c36c5f5a3e11b3ea84696b0763c0/pa/ST19382_831a0956da010e24bc28a351db880fdb.jpg saved to cache
2026-03-30 11:25:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5390cfd1-d10b-5890-ad94-6b5021f35dbe
2026-03-30 11:25:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5390cfd1-d10b-5890-ad94-6b5021f35dbe, skipping ID generation
2026-03-30 11:25:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5390cfd1-d10b-5890-ad94-6b5021f35dbe with scrape type 1
2026-03-30 11:25:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5390cfd1-d10b-5890-ad94-6b5021f35dbe sending to next pipeline
2026-03-30 11:25:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5390cfd1-d10b-5890-ad94-6b5021f35dbe, identifier: ST19382
2026-03-30 11:25:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5390cfd1-d10b-5890-ad94-6b5021f35dbe with identifier: ST19382
2026-03-30 11:25:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5390cfd1-d10b-5890-ad94-6b5021f35dbe with identifier: ST19382
2026-03-30 11:25:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5390cfd1-d10b-5890-ad94-6b5021f35dbe with identifier: ST19382 to the API
2026-03-30 11:25:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:25:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img55/a6/55a6c36c5f5a3e11b3ea84696b0763c0/pa/ST19382_831a0956da010e24bc28a351db880fdb.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.2L',
'engine_horse_power': 80,
'expiration_date': '2026-03-31T15:15:14Z',
'fuel_type': 'petrol',
'id': '5390cfd1-d10b-5890-ad94-6b5021f35dbe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST19382',
'listing': 'auction',
'location': 'ES, Málaga',
'make': 'Nissan',
'model': 'Micra',
'odometer': 61187,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5390cfd1-d10b-5890-ad94-6b5021f35dbe/5390cfd1-d10b-5890-ad94-6b5021f35dbe_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113774,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img55/a6/55a6c36c5f5a3e11b3ea84696b0763c0/pa/ST19382_831a0956da010e24bc28a351db880fdb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5390cfd1-d10b-5890-ad94-6b5021f35dbe/5390cfd1-d10b-5890-ad94-6b5021f35dbe_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108487,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img55/a6/55a6c36c5f5a3e11b3ea84696b0763c0/pa/ST19382_b7111836166da8a96b8daa9711ec9aa8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5390cfd1-d10b-5890-ad94-6b5021f35dbe/5390cfd1-d10b-5890-ad94-6b5021f35dbe_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85024,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img55/a6/55a6c36c5f5a3e11b3ea84696b0763c0/pa/ST19382_df81816afb614a5fd551a46983904559.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5390cfd1-d10b-5890-ad94-6b5021f35dbe/5390cfd1-d10b-5890-ad94-6b5021f35dbe_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59853,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img55/a6/55a6c36c5f5a3e11b3ea84696b0763c0/pa/ST19382_18e250a4900ccab509a3696460e0cebd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5390cfd1-d10b-5890-ad94-6b5021f35dbe/5390cfd1-d10b-5890-ad94-6b5021f35dbe_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57287,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img55/a6/55a6c36c5f5a3e11b3ea84696b0763c0/pa/ST19382_910fc9b687e5c07d2de3a9edbe38be47.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5390cfd1-d10b-5890-ad94-6b5021f35dbe/5390cfd1-d10b-5890-ad94-6b5021f35dbe_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105453,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img55/a6/55a6c36c5f5a3e11b3ea84696b0763c0/pa/ST19382_2931f16ea79db10a7808348268dbccec.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2006-06-11',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Micra 1.2 Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2006}
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ST19382%27 HTTP/1.1" 200 None
2026-03-30 11:25:38 [auto1.es] INFO: Saving data for ST19382: {'created_time': 1774869938.375619, 'last_price_update_time': 1774869938.37563, 'auction_closing_time': 1774970114.0}
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ST19382') HTTP/1.1" 204 0
2026-03-30 11:25:38 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.198(s), this was the 1st time calling it.
2026-03-30 11:25:38 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.6868127294573405 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:25:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:25:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YZ56503> (referer: https://www.auto1.com/v1/car-details-view/YZ56503/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 189ccad6-5211-5b15-970d-79e60f0c00fc with identifier: YZ56503
2026-03-30 11:25:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 189ccad6-5211-5b15-970d-79e60f0c00fc with scrape type 1
2026-03-30 11:25:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 189ccad6-5211-5b15-970d-79e60f0c00fc
2026-03-30 11:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F16%252F32167e987165e879829b53abbdc51232%252Fpa%252FYZ56503_d0af76ff10796699354d610ad8d04f5f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/16/32167e987165e879829b53abbdc51232/pa/YZ56503_d0af76ff10796699354d610ad8d04f5f.jpg not downloaded yet
2026-03-30 11:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F16%252F32167e987165e879829b53abbdc51232%252Fpa%252FYZ56503_70deb55d339e5777824966e6cc8ed820.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/16/32167e987165e879829b53abbdc51232/pa/YZ56503_70deb55d339e5777824966e6cc8ed820.jpg not downloaded yet
2026-03-30 11:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F16%252F32167e987165e879829b53abbdc51232%252Fpa%252FYZ56503_724f59c215164ed4f8af94f414504240.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/16/32167e987165e879829b53abbdc51232/pa/YZ56503_724f59c215164ed4f8af94f414504240.jpg not downloaded yet
2026-03-30 11:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F16%252F32167e987165e879829b53abbdc51232%252Fpa%252FYZ56503_5a02242227ae2b382e747df7b61fb058.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/16/32167e987165e879829b53abbdc51232/pa/YZ56503_5a02242227ae2b382e747df7b61fb058.jpg not downloaded yet
2026-03-30 11:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F16%252F32167e987165e879829b53abbdc51232%252Fpa%252FYZ56503_687a551b1e4f0444917e571c6699ce2a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/16/32167e987165e879829b53abbdc51232/pa/YZ56503_687a551b1e4f0444917e571c6699ce2a.jpg not downloaded yet
2026-03-30 11:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F16%252F32167e987165e879829b53abbdc51232%252Fpa%252FYZ56503_30a04197b3db12d0bc21610d617b78eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/16/32167e987165e879829b53abbdc51232/pa/YZ56503_30a04197b3db12d0bc21610d617b78eb.jpg not downloaded yet
2026-03-30 11:25:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WY74843/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/16/32167e987165e879829b53abbdc51232/pa/YZ56503_30a04197b3db12d0bc21610d617b78eb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a35d010>
2026-03-30 11:25:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189ccad6-5211-5b15-970d-79e60f0c00fc/189ccad6-5211-5b15-970d-79e60f0c00fc_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F16%252F32167e987165e879829b53abbdc51232%252Fpa%252FYZ56503_30a04197b3db12d0bc21610d617b78eb.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/16/32167e987165e879829b53abbdc51232/pa/YZ56503_30a04197b3db12d0bc21610d617b78eb.jpg saved to cache
2026-03-30 11:25:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 189ccad6-5211-5b15-970d-79e60f0c00fc
2026-03-30 11:25:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SB83788/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:48 [auto1.es] INFO: Channel: 24h | Page: 10 | totalHits: 2234 | hits on page: 40
2026-03-30 11:25:48 [auto1.es] INFO: Found listing with ID: YK20837
2026-03-30 11:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YK20837%27 HTTP/1.1" 200 None
2026-03-30 11:25:48 [auto1.es] INFO: Scrape type for YK20837: 0
2026-03-30 11:25:48 [auto1.es] INFO: Found listing with ID: BA34469
2026-03-30 11:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BA34469%27 HTTP/1.1" 200 None
2026-03-30 11:25:48 [auto1.es] INFO: Scrape type for BA34469: 0
2026-03-30 11:25:48 [auto1.es] INFO: Found listing with ID: RF07608
2026-03-30 11:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RF07608%27 HTTP/1.1" 200 None
2026-03-30 11:25:48 [auto1.es] INFO: Scrape type for RF07608: 1
2026-03-30 11:25:48 [auto1.es] INFO: Found listing with ID: BU05339
2026-03-30 11:25:48 [auto1.es] INFO: Found listing with ID: CL24407
2026-03-30 11:25:48 [auto1.es] INFO: Found listing with ID: PU52673
2026-03-30 11:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PU52673%27 HTTP/1.1" 200 None
2026-03-30 11:25:48 [auto1.es] INFO: Scrape type for PU52673: 1
2026-03-30 11:25:48 [auto1.es] INFO: Found listing with ID: GJ54103
2026-03-30 11:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GJ54103%27 HTTP/1.1" 200 None
2026-03-30 11:25:48 [auto1.es] INFO: Scrape type for GJ54103: 2
2026-03-30 11:25:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: caa78e1f-9123-52d9-b9f1-52de5e6d4904 with identifier: GJ54103
2026-03-30 11:25:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item caa78e1f-9123-52d9-b9f1-52de5e6d4904 with scrape type 2
2026-03-30 11:25:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item caa78e1f-9123-52d9-b9f1-52de5e6d4904 with scrape type 2
2026-03-30 11:25:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: caa78e1f-9123-52d9-b9f1-52de5e6d4904, identifier: GJ54103
2026-03-30 11:25:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: caa78e1f-9123-52d9-b9f1-52de5e6d4904 with identifier: GJ54103
2026-03-30 11:25:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: caa78e1f-9123-52d9-b9f1-52de5e6d4904 with identifier: GJ54103
2026-03-30 11:25:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: caa78e1f-9123-52d9-b9f1-52de5e6d4904 with identifier: GJ54103 to the API
2026-03-30 11:25:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:25:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:25:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:07:12Z',
'fuel_type': 'diesel',
'id': 'caa78e1f-9123-52d9-b9f1-52de5e6d4904',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ54103',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 143044,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-18',
'seller_name': None,
'title': 'Peugeot 208 1.4 HDi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2013}
2026-03-30 11:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GJ54103%27 HTTP/1.1" 200 None
2026-03-30 11:25:48 [auto1.es] INFO: Saving data for GJ54103: {'auction_closing_time': 1774969632.0, 'created_time': 1773238852.319635, 'last_price_update_time': 1774869948.772549}
2026-03-30 11:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GJ54103') HTTP/1.1" 204 0
2026-03-30 11:25:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/16/32167e987165e879829b53abbdc51232/pa/YZ56503_687a551b1e4f0444917e571c6699ce2a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:48 [auto1.es] INFO: Found listing with ID: UB08754
2026-03-30 11:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB08754%27 HTTP/1.1" 200 None
2026-03-30 11:25:48 [auto1.es] INFO: Scrape type for UB08754: 2
2026-03-30 11:25:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b65050cd-9ef4-5f1b-831f-682e03482a4c with identifier: UB08754
2026-03-30 11:25:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b65050cd-9ef4-5f1b-831f-682e03482a4c with scrape type 2
2026-03-30 11:25:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b65050cd-9ef4-5f1b-831f-682e03482a4c with scrape type 2
2026-03-30 11:25:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b65050cd-9ef4-5f1b-831f-682e03482a4c, identifier: UB08754
2026-03-30 11:25:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b65050cd-9ef4-5f1b-831f-682e03482a4c with identifier: UB08754
2026-03-30 11:25:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b65050cd-9ef4-5f1b-831f-682e03482a4c with identifier: UB08754
2026-03-30 11:25:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b65050cd-9ef4-5f1b-831f-682e03482a4c with identifier: UB08754 to the API
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:25:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 116,
'expiration_date': '2026-03-31T15:34:09Z',
'fuel_type': 'petrol',
'id': 'b65050cd-9ef4-5f1b-831f-682e03482a4c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB08754',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Limousine',
'odometer': 197683,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-25',
'seller_name': None,
'title': 'Audi A3 Limousine 30 TFSI Design',
'transmission': 'manual',
'trim': 'Design',
'year': 2019}
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB08754%27 HTTP/1.1" 200 None
2026-03-30 11:25:49 [auto1.es] INFO: Saving data for UB08754: {'auction_closing_time': 1774971249.0, 'created_time': 1773145695.64871, 'last_price_update_time': 1774869949.327793}
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UB08754') HTTP/1.1" 204 0
2026-03-30 11:25:49 [auto1.es] INFO: Found listing with ID: NG44880
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NG44880%27 HTTP/1.1" 200 None
2026-03-30 11:25:49 [auto1.es] INFO: Scrape type for NG44880: 2
2026-03-30 11:25:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c11e7ca9-5579-5080-b5b8-c26107ace98e with identifier: NG44880
2026-03-30 11:25:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c11e7ca9-5579-5080-b5b8-c26107ace98e with scrape type 2
2026-03-30 11:25:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c11e7ca9-5579-5080-b5b8-c26107ace98e with scrape type 2
2026-03-30 11:25:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c11e7ca9-5579-5080-b5b8-c26107ace98e, identifier: NG44880
2026-03-30 11:25:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c11e7ca9-5579-5080-b5b8-c26107ace98e with identifier: NG44880
2026-03-30 11:25:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c11e7ca9-5579-5080-b5b8-c26107ace98e with identifier: NG44880
2026-03-30 11:25:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c11e7ca9-5579-5080-b5b8-c26107ace98e with identifier: NG44880 to the API
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:25:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-31T15:45:40Z',
'fuel_type': 'petrol',
'id': 'c11e7ca9-5579-5080-b5b8-c26107ace98e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG44880',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 134052,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'Audi Q5 2.0 TFSI quattro Advanced edition',
'transmission': 'manual',
'trim': 'quattro Advanced edition',
'year': 2017}
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NG44880%27 HTTP/1.1" 200 None
2026-03-30 11:25:49 [auto1.es] INFO: Saving data for NG44880: {'auction_closing_time': 1774971940.0, 'created_time': 1773144251.380323, 'last_price_update_time': 1774869949.846776}
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NG44880') HTTP/1.1" 204 0
2026-03-30 11:25:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad6f810>
2026-03-30 11:25:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189ccad6-5211-5b15-970d-79e60f0c00fc/189ccad6-5211-5b15-970d-79e60f0c00fc_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F16%252F32167e987165e879829b53abbdc51232%252Fpa%252FYZ56503_687a551b1e4f0444917e571c6699ce2a.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/16/32167e987165e879829b53abbdc51232/pa/YZ56503_687a551b1e4f0444917e571c6699ce2a.jpg saved to cache
2026-03-30 11:25:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 189ccad6-5211-5b15-970d-79e60f0c00fc
2026-03-30 11:25:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/16/32167e987165e879829b53abbdc51232/pa/YZ56503_5a02242227ae2b382e747df7b61fb058.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:25:49 [auto1.es] INFO: Found listing with ID: GS81251
2026-03-30 11:25:49 [auto1.es] INFO: Found listing with ID: AV47736
2026-03-30 11:25:49 [auto1.es] INFO: Found listing with ID: VB30178
2026-03-30 11:25:49 [auto1.es] INFO: Found listing with ID: MB25535
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MB25535%27 HTTP/1.1" 200 None
2026-03-30 11:25:49 [auto1.es] INFO: Scrape type for MB25535: 1
2026-03-30 11:25:49 [auto1.es] INFO: Found listing with ID: NF93358
2026-03-30 11:25:49 [auto1.es] INFO: Found listing with ID: NM50229
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM50229%27 HTTP/1.1" 200 None
2026-03-30 11:25:49 [auto1.es] INFO: Scrape type for NM50229: 2
2026-03-30 11:25:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a037ee8b-50f7-557b-a1a4-7064d0d5a616 with identifier: NM50229
2026-03-30 11:25:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a037ee8b-50f7-557b-a1a4-7064d0d5a616 with scrape type 2
2026-03-30 11:25:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a037ee8b-50f7-557b-a1a4-7064d0d5a616 with scrape type 2
2026-03-30 11:25:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a037ee8b-50f7-557b-a1a4-7064d0d5a616, identifier: NM50229
2026-03-30 11:25:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a037ee8b-50f7-557b-a1a4-7064d0d5a616 with identifier: NM50229
2026-03-30 11:25:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a037ee8b-50f7-557b-a1a4-7064d0d5a616 with identifier: NM50229
2026-03-30 11:25:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a037ee8b-50f7-557b-a1a4-7064d0d5a616 with identifier: NM50229 to the API
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:25:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:59:52Z',
'fuel_type': 'diesel',
'id': 'a037ee8b-50f7-557b-a1a4-7064d0d5a616',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM50229',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 229224,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-11-29',
'seller_name': None,
'title': 'Ford Focus 1.8 TDCi Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2006}
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM50229%27 HTTP/1.1" 200 None
2026-03-30 11:25:50 [auto1.es] INFO: Saving data for NM50229: {'auction_closing_time': 1774972792.0, 'created_time': 1773180598.219101, 'last_price_update_time': 1774869950.369767}
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NM50229') HTTP/1.1" 204 0
2026-03-30 11:25:50 [auto1.es] INFO: Found listing with ID: UC04153
2026-03-30 11:25:50 [auto1.es] INFO: Found listing with ID: WB78314
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WB78314%27 HTTP/1.1" 200 None
2026-03-30 11:25:50 [auto1.es] INFO: Scrape type for WB78314: 2
2026-03-30 11:25:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39fe6339-6bb8-5d23-95cc-99303f4bad45 with identifier: WB78314
2026-03-30 11:25:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39fe6339-6bb8-5d23-95cc-99303f4bad45 with scrape type 2
2026-03-30 11:25:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39fe6339-6bb8-5d23-95cc-99303f4bad45 with scrape type 2
2026-03-30 11:25:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 39fe6339-6bb8-5d23-95cc-99303f4bad45, identifier: WB78314
2026-03-30 11:25:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 39fe6339-6bb8-5d23-95cc-99303f4bad45 with identifier: WB78314
2026-03-30 11:25:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 39fe6339-6bb8-5d23-95cc-99303f4bad45 with identifier: WB78314
2026-03-30 11:25:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 39fe6339-6bb8-5d23-95cc-99303f4bad45 with identifier: WB78314 to the API
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:25:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:05:40Z',
'fuel_type': 'diesel',
'id': '39fe6339-6bb8-5d23-95cc-99303f4bad45',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB78314',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-5',
'odometer': 143379,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-09-18',
'seller_name': None,
'title': 'Mazda CX-5 2.2 Turbodiesel Luxury 4WD',
'transmission': 'automatic',
'trim': 'Luxury 4WD',
'year': 2014}
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WB78314%27 HTTP/1.1" 200 None
2026-03-30 11:25:50 [auto1.es] INFO: Saving data for WB78314: {'auction_closing_time': 1774969540.0, 'created_time': 1773146144.836727, 'last_price_update_time': 1774869950.85383}
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WB78314') HTTP/1.1" 204 0
2026-03-30 11:25:50 [auto1.es] INFO: Found listing with ID: LS16672
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LS16672%27 HTTP/1.1" 200 None
2026-03-30 11:25:50 [auto1.es] INFO: Scrape type for LS16672: 1
2026-03-30 11:25:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:25:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4a6ed0>
2026-03-30 11:25:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:25:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189ccad6-5211-5b15-970d-79e60f0c00fc/189ccad6-5211-5b15-970d-79e60f0c00fc_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F16%252F32167e987165e879829b53abbdc51232%252Fpa%252FYZ56503_5a02242227ae2b382e747df7b61fb058.jpg') HTTP/1.1" 204 0
2026-03-30 11:25:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/16/32167e987165e879829b53abbdc51232/pa/YZ56503_5a02242227ae2b382e747df7b61fb058.jpg saved to cache
2026-03-30 11:25:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 189ccad6-5211-5b15-970d-79e60f0c00fc
2026-03-30 11:25:50 [auto1.es] INFO: Found listing with ID: ZY06660
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZY06660%27 HTTP/1.1" 200 None
2026-03-30 11:25:50 [auto1.es] INFO: Scrape type for ZY06660: 2
2026-03-30 11:25:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdbc0900-05b0-5a16-a866-2f057c04fddd with identifier: ZY06660
2026-03-30 11:25:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdbc0900-05b0-5a16-a866-2f057c04fddd with scrape type 2
2026-03-30 11:25:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fdbc0900-05b0-5a16-a866-2f057c04fddd with scrape type 2
2026-03-30 11:25:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fdbc0900-05b0-5a16-a866-2f057c04fddd, identifier: ZY06660
2026-03-30 11:25:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fdbc0900-05b0-5a16-a866-2f057c04fddd with identifier: ZY06660
2026-03-30 11:25:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fdbc0900-05b0-5a16-a866-2f057c04fddd with identifier: ZY06660
2026-03-30 11:25:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fdbc0900-05b0-5a16-a866-2f057c04fddd with identifier: ZY06660 to the API
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:25:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-31T15:29:29Z',
'fuel_type': 'petrol',
'id': 'fdbc0900-05b0-5a16-a866-2f057c04fddd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY06660',
'listing': 'auction',
'make': 'Ford',
'model': 'Ka',
'odometer': 121716,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-16',
'seller_name': None,
'title': 'Ford Ka 1.2 Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2010}
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZY06660%27 HTTP/1.1" 200 None
2026-03-30 11:25:51 [auto1.es] INFO: Saving data for ZY06660: {'auction_closing_time': 1774970969.0, 'created_time': 1774471051.300724, 'last_price_update_time': 1774869951.384659}
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZY06660') HTTP/1.1" 204 0
2026-03-30 11:25:51 [auto1.es] INFO: Found listing with ID: PY56166
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PY56166%27 HTTP/1.1" 200 None
2026-03-30 11:25:51 [auto1.es] INFO: Scrape type for PY56166: 2
2026-03-30 11:25:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 458290a2-cd11-5c69-9747-e1cd24f924f5 with identifier: PY56166
2026-03-30 11:25:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 458290a2-cd11-5c69-9747-e1cd24f924f5 with scrape type 2
2026-03-30 11:25:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 458290a2-cd11-5c69-9747-e1cd24f924f5 with scrape type 2
2026-03-30 11:25:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 458290a2-cd11-5c69-9747-e1cd24f924f5, identifier: PY56166
2026-03-30 11:25:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 458290a2-cd11-5c69-9747-e1cd24f924f5 with identifier: PY56166
2026-03-30 11:25:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 458290a2-cd11-5c69-9747-e1cd24f924f5 with identifier: PY56166
2026-03-30 11:25:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 458290a2-cd11-5c69-9747-e1cd24f924f5 with identifier: PY56166 to the API
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:25:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 155,
'expiration_date': '2026-03-31T15:20:24Z',
'fuel_type': 'petrol',
'id': '458290a2-cd11-5c69-9747-e1cd24f924f5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY56166',
'listing': 'auction',
'make': 'Honda',
'model': 'Accord',
'odometer': 230386,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-08-07',
'seller_name': None,
'title': 'Honda Accord 2.0 VTEC Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2005}
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PY56166%27 HTTP/1.1" 200 None
2026-03-30 11:25:51 [auto1.es] INFO: Saving data for PY56166: {'auction_closing_time': 1774970424.0, 'created_time': 1773295242.483284, 'last_price_update_time': 1774869951.917271}
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PY56166') HTTP/1.1" 204 0
2026-03-30 11:25:51 [auto1.es] INFO: Found listing with ID: BB23821
2026-03-30 11:25:51 [auto1.es] INFO: Found listing with ID: DX58510
2026-03-30 11:25:51 [auto1.es] INFO: Found listing with ID: RD08609
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD08609%27 HTTP/1.1" 200 None
2026-03-30 11:25:51 [auto1.es] INFO: Scrape type for RD08609: 2
2026-03-30 11:25:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bee17770-ccba-52bb-ba52-b0dbd86c1759 with identifier: RD08609
2026-03-30 11:25:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bee17770-ccba-52bb-ba52-b0dbd86c1759 with scrape type 2
2026-03-30 11:25:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bee17770-ccba-52bb-ba52-b0dbd86c1759 with scrape type 2
2026-03-30 11:25:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bee17770-ccba-52bb-ba52-b0dbd86c1759, identifier: RD08609
2026-03-30 11:25:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XX24085/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bee17770-ccba-52bb-ba52-b0dbd86c1759 with identifier: RD08609
2026-03-30 11:25:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bee17770-ccba-52bb-ba52-b0dbd86c1759 with identifier: RD08609
2026-03-30 11:25:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bee17770-ccba-52bb-ba52-b0dbd86c1759 with identifier: RD08609 to the API
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:25:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 232,
'expiration_date': '2026-03-31T15:09:14Z',
'fuel_type': 'diesel',
'id': 'bee17770-ccba-52bb-ba52-b0dbd86c1759',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD08609',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 373434,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-02-12',
'seller_name': None,
'title': 'Audi A6 3.0 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2008}
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD08609%27 HTTP/1.1" 200 None
2026-03-30 11:25:52 [auto1.es] INFO: Saving data for RD08609: {'auction_closing_time': 1774969754.0, 'created_time': 1773146650.97267, 'last_price_update_time': 1774869952.468281}
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RD08609') HTTP/1.1" 204 0
2026-03-30 11:25:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BK85695/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:52 [auto1.es] INFO: Found listing with ID: DK89314
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DK89314%27 HTTP/1.1" 200 None
2026-03-30 11:25:52 [auto1.es] INFO: Scrape type for DK89314: 2
2026-03-30 11:25:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 088a1783-ec3e-530c-aa42-6dbe25cce1d2 with identifier: DK89314
2026-03-30 11:25:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 088a1783-ec3e-530c-aa42-6dbe25cce1d2 with scrape type 2
2026-03-30 11:25:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 088a1783-ec3e-530c-aa42-6dbe25cce1d2 with scrape type 2
2026-03-30 11:25:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 088a1783-ec3e-530c-aa42-6dbe25cce1d2, identifier: DK89314
2026-03-30 11:25:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 088a1783-ec3e-530c-aa42-6dbe25cce1d2 with identifier: DK89314
2026-03-30 11:25:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 088a1783-ec3e-530c-aa42-6dbe25cce1d2 with identifier: DK89314
2026-03-30 11:25:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 088a1783-ec3e-530c-aa42-6dbe25cce1d2 with identifier: DK89314 to the API
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:25:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 194,
'expiration_date': '2026-03-31T15:55:28Z',
'fuel_type': 'diesel',
'id': '088a1783-ec3e-530c-aa42-6dbe25cce1d2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK89314',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 76621,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-04',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2020}
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DK89314%27 HTTP/1.1" 200 None
2026-03-30 11:25:52 [auto1.es] INFO: Saving data for DK89314: {'auction_closing_time': 1774972528.0, 'created_time': 1773130481.972147, 'last_price_update_time': 1774869952.993264}
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DK89314') HTTP/1.1" 204 0
2026-03-30 11:25:53 [auto1.es] INFO: Found listing with ID: WU12290
2026-03-30 11:25:53 [auto1.es] INFO: Found listing with ID: KZ68230
2026-03-30 11:25:53 [auto1.es] INFO: Found listing with ID: WU48196
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WU48196%27 HTTP/1.1" 200 None
2026-03-30 11:25:53 [auto1.es] INFO: Scrape type for WU48196: 2
2026-03-30 11:25:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ba00599-ee3e-5b4c-9389-7217616fa992 with identifier: WU48196
2026-03-30 11:25:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ba00599-ee3e-5b4c-9389-7217616fa992 with scrape type 2
2026-03-30 11:25:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ba00599-ee3e-5b4c-9389-7217616fa992 with scrape type 2
2026-03-30 11:25:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2ba00599-ee3e-5b4c-9389-7217616fa992, identifier: WU48196
2026-03-30 11:25:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2ba00599-ee3e-5b4c-9389-7217616fa992 with identifier: WU48196
2026-03-30 11:25:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2ba00599-ee3e-5b4c-9389-7217616fa992 with identifier: WU48196
2026-03-30 11:25:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2ba00599-ee3e-5b4c-9389-7217616fa992 with identifier: WU48196 to the API
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:25:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-31T15:37:07Z',
'fuel_type': 'diesel',
'id': '2ba00599-ee3e-5b4c-9389-7217616fa992',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU48196',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 245816,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-12',
'seller_name': None,
'title': 'BMW 3er 320d xDrive Sport Line',
'transmission': 'automatic',
'trim': 'xDrive Sport Line',
'year': 2017}
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WU48196%27 HTTP/1.1" 200 None
2026-03-30 11:25:53 [auto1.es] INFO: Saving data for WU48196: {'auction_closing_time': 1774971427.0, 'created_time': 1774263981.459689, 'last_price_update_time': 1774869953.507045}
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WU48196') HTTP/1.1" 204 0
2026-03-30 11:25:53 [auto1.es] INFO: Found listing with ID: EN72031
2026-03-30 11:25:53 [auto1.es] INFO: Found listing with ID: HH73339
2026-03-30 11:25:53 [auto1.es] INFO: Found listing with ID: RV47114
2026-03-30 11:25:53 [auto1.es] INFO: Found listing with ID: SN50770
2026-03-30 11:25:53 [auto1.es] INFO: Found listing with ID: JL69651
2026-03-30 11:25:53 [auto1.es] INFO: Found listing with ID: UE43737
2026-03-30 11:25:53 [auto1.es] INFO: Found listing with ID: UR76299
2026-03-30 11:25:53 [auto1.es] INFO: Found listing with ID: CE82406
2026-03-30 11:25:53 [auto1.es] INFO: Found listing with ID: CP05375
2026-03-30 11:25:53 [auto1.es] INFO: Found listing with ID: FK20395
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK20395%27 HTTP/1.1" 200 None
2026-03-30 11:25:53 [auto1.es] INFO: Scrape type for FK20395: 2
2026-03-30 11:25:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5d6b5cd-6163-5fee-8c33-950441370eba with identifier: FK20395
2026-03-30 11:25:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5d6b5cd-6163-5fee-8c33-950441370eba with scrape type 2
2026-03-30 11:25:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5d6b5cd-6163-5fee-8c33-950441370eba with scrape type 2
2026-03-30 11:25:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c5d6b5cd-6163-5fee-8c33-950441370eba, identifier: FK20395
2026-03-30 11:25:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c5d6b5cd-6163-5fee-8c33-950441370eba with identifier: FK20395
2026-03-30 11:25:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c5d6b5cd-6163-5fee-8c33-950441370eba with identifier: FK20395
2026-03-30 11:25:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c5d6b5cd-6163-5fee-8c33-950441370eba with identifier: FK20395 to the API
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:25:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:17:47Z',
'fuel_type': 'petrol',
'id': 'c5d6b5cd-6163-5fee-8c33-950441370eba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK20395',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 96588,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-08-16',
'seller_name': None,
'title': 'Audi A3 Sportback 1.2 TFSI Ambiente',
'transmission': 'manual',
'trim': 'Ambiente',
'year': 2015}
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK20395%27 HTTP/1.1" 200 None
2026-03-30 11:25:53 [auto1.es] INFO: Saving data for FK20395: {'auction_closing_time': 1774970267.0, 'created_time': 1773146555.332048, 'last_price_update_time': 1774869953.989101}
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FK20395') HTTP/1.1" 204 0
2026-03-30 11:25:54 [auto1.es] INFO: Found listing with ID: RN17480
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RN17480%27 HTTP/1.1" 200 None
2026-03-30 11:25:54 [auto1.es] INFO: Scrape type for RN17480: 2
2026-03-30 11:25:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f96abdfb-c54f-5267-aac4-1a846f722a95 with identifier: RN17480
2026-03-30 11:25:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f96abdfb-c54f-5267-aac4-1a846f722a95 with scrape type 2
2026-03-30 11:25:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f96abdfb-c54f-5267-aac4-1a846f722a95 with scrape type 2
2026-03-30 11:25:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f96abdfb-c54f-5267-aac4-1a846f722a95, identifier: RN17480
2026-03-30 11:25:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f96abdfb-c54f-5267-aac4-1a846f722a95 with identifier: RN17480
2026-03-30 11:25:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f96abdfb-c54f-5267-aac4-1a846f722a95 with identifier: RN17480
2026-03-30 11:25:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f96abdfb-c54f-5267-aac4-1a846f722a95 with identifier: RN17480 to the API
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:25:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-31T15:17:45Z',
'fuel_type': 'diesel',
'id': 'f96abdfb-c54f-5267-aac4-1a846f722a95',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN17480',
'listing': 'auction',
'make': 'DS Automobiles',
'model': 'DS7 Crossback',
'odometer': 171158,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-10',
'seller_name': None,
'title': 'DS Automobiles DS7 Crossback 2.0 Blue-HDi SoChic',
'transmission': 'automatic',
'trim': 'SoChic',
'year': 2019}
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RN17480%27 HTTP/1.1" 200 None
2026-03-30 11:25:54 [auto1.es] INFO: Saving data for RN17480: {'auction_closing_time': 1774970265.0, 'created_time': 1773146518.403577, 'last_price_update_time': 1774869954.577936}
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RN17480') HTTP/1.1" 204 0
2026-03-30 11:25:54 [auto1.es] INFO: Found listing with ID: CB59551
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CB59551%27 HTTP/1.1" 200 None
2026-03-30 11:25:54 [auto1.es] INFO: Scrape type for CB59551: 2
2026-03-30 11:25:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1524cfbe-92a4-5bde-93fa-edb85d39c271 with identifier: CB59551
2026-03-30 11:25:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1524cfbe-92a4-5bde-93fa-edb85d39c271 with scrape type 2
2026-03-30 11:25:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1524cfbe-92a4-5bde-93fa-edb85d39c271 with scrape type 2
2026-03-30 11:25:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1524cfbe-92a4-5bde-93fa-edb85d39c271, identifier: CB59551
2026-03-30 11:25:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1524cfbe-92a4-5bde-93fa-edb85d39c271 with identifier: CB59551
2026-03-30 11:25:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1524cfbe-92a4-5bde-93fa-edb85d39c271 with identifier: CB59551
2026-03-30 11:25:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1524cfbe-92a4-5bde-93fa-edb85d39c271 with identifier: CB59551 to the API
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:25:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:25:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-31T15:05:21Z',
'fuel_type': 'diesel',
'id': '1524cfbe-92a4-5bde-93fa-edb85d39c271',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB59551',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 340689,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-07-30',
'seller_name': None,
'title': 'Volkswagen Touran 1.9 TDI Goal',
'transmission': 'manual',
'trim': 'Goal',
'year': 2006}
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CB59551%27 HTTP/1.1" 200 None
2026-03-30 11:25:55 [auto1.es] INFO: Saving data for CB59551: {'auction_closing_time': 1774969521.0, 'created_time': 1773146750.674578, 'last_price_update_time': 1774869955.056528}
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CB59551') HTTP/1.1" 204 0
2026-03-30 11:25:55 [auto1.es] INFO: Found listing with ID: AE45269
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE45269%27 HTTP/1.1" 200 None
2026-03-30 11:25:55 [auto1.es] INFO: Scrape type for AE45269: 2
2026-03-30 11:25:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38b5ab60-083b-5849-bd48-c98de02df88c with identifier: AE45269
2026-03-30 11:25:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38b5ab60-083b-5849-bd48-c98de02df88c with scrape type 2
2026-03-30 11:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38b5ab60-083b-5849-bd48-c98de02df88c with scrape type 2
2026-03-30 11:25:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 38b5ab60-083b-5849-bd48-c98de02df88c, identifier: AE45269
2026-03-30 11:25:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 38b5ab60-083b-5849-bd48-c98de02df88c with identifier: AE45269
2026-03-30 11:25:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 38b5ab60-083b-5849-bd48-c98de02df88c with identifier: AE45269
2026-03-30 11:25:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 38b5ab60-083b-5849-bd48-c98de02df88c with identifier: AE45269 to the API
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:25:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:09:54Z',
'fuel_type': 'diesel',
'id': '38b5ab60-083b-5849-bd48-c98de02df88c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE45269',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 156697,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-05',
'seller_name': None,
'title': 'Dacia Sandero 1.5 dCi Stepway Prestige',
'transmission': 'manual',
'trim': 'Stepway Prestige',
'year': 2016}
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE45269%27 HTTP/1.1" 200 None
2026-03-30 11:25:55 [auto1.es] INFO: Saving data for AE45269: {'auction_closing_time': 1774969794.0, 'created_time': 1774382770.014713, 'last_price_update_time': 1774869955.475264}
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AE45269') HTTP/1.1" 204 0
2026-03-30 11:25:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BV86161/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:56 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.310(s), this was the 1st time calling it.
2026-03-30 11:25:56 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.621961072825584 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:25:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UG86344/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SA67244> (referer: https://www.auto1.com/v1/car-details-view/SA67244/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4eddcdf-b996-5cf5-b820-f09f16ddd686 with identifier: SA67244
2026-03-30 11:26:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4eddcdf-b996-5cf5-b820-f09f16ddd686 with scrape type 1
2026-03-30 11:26:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d4eddcdf-b996-5cf5-b820-f09f16ddd686
2026-03-30 11:26:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F9c%252F339c67a9b7f58eb2bf778a0fd62218a0%252Fpa%252FSA67244_2d4e795e066d852bae5245af6ff90aaa.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_2d4e795e066d852bae5245af6ff90aaa.jpg not downloaded yet
2026-03-30 11:26:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F9c%252F339c67a9b7f58eb2bf778a0fd62218a0%252Fpa%252FSA67244_14f331695977b3df2225fb5cbaa32665.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_14f331695977b3df2225fb5cbaa32665.jpg not downloaded yet
2026-03-30 11:26:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F9c%252F339c67a9b7f58eb2bf778a0fd62218a0%252Fpa%252FSA67244_81cf7d48e1f5725806d70d2a57814e4b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_81cf7d48e1f5725806d70d2a57814e4b.jpg not downloaded yet
2026-03-30 11:26:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F9c%252F339c67a9b7f58eb2bf778a0fd62218a0%252Fpa%252FSA67244_5b29d1427cd8fa67420e08136c8a438c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_5b29d1427cd8fa67420e08136c8a438c.jpg not downloaded yet
2026-03-30 11:26:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F9c%252F339c67a9b7f58eb2bf778a0fd62218a0%252Fpa%252FSA67244_e4067b4a98c8ff0e3a6108a8b807575b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_e4067b4a98c8ff0e3a6108a8b807575b.jpg not downloaded yet
2026-03-30 11:26:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F9c%252F339c67a9b7f58eb2bf778a0fd62218a0%252Fpa%252FSA67244_4a5f57dbe47adf1ecb18004e5b1c46d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_4a5f57dbe47adf1ecb18004e5b1c46d8.jpg not downloaded yet
2026-03-30 11:26:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F9c%252F339c67a9b7f58eb2bf778a0fd62218a0%252Fpa%252FSA67244_e7c6aa4b3a6bc3adc16246f3f5af9b72.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_e7c6aa4b3a6bc3adc16246f3f5af9b72.jpg not downloaded yet
2026-03-30 11:26:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F9c%252F339c67a9b7f58eb2bf778a0fd62218a0%252Fpa%252FSA67244_fb7cff1fa2f8ebaffd5da63b418dfbc5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_fb7cff1fa2f8ebaffd5da63b418dfbc5.jpg not downloaded yet
2026-03-30 11:26:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F9c%252F339c67a9b7f58eb2bf778a0fd62218a0%252Fpa%252FSA67244_e4588e08623425c21e3df379946f222a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_e4588e08623425c21e3df379946f222a.jpg not downloaded yet
2026-03-30 11:26:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F9c%252F339c67a9b7f58eb2bf778a0fd62218a0%252Fpa%252FSA67244_29c2eeddd24265324e0d8df09bcf0ec7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_29c2eeddd24265324e0d8df09bcf0ec7.jpg not downloaded yet
2026-03-30 11:26:02 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 405.050(s), this was the 3rd time calling it.
2026-03-30 11:26:02 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.163406721982271 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:26:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:26:04 [scrapy.extensions.logstats] INFO: Crawled 142 pages (at 12 pages/min), scraped 167 items (at 16 items/min)
2026-03-30 11:26:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 161MiB
2026-03-30 11:26:06 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.183(s), this was the 1st time calling it.
2026-03-30 11:26:06 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.101083528915334 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:26:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 4th time calling it.
2026-03-30 11:26:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DA85741/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_29c2eeddd24265324e0d8df09bcf0ec7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060fe7d50>
2026-03-30 11:26:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4eddcdf-b996-5cf5-b820-f09f16ddd686/d4eddcdf-b996-5cf5-b820-f09f16ddd686_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:26:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F9c%252F339c67a9b7f58eb2bf778a0fd62218a0%252Fpa%252FSA67244_29c2eeddd24265324e0d8df09bcf0ec7.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_29c2eeddd24265324e0d8df09bcf0ec7.jpg saved to cache
2026-03-30 11:26:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d4eddcdf-b996-5cf5-b820-f09f16ddd686
2026-03-30 11:26:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WY74843> (referer: https://www.auto1.com/v1/car-details-view/WY74843/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17dbdd4b-e17a-5ff9-95a5-489f0b4194c3 with identifier: WY74843
2026-03-30 11:26:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17dbdd4b-e17a-5ff9-95a5-489f0b4194c3 with scrape type 1
2026-03-30 11:26:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 17dbdd4b-e17a-5ff9-95a5-489f0b4194c3
2026-03-30 11:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fd3%252F54d36ac59729a7bcdf2440690d92e557%252Fpa%252FWY74843_0a4de5565534f02897958c36fe174076.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/d3/54d36ac59729a7bcdf2440690d92e557/pa/WY74843_0a4de5565534f02897958c36fe174076.jpg not downloaded yet
2026-03-30 11:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fd3%252F54d36ac59729a7bcdf2440690d92e557%252Fpa%252FWY74843_6e3a25b078f61e8328d087beb7544cb5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/d3/54d36ac59729a7bcdf2440690d92e557/pa/WY74843_6e3a25b078f61e8328d087beb7544cb5.jpg not downloaded yet
2026-03-30 11:26:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_e4588e08623425c21e3df379946f222a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fd3%252F54d36ac59729a7bcdf2440690d92e557%252Fpa%252FWY74843_440faddb70f3f5174ee4560b40452130.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/d3/54d36ac59729a7bcdf2440690d92e557/pa/WY74843_440faddb70f3f5174ee4560b40452130.jpg not downloaded yet
2026-03-30 11:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fd3%252F54d36ac59729a7bcdf2440690d92e557%252Fpa%252FWY74843_d54787a58ca864fbfdc9cfc8fe1a0924.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/d3/54d36ac59729a7bcdf2440690d92e557/pa/WY74843_d54787a58ca864fbfdc9cfc8fe1a0924.jpg not downloaded yet
2026-03-30 11:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fd3%252F54d36ac59729a7bcdf2440690d92e557%252Fpa%252FWY74843_16f6f0ea2ba02b48f7b7fbb59d4ec2ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/d3/54d36ac59729a7bcdf2440690d92e557/pa/WY74843_16f6f0ea2ba02b48f7b7fbb59d4ec2ef.jpg not downloaded yet
2026-03-30 11:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fd3%252F54d36ac59729a7bcdf2440690d92e557%252Fpa%252FWY74843_679627bf225f991e62530a7fe37bb7c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/d3/54d36ac59729a7bcdf2440690d92e557/pa/WY74843_679627bf225f991e62530a7fe37bb7c6.jpg not downloaded yet
2026-03-30 11:26:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a439750>
2026-03-30 11:26:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4eddcdf-b996-5cf5-b820-f09f16ddd686/d4eddcdf-b996-5cf5-b820-f09f16ddd686_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F9c%252F339c67a9b7f58eb2bf778a0fd62218a0%252Fpa%252FSA67244_e4588e08623425c21e3df379946f222a.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_e4588e08623425c21e3df379946f222a.jpg saved to cache
2026-03-30 11:26:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d4eddcdf-b996-5cf5-b820-f09f16ddd686
2026-03-30 11:26:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/d3/54d36ac59729a7bcdf2440690d92e557/pa/WY74843_6e3a25b078f61e8328d087beb7544cb5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/d3/54d36ac59729a7bcdf2440690d92e557/pa/WY74843_679627bf225f991e62530a7fe37bb7c6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/d3/54d36ac59729a7bcdf2440690d92e557/pa/WY74843_16f6f0ea2ba02b48f7b7fbb59d4ec2ef.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3a1850>
2026-03-30 11:26:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17dbdd4b-e17a-5ff9-95a5-489f0b4194c3/17dbdd4b-e17a-5ff9-95a5-489f0b4194c3_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fd3%252F54d36ac59729a7bcdf2440690d92e557%252Fpa%252FWY74843_6e3a25b078f61e8328d087beb7544cb5.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/d3/54d36ac59729a7bcdf2440690d92e557/pa/WY74843_6e3a25b078f61e8328d087beb7544cb5.jpg saved to cache
2026-03-30 11:26:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 17dbdd4b-e17a-5ff9-95a5-489f0b4194c3
2026-03-30 11:26:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/d3/54d36ac59729a7bcdf2440690d92e557/pa/WY74843_d54787a58ca864fbfdc9cfc8fe1a0924.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05aee1250>
2026-03-30 11:26:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17dbdd4b-e17a-5ff9-95a5-489f0b4194c3/17dbdd4b-e17a-5ff9-95a5-489f0b4194c3_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fd3%252F54d36ac59729a7bcdf2440690d92e557%252Fpa%252FWY74843_679627bf225f991e62530a7fe37bb7c6.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/d3/54d36ac59729a7bcdf2440690d92e557/pa/WY74843_679627bf225f991e62530a7fe37bb7c6.jpg saved to cache
2026-03-30 11:26:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 17dbdd4b-e17a-5ff9-95a5-489f0b4194c3
2026-03-30 11:26:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3a35d0>
2026-03-30 11:26:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17dbdd4b-e17a-5ff9-95a5-489f0b4194c3/17dbdd4b-e17a-5ff9-95a5-489f0b4194c3_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fd3%252F54d36ac59729a7bcdf2440690d92e557%252Fpa%252FWY74843_16f6f0ea2ba02b48f7b7fbb59d4ec2ef.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/d3/54d36ac59729a7bcdf2440690d92e557/pa/WY74843_16f6f0ea2ba02b48f7b7fbb59d4ec2ef.jpg saved to cache
2026-03-30 11:26:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 17dbdd4b-e17a-5ff9-95a5-489f0b4194c3
2026-03-30 11:26:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/d3/54d36ac59729a7bcdf2440690d92e557/pa/WY74843_440faddb70f3f5174ee4560b40452130.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4d7850>
2026-03-30 11:26:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17dbdd4b-e17a-5ff9-95a5-489f0b4194c3/17dbdd4b-e17a-5ff9-95a5-489f0b4194c3_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fd3%252F54d36ac59729a7bcdf2440690d92e557%252Fpa%252FWY74843_d54787a58ca864fbfdc9cfc8fe1a0924.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/d3/54d36ac59729a7bcdf2440690d92e557/pa/WY74843_d54787a58ca864fbfdc9cfc8fe1a0924.jpg saved to cache
2026-03-30 11:26:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 17dbdd4b-e17a-5ff9-95a5-489f0b4194c3
2026-03-30 11:26:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/d3/54d36ac59729a7bcdf2440690d92e557/pa/WY74843_0a4de5565534f02897958c36fe174076.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad42210>
2026-03-30 11:26:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17dbdd4b-e17a-5ff9-95a5-489f0b4194c3/17dbdd4b-e17a-5ff9-95a5-489f0b4194c3_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:26:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fd3%252F54d36ac59729a7bcdf2440690d92e557%252Fpa%252FWY74843_440faddb70f3f5174ee4560b40452130.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/d3/54d36ac59729a7bcdf2440690d92e557/pa/WY74843_440faddb70f3f5174ee4560b40452130.jpg saved to cache
2026-03-30 11:26:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 17dbdd4b-e17a-5ff9-95a5-489f0b4194c3
2026-03-30 11:26:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4af190>
2026-03-30 11:26:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17dbdd4b-e17a-5ff9-95a5-489f0b4194c3/17dbdd4b-e17a-5ff9-95a5-489f0b4194c3_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:26:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fd3%252F54d36ac59729a7bcdf2440690d92e557%252Fpa%252FWY74843_0a4de5565534f02897958c36fe174076.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/d3/54d36ac59729a7bcdf2440690d92e557/pa/WY74843_0a4de5565534f02897958c36fe174076.jpg saved to cache
2026-03-30 11:26:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 17dbdd4b-e17a-5ff9-95a5-489f0b4194c3
2026-03-30 11:26:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 17dbdd4b-e17a-5ff9-95a5-489f0b4194c3, skipping ID generation
2026-03-30 11:26:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17dbdd4b-e17a-5ff9-95a5-489f0b4194c3 with scrape type 1
2026-03-30 11:26:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 17dbdd4b-e17a-5ff9-95a5-489f0b4194c3 sending to next pipeline
2026-03-30 11:26:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 17dbdd4b-e17a-5ff9-95a5-489f0b4194c3, identifier: WY74843
2026-03-30 11:26:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 17dbdd4b-e17a-5ff9-95a5-489f0b4194c3 with identifier: WY74843
2026-03-30 11:26:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 17dbdd4b-e17a-5ff9-95a5-489f0b4194c3 with identifier: WY74843
2026-03-30 11:26:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 17dbdd4b-e17a-5ff9-95a5-489f0b4194c3 with identifier: WY74843 to the API
2026-03-30 11:26:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img54/d3/54d36ac59729a7bcdf2440690d92e557/pa/WY74843_0a4de5565534f02897958c36fe174076.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 73,
'expiration_date': '2026-03-31T15:33:04Z',
'fuel_type': 'petrol',
'id': '17dbdd4b-e17a-5ff9-95a5-489f0b4194c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY74843',
'listing': 'auction',
'location': 'ES, Vigo',
'make': 'Peugeot',
'model': '206+',
'odometer': 118700,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17dbdd4b-e17a-5ff9-95a5-489f0b4194c3/17dbdd4b-e17a-5ff9-95a5-489f0b4194c3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 125632,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/d3/54d36ac59729a7bcdf2440690d92e557/pa/WY74843_0a4de5565534f02897958c36fe174076.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17dbdd4b-e17a-5ff9-95a5-489f0b4194c3/17dbdd4b-e17a-5ff9-95a5-489f0b4194c3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103741,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/d3/54d36ac59729a7bcdf2440690d92e557/pa/WY74843_6e3a25b078f61e8328d087beb7544cb5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17dbdd4b-e17a-5ff9-95a5-489f0b4194c3/17dbdd4b-e17a-5ff9-95a5-489f0b4194c3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83636,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/d3/54d36ac59729a7bcdf2440690d92e557/pa/WY74843_440faddb70f3f5174ee4560b40452130.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17dbdd4b-e17a-5ff9-95a5-489f0b4194c3/17dbdd4b-e17a-5ff9-95a5-489f0b4194c3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66915,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/d3/54d36ac59729a7bcdf2440690d92e557/pa/WY74843_d54787a58ca864fbfdc9cfc8fe1a0924.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17dbdd4b-e17a-5ff9-95a5-489f0b4194c3/17dbdd4b-e17a-5ff9-95a5-489f0b4194c3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49137,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/d3/54d36ac59729a7bcdf2440690d92e557/pa/WY74843_16f6f0ea2ba02b48f7b7fbb59d4ec2ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17dbdd4b-e17a-5ff9-95a5-489f0b4194c3/17dbdd4b-e17a-5ff9-95a5-489f0b4194c3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 125352,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/d3/54d36ac59729a7bcdf2440690d92e557/pa/WY74843_679627bf225f991e62530a7fe37bb7c6.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-06-30',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 206+ 1.4 Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2011}
2026-03-30 11:26:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WY74843%27 HTTP/1.1" 200 None
2026-03-30 11:26:11 [auto1.es] INFO: Saving data for WY74843: {'created_time': 1774869971.621095, 'last_price_update_time': 1774869971.621105, 'auction_closing_time': 1774971184.0}
2026-03-30 11:26:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WY74843') HTTP/1.1" 204 0
2026-03-30 11:26:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_fb7cff1fa2f8ebaffd5da63b418dfbc5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:26:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ae70090>
2026-03-30 11:26:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4eddcdf-b996-5cf5-b820-f09f16ddd686/d4eddcdf-b996-5cf5-b820-f09f16ddd686_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:26:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F9c%252F339c67a9b7f58eb2bf778a0fd62218a0%252Fpa%252FSA67244_fb7cff1fa2f8ebaffd5da63b418dfbc5.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_fb7cff1fa2f8ebaffd5da63b418dfbc5.jpg saved to cache
2026-03-30 11:26:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d4eddcdf-b996-5cf5-b820-f09f16ddd686
2026-03-30 11:26:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_e7c6aa4b3a6bc3adc16246f3f5af9b72.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060fee3d0>
2026-03-30 11:26:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4eddcdf-b996-5cf5-b820-f09f16ddd686/d4eddcdf-b996-5cf5-b820-f09f16ddd686_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:26:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F9c%252F339c67a9b7f58eb2bf778a0fd62218a0%252Fpa%252FSA67244_e7c6aa4b3a6bc3adc16246f3f5af9b72.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_e7c6aa4b3a6bc3adc16246f3f5af9b72.jpg saved to cache
2026-03-30 11:26:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d4eddcdf-b996-5cf5-b820-f09f16ddd686
2026-03-30 11:26:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_4a5f57dbe47adf1ecb18004e5b1c46d8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4d6350>
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4eddcdf-b996-5cf5-b820-f09f16ddd686/d4eddcdf-b996-5cf5-b820-f09f16ddd686_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F9c%252F339c67a9b7f58eb2bf778a0fd62218a0%252Fpa%252FSA67244_4a5f57dbe47adf1ecb18004e5b1c46d8.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_4a5f57dbe47adf1ecb18004e5b1c46d8.jpg saved to cache
2026-03-30 11:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d4eddcdf-b996-5cf5-b820-f09f16ddd686
2026-03-30 11:26:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_e4067b4a98c8ff0e3a6108a8b807575b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060fef610>
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4eddcdf-b996-5cf5-b820-f09f16ddd686/d4eddcdf-b996-5cf5-b820-f09f16ddd686_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F9c%252F339c67a9b7f58eb2bf778a0fd62218a0%252Fpa%252FSA67244_e4067b4a98c8ff0e3a6108a8b807575b.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_e4067b4a98c8ff0e3a6108a8b807575b.jpg saved to cache
2026-03-30 11:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d4eddcdf-b996-5cf5-b820-f09f16ddd686
2026-03-30 11:26:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_5b29d1427cd8fa67420e08136c8a438c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3a2490>
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4eddcdf-b996-5cf5-b820-f09f16ddd686/d4eddcdf-b996-5cf5-b820-f09f16ddd686_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F9c%252F339c67a9b7f58eb2bf778a0fd62218a0%252Fpa%252FSA67244_5b29d1427cd8fa67420e08136c8a438c.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_5b29d1427cd8fa67420e08136c8a438c.jpg saved to cache
2026-03-30 11:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d4eddcdf-b996-5cf5-b820-f09f16ddd686
2026-03-30 11:26:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_81cf7d48e1f5725806d70d2a57814e4b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a301750>
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4eddcdf-b996-5cf5-b820-f09f16ddd686/d4eddcdf-b996-5cf5-b820-f09f16ddd686_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F9c%252F339c67a9b7f58eb2bf778a0fd62218a0%252Fpa%252FSA67244_81cf7d48e1f5725806d70d2a57814e4b.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_81cf7d48e1f5725806d70d2a57814e4b.jpg saved to cache
2026-03-30 11:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d4eddcdf-b996-5cf5-b820-f09f16ddd686
2026-03-30 11:26:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_14f331695977b3df2225fb5cbaa32665.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_2d4e795e066d852bae5245af6ff90aaa.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4ad4d0>
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4eddcdf-b996-5cf5-b820-f09f16ddd686/d4eddcdf-b996-5cf5-b820-f09f16ddd686_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F9c%252F339c67a9b7f58eb2bf778a0fd62218a0%252Fpa%252FSA67244_14f331695977b3df2225fb5cbaa32665.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_14f331695977b3df2225fb5cbaa32665.jpg saved to cache
2026-03-30 11:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d4eddcdf-b996-5cf5-b820-f09f16ddd686
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3a0e90>
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4eddcdf-b996-5cf5-b820-f09f16ddd686/d4eddcdf-b996-5cf5-b820-f09f16ddd686_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F9c%252F339c67a9b7f58eb2bf778a0fd62218a0%252Fpa%252FSA67244_2d4e795e066d852bae5245af6ff90aaa.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_2d4e795e066d852bae5245af6ff90aaa.jpg saved to cache
2026-03-30 11:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d4eddcdf-b996-5cf5-b820-f09f16ddd686
2026-03-30 11:26:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d4eddcdf-b996-5cf5-b820-f09f16ddd686, skipping ID generation
2026-03-30 11:26:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4eddcdf-b996-5cf5-b820-f09f16ddd686 with scrape type 1
2026-03-30 11:26:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d4eddcdf-b996-5cf5-b820-f09f16ddd686 sending to next pipeline
2026-03-30 11:26:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d4eddcdf-b996-5cf5-b820-f09f16ddd686, identifier: SA67244
2026-03-30 11:26:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d4eddcdf-b996-5cf5-b820-f09f16ddd686 with identifier: SA67244
2026-03-30 11:26:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d4eddcdf-b996-5cf5-b820-f09f16ddd686 with identifier: SA67244
2026-03-30 11:26:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d4eddcdf-b996-5cf5-b820-f09f16ddd686 with identifier: SA67244 to the API
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_2d4e795e066d852bae5245af6ff90aaa.jpg>
{'auction_title': '',
'c_o_2_emission_value': 148,
'category': 'Rental',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 95,
'expiration_date': '2026-03-31T15:39:42Z',
'fuel_type': 'diesel',
'id': 'd4eddcdf-b996-5cf5-b820-f09f16ddd686',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA67244',
'listing': 'auction',
'location': 'ES, Barcelona',
'make': 'Renault',
'model': 'Kangoo',
'odometer': 169628,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4eddcdf-b996-5cf5-b820-f09f16ddd686/d4eddcdf-b996-5cf5-b820-f09f16ddd686_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60568,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_2d4e795e066d852bae5245af6ff90aaa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4eddcdf-b996-5cf5-b820-f09f16ddd686/d4eddcdf-b996-5cf5-b820-f09f16ddd686_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56714,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_14f331695977b3df2225fb5cbaa32665.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4eddcdf-b996-5cf5-b820-f09f16ddd686/d4eddcdf-b996-5cf5-b820-f09f16ddd686_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46015,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_81cf7d48e1f5725806d70d2a57814e4b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4eddcdf-b996-5cf5-b820-f09f16ddd686/d4eddcdf-b996-5cf5-b820-f09f16ddd686_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40350,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_5b29d1427cd8fa67420e08136c8a438c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4eddcdf-b996-5cf5-b820-f09f16ddd686/d4eddcdf-b996-5cf5-b820-f09f16ddd686_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47645,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_e4067b4a98c8ff0e3a6108a8b807575b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4eddcdf-b996-5cf5-b820-f09f16ddd686/d4eddcdf-b996-5cf5-b820-f09f16ddd686_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52690,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_4a5f57dbe47adf1ecb18004e5b1c46d8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4eddcdf-b996-5cf5-b820-f09f16ddd686/d4eddcdf-b996-5cf5-b820-f09f16ddd686_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50164,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_e7c6aa4b3a6bc3adc16246f3f5af9b72.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4eddcdf-b996-5cf5-b820-f09f16ddd686/d4eddcdf-b996-5cf5-b820-f09f16ddd686_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59047,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_fb7cff1fa2f8ebaffd5da63b418dfbc5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4eddcdf-b996-5cf5-b820-f09f16ddd686/d4eddcdf-b996-5cf5-b820-f09f16ddd686_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55147,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_e4588e08623425c21e3df379946f222a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4eddcdf-b996-5cf5-b820-f09f16ddd686/d4eddcdf-b996-5cf5-b820-f09f16ddd686_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67491,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/9c/339c67a9b7f58eb2bf778a0fd62218a0/pa/SA67244_29c2eeddd24265324e0d8df09bcf0ec7.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-01-24',
'seats_number': 2,
'seller_name': None,
'title': 'Renault Kangoo 1.5 BLUE dCi Furgón Professional',
'transmission': 'manual',
'trim': 'Furgón Professional',
'year': 2021}
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SA67244%27 HTTP/1.1" 200 None
2026-03-30 11:26:13 [auto1.es] INFO: Saving data for SA67244: {'created_time': 1774869973.356831, 'last_price_update_time': 1774869973.356842, 'auction_closing_time': 1774971582.0}
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SA67244') HTTP/1.1" 204 0
2026-03-30 11:26:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YJ93473/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RK47874/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PU52673/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LS16672/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BK85695> (referer: https://www.auto1.com/v1/car-details-view/BK85695/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53fa9d2f-2c77-594a-a1ef-239816f3065d with identifier: BK85695
2026-03-30 11:26:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53fa9d2f-2c77-594a-a1ef-239816f3065d with scrape type 1
2026-03-30 11:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 53fa9d2f-2c77-594a-a1ef-239816f3065d
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fd1%252F4dd1ba1d67f5b8b2416b4bf9d9eb33ce%252Fpa%252FBK85695_6fc0c8e4979d40741460613701afbd4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_6fc0c8e4979d40741460613701afbd4c.jpg not downloaded yet
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fd1%252F4dd1ba1d67f5b8b2416b4bf9d9eb33ce%252Fpa%252FBK85695_bd4083d8bc917121ac11bd39e965a95a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_bd4083d8bc917121ac11bd39e965a95a.jpg not downloaded yet
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fd1%252F4dd1ba1d67f5b8b2416b4bf9d9eb33ce%252Fpa%252FBK85695_717c2ff412c1141ee3ae5ca0a4267286.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_717c2ff412c1141ee3ae5ca0a4267286.jpg not downloaded yet
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fd1%252F4dd1ba1d67f5b8b2416b4bf9d9eb33ce%252Fpa%252FBK85695_fbbe574c498befa210b9091ebda904ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_fbbe574c498befa210b9091ebda904ba.jpg not downloaded yet
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fd1%252F4dd1ba1d67f5b8b2416b4bf9d9eb33ce%252Fpa%252FBK85695_f900c64b2ec38271aaa098f64de022fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_f900c64b2ec38271aaa098f64de022fe.jpg not downloaded yet
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fd1%252F4dd1ba1d67f5b8b2416b4bf9d9eb33ce%252Fpa%252FBK85695_bd4bf99433d3072fa3fd149f2df1665d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_bd4bf99433d3072fa3fd149f2df1665d.jpg not downloaded yet
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fd1%252F4dd1ba1d67f5b8b2416b4bf9d9eb33ce%252Fpa%252FBK85695_d3a606e3528386f6a39c8fdc1fa9b946.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_d3a606e3528386f6a39c8fdc1fa9b946.jpg not downloaded yet
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fd1%252F4dd1ba1d67f5b8b2416b4bf9d9eb33ce%252Fpa%252FBK85695_ca1f73e291d0cbb979f03053ee35a915.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_ca1f73e291d0cbb979f03053ee35a915.jpg not downloaded yet
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fd1%252F4dd1ba1d67f5b8b2416b4bf9d9eb33ce%252Fpa%252FBK85695_4d90dc15cef743b8912c3ca9c06fb968.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_4d90dc15cef743b8912c3ca9c06fb968.jpg not downloaded yet
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fd1%252F4dd1ba1d67f5b8b2416b4bf9d9eb33ce%252Fpa%252FBK85695_202001dde8b1210ba1a5c36de1e27d18.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_202001dde8b1210ba1a5c36de1e27d18.jpg not downloaded yet
2026-03-30 11:26:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SB83788> (referer: https://www.auto1.com/v1/car-details-view/SB83788/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72cc8870-ae59-5f25-a353-b1925b30c85a with identifier: SB83788
2026-03-30 11:26:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72cc8870-ae59-5f25-a353-b1925b30c85a with scrape type 1
2026-03-30 11:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 72cc8870-ae59-5f25-a353-b1925b30c85a
2026-03-30 11:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fff%252Fe2ffe8ebde7579052a5c94921b876f46%252Fpa%252FSB83788_6cf7150ce132dde39ddeb120f61f1eb5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_6cf7150ce132dde39ddeb120f61f1eb5.jpg not downloaded yet
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fff%252Fe2ffe8ebde7579052a5c94921b876f46%252Fpa%252FSB83788_b5685741e885ea7c14e69dc2f962a158.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_b5685741e885ea7c14e69dc2f962a158.jpg not downloaded yet
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fff%252Fe2ffe8ebde7579052a5c94921b876f46%252Fpa%252FSB83788_a1e900b5a170ad2396b7a396aba87786.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_a1e900b5a170ad2396b7a396aba87786.jpg not downloaded yet
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fff%252Fe2ffe8ebde7579052a5c94921b876f46%252Fpa%252FSB83788_0d11e271ec444ea21270c2c1d62f0f14.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_0d11e271ec444ea21270c2c1d62f0f14.jpg not downloaded yet
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fff%252Fe2ffe8ebde7579052a5c94921b876f46%252Fpa%252FSB83788_f20f9df9c52a8f6d0d659a30a394e967.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_f20f9df9c52a8f6d0d659a30a394e967.jpg not downloaded yet
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fff%252Fe2ffe8ebde7579052a5c94921b876f46%252Fpa%252FSB83788_fe3eac5172d763134017ddeb5d525908.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_fe3eac5172d763134017ddeb5d525908.jpg not downloaded yet
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fff%252Fe2ffe8ebde7579052a5c94921b876f46%252Fpa%252FSB83788_ea34c1a25d3155e4ecd78b6d4be34e9b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_ea34c1a25d3155e4ecd78b6d4be34e9b.jpg not downloaded yet
2026-03-30 11:26:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_202001dde8b1210ba1a5c36de1e27d18.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fff%252Fe2ffe8ebde7579052a5c94921b876f46%252Fpa%252FSB83788_d737c96b5789c0300ed988e24c58e71d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_d737c96b5789c0300ed988e24c58e71d.jpg not downloaded yet
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fff%252Fe2ffe8ebde7579052a5c94921b876f46%252Fpa%252FSB83788_fb85dff84584244e2df873ebc17af930.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_fb85dff84584244e2df873ebc17af930.jpg not downloaded yet
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fff%252Fe2ffe8ebde7579052a5c94921b876f46%252Fpa%252FSB83788_d48f851ea03a5a7b241d1b259009a8a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_d48f851ea03a5a7b241d1b259009a8a8.jpg not downloaded yet
2026-03-30 11:26:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a301ad0>
2026-03-30 11:26:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53fa9d2f-2c77-594a-a1ef-239816f3065d/53fa9d2f-2c77-594a-a1ef-239816f3065d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fd1%252F4dd1ba1d67f5b8b2416b4bf9d9eb33ce%252Fpa%252FBK85695_202001dde8b1210ba1a5c36de1e27d18.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_202001dde8b1210ba1a5c36de1e27d18.jpg saved to cache
2026-03-30 11:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 53fa9d2f-2c77-594a-a1ef-239816f3065d
2026-03-30 11:26:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_ea34c1a25d3155e4ecd78b6d4be34e9b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3e8510>
2026-03-30 11:26:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72cc8870-ae59-5f25-a353-b1925b30c85a/72cc8870-ae59-5f25-a353-b1925b30c85a_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fff%252Fe2ffe8ebde7579052a5c94921b876f46%252Fpa%252FSB83788_ea34c1a25d3155e4ecd78b6d4be34e9b.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_ea34c1a25d3155e4ecd78b6d4be34e9b.jpg saved to cache
2026-03-30 11:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 72cc8870-ae59-5f25-a353-b1925b30c85a
2026-03-30 11:26:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_d48f851ea03a5a7b241d1b259009a8a8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:20 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.900(s), this was the 1st time calling it.
2026-03-30 11:26:20 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.7687477379918 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:26:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a467250>
2026-03-30 11:26:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72cc8870-ae59-5f25-a353-b1925b30c85a/72cc8870-ae59-5f25-a353-b1925b30c85a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fff%252Fe2ffe8ebde7579052a5c94921b876f46%252Fpa%252FSB83788_d48f851ea03a5a7b241d1b259009a8a8.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_d48f851ea03a5a7b241d1b259009a8a8.jpg saved to cache
2026-03-30 11:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 72cc8870-ae59-5f25-a353-b1925b30c85a
2026-03-30 11:26:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_fb85dff84584244e2df873ebc17af930.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad7a090>
2026-03-30 11:26:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72cc8870-ae59-5f25-a353-b1925b30c85a/72cc8870-ae59-5f25-a353-b1925b30c85a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fff%252Fe2ffe8ebde7579052a5c94921b876f46%252Fpa%252FSB83788_fb85dff84584244e2df873ebc17af930.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_fb85dff84584244e2df873ebc17af930.jpg saved to cache
2026-03-30 11:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 72cc8870-ae59-5f25-a353-b1925b30c85a
2026-03-30 11:26:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_d737c96b5789c0300ed988e24c58e71d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad53dd0>
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72cc8870-ae59-5f25-a353-b1925b30c85a/72cc8870-ae59-5f25-a353-b1925b30c85a_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fff%252Fe2ffe8ebde7579052a5c94921b876f46%252Fpa%252FSB83788_d737c96b5789c0300ed988e24c58e71d.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_d737c96b5789c0300ed988e24c58e71d.jpg saved to cache
2026-03-30 11:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 72cc8870-ae59-5f25-a353-b1925b30c85a
2026-03-30 11:26:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_fe3eac5172d763134017ddeb5d525908.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a466dd0>
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72cc8870-ae59-5f25-a353-b1925b30c85a/72cc8870-ae59-5f25-a353-b1925b30c85a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fff%252Fe2ffe8ebde7579052a5c94921b876f46%252Fpa%252FSB83788_fe3eac5172d763134017ddeb5d525908.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_fe3eac5172d763134017ddeb5d525908.jpg saved to cache
2026-03-30 11:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 72cc8870-ae59-5f25-a353-b1925b30c85a
2026-03-30 11:26:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_f20f9df9c52a8f6d0d659a30a394e967.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4a4b10>
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72cc8870-ae59-5f25-a353-b1925b30c85a/72cc8870-ae59-5f25-a353-b1925b30c85a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fff%252Fe2ffe8ebde7579052a5c94921b876f46%252Fpa%252FSB83788_f20f9df9c52a8f6d0d659a30a394e967.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_f20f9df9c52a8f6d0d659a30a394e967.jpg saved to cache
2026-03-30 11:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 72cc8870-ae59-5f25-a353-b1925b30c85a
2026-03-30 11:26:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_0d11e271ec444ea21270c2c1d62f0f14.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad1c810>
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72cc8870-ae59-5f25-a353-b1925b30c85a/72cc8870-ae59-5f25-a353-b1925b30c85a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fff%252Fe2ffe8ebde7579052a5c94921b876f46%252Fpa%252FSB83788_0d11e271ec444ea21270c2c1d62f0f14.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_0d11e271ec444ea21270c2c1d62f0f14.jpg saved to cache
2026-03-30 11:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 72cc8870-ae59-5f25-a353-b1925b30c85a
2026-03-30 11:26:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_a1e900b5a170ad2396b7a396aba87786.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a455d90>
2026-03-30 11:26:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72cc8870-ae59-5f25-a353-b1925b30c85a/72cc8870-ae59-5f25-a353-b1925b30c85a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fff%252Fe2ffe8ebde7579052a5c94921b876f46%252Fpa%252FSB83788_a1e900b5a170ad2396b7a396aba87786.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_a1e900b5a170ad2396b7a396aba87786.jpg saved to cache
2026-03-30 11:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 72cc8870-ae59-5f25-a353-b1925b30c85a
2026-03-30 11:26:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_b5685741e885ea7c14e69dc2f962a158.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_6cf7150ce132dde39ddeb120f61f1eb5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4b7c90>
2026-03-30 11:26:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72cc8870-ae59-5f25-a353-b1925b30c85a/72cc8870-ae59-5f25-a353-b1925b30c85a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fff%252Fe2ffe8ebde7579052a5c94921b876f46%252Fpa%252FSB83788_b5685741e885ea7c14e69dc2f962a158.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_b5685741e885ea7c14e69dc2f962a158.jpg saved to cache
2026-03-30 11:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 72cc8870-ae59-5f25-a353-b1925b30c85a
2026-03-30 11:26:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ae70d90>
2026-03-30 11:26:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72cc8870-ae59-5f25-a353-b1925b30c85a/72cc8870-ae59-5f25-a353-b1925b30c85a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fff%252Fe2ffe8ebde7579052a5c94921b876f46%252Fpa%252FSB83788_6cf7150ce132dde39ddeb120f61f1eb5.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_6cf7150ce132dde39ddeb120f61f1eb5.jpg saved to cache
2026-03-30 11:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 72cc8870-ae59-5f25-a353-b1925b30c85a
2026-03-30 11:26:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 72cc8870-ae59-5f25-a353-b1925b30c85a, skipping ID generation
2026-03-30 11:26:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72cc8870-ae59-5f25-a353-b1925b30c85a with scrape type 1
2026-03-30 11:26:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 72cc8870-ae59-5f25-a353-b1925b30c85a sending to next pipeline
2026-03-30 11:26:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 72cc8870-ae59-5f25-a353-b1925b30c85a, identifier: SB83788
2026-03-30 11:26:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 72cc8870-ae59-5f25-a353-b1925b30c85a with identifier: SB83788
2026-03-30 11:26:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 72cc8870-ae59-5f25-a353-b1925b30c85a with identifier: SB83788
2026-03-30 11:26:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 72cc8870-ae59-5f25-a353-b1925b30c85a with identifier: SB83788 to the API
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_6cf7150ce132dde39ddeb120f61f1eb5.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '2.0L',
'engine_horse_power': 170,
'expiration_date': '2026-03-31T15:27:58Z',
'fuel_type': 'diesel',
'id': '72cc8870-ae59-5f25-a353-b1925b30c85a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB83788',
'listing': 'auction',
'location': 'ES, Campo Real',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 140006,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72cc8870-ae59-5f25-a353-b1925b30c85a/72cc8870-ae59-5f25-a353-b1925b30c85a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90905,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_6cf7150ce132dde39ddeb120f61f1eb5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72cc8870-ae59-5f25-a353-b1925b30c85a/72cc8870-ae59-5f25-a353-b1925b30c85a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70526,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_b5685741e885ea7c14e69dc2f962a158.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72cc8870-ae59-5f25-a353-b1925b30c85a/72cc8870-ae59-5f25-a353-b1925b30c85a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69703,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_a1e900b5a170ad2396b7a396aba87786.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72cc8870-ae59-5f25-a353-b1925b30c85a/72cc8870-ae59-5f25-a353-b1925b30c85a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76377,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_0d11e271ec444ea21270c2c1d62f0f14.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72cc8870-ae59-5f25-a353-b1925b30c85a/72cc8870-ae59-5f25-a353-b1925b30c85a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84493,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_f20f9df9c52a8f6d0d659a30a394e967.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72cc8870-ae59-5f25-a353-b1925b30c85a/72cc8870-ae59-5f25-a353-b1925b30c85a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97986,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_fe3eac5172d763134017ddeb5d525908.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72cc8870-ae59-5f25-a353-b1925b30c85a/72cc8870-ae59-5f25-a353-b1925b30c85a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99395,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_ea34c1a25d3155e4ecd78b6d4be34e9b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72cc8870-ae59-5f25-a353-b1925b30c85a/72cc8870-ae59-5f25-a353-b1925b30c85a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95333,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_d737c96b5789c0300ed988e24c58e71d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72cc8870-ae59-5f25-a353-b1925b30c85a/72cc8870-ae59-5f25-a353-b1925b30c85a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82241,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_fb85dff84584244e2df873ebc17af930.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72cc8870-ae59-5f25-a353-b1925b30c85a/72cc8870-ae59-5f25-a353-b1925b30c85a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72815,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/ff/e2ffe8ebde7579052a5c94921b876f46/pa/SB83788_d48f851ea03a5a7b241d1b259009a8a8.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2006-12-20',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Highline',
'transmission': 'manual',
'trim': 'Highline',
'year': 2006}
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SB83788%27 HTTP/1.1" 200 None
2026-03-30 11:26:22 [auto1.es] INFO: Saving data for SB83788: {'created_time': 1774869982.748898, 'last_price_update_time': 1774869982.748912, 'auction_closing_time': 1774970878.0}
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SB83788') HTTP/1.1" 204 0
2026-03-30 11:26:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_4d90dc15cef743b8912c3ca9c06fb968.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a43ffd0>
2026-03-30 11:26:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53fa9d2f-2c77-594a-a1ef-239816f3065d/53fa9d2f-2c77-594a-a1ef-239816f3065d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fd1%252F4dd1ba1d67f5b8b2416b4bf9d9eb33ce%252Fpa%252FBK85695_4d90dc15cef743b8912c3ca9c06fb968.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_4d90dc15cef743b8912c3ca9c06fb968.jpg saved to cache
2026-03-30 11:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 53fa9d2f-2c77-594a-a1ef-239816f3065d
2026-03-30 11:26:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_ca1f73e291d0cbb979f03053ee35a915.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3ceed0>
2026-03-30 11:26:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53fa9d2f-2c77-594a-a1ef-239816f3065d/53fa9d2f-2c77-594a-a1ef-239816f3065d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:26:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fd1%252F4dd1ba1d67f5b8b2416b4bf9d9eb33ce%252Fpa%252FBK85695_ca1f73e291d0cbb979f03053ee35a915.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_ca1f73e291d0cbb979f03053ee35a915.jpg saved to cache
2026-03-30 11:26:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 53fa9d2f-2c77-594a-a1ef-239816f3065d
2026-03-30 11:26:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_d3a606e3528386f6a39c8fdc1fa9b946.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060eb7a10>
2026-03-30 11:26:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53fa9d2f-2c77-594a-a1ef-239816f3065d/53fa9d2f-2c77-594a-a1ef-239816f3065d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:26:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fd1%252F4dd1ba1d67f5b8b2416b4bf9d9eb33ce%252Fpa%252FBK85695_d3a606e3528386f6a39c8fdc1fa9b946.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_d3a606e3528386f6a39c8fdc1fa9b946.jpg saved to cache
2026-03-30 11:26:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 53fa9d2f-2c77-594a-a1ef-239816f3065d
2026-03-30 11:26:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_bd4bf99433d3072fa3fd149f2df1665d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4e1910>
2026-03-30 11:26:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53fa9d2f-2c77-594a-a1ef-239816f3065d/53fa9d2f-2c77-594a-a1ef-239816f3065d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:26:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fd1%252F4dd1ba1d67f5b8b2416b4bf9d9eb33ce%252Fpa%252FBK85695_bd4bf99433d3072fa3fd149f2df1665d.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_bd4bf99433d3072fa3fd149f2df1665d.jpg saved to cache
2026-03-30 11:26:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 53fa9d2f-2c77-594a-a1ef-239816f3065d
2026-03-30 11:26:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_f900c64b2ec38271aaa098f64de022fe.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a49e350>
2026-03-30 11:26:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53fa9d2f-2c77-594a-a1ef-239816f3065d/53fa9d2f-2c77-594a-a1ef-239816f3065d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:26:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fd1%252F4dd1ba1d67f5b8b2416b4bf9d9eb33ce%252Fpa%252FBK85695_f900c64b2ec38271aaa098f64de022fe.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_f900c64b2ec38271aaa098f64de022fe.jpg saved to cache
2026-03-30 11:26:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 53fa9d2f-2c77-594a-a1ef-239816f3065d
2026-03-30 11:26:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_fbbe574c498befa210b9091ebda904ba.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060fb1150>
2026-03-30 11:26:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53fa9d2f-2c77-594a-a1ef-239816f3065d/53fa9d2f-2c77-594a-a1ef-239816f3065d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:26:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fd1%252F4dd1ba1d67f5b8b2416b4bf9d9eb33ce%252Fpa%252FBK85695_fbbe574c498befa210b9091ebda904ba.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_fbbe574c498befa210b9091ebda904ba.jpg saved to cache
2026-03-30 11:26:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 53fa9d2f-2c77-594a-a1ef-239816f3065d
2026-03-30 11:26:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_717c2ff412c1141ee3ae5ca0a4267286.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4e2350>
2026-03-30 11:26:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53fa9d2f-2c77-594a-a1ef-239816f3065d/53fa9d2f-2c77-594a-a1ef-239816f3065d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:26:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fd1%252F4dd1ba1d67f5b8b2416b4bf9d9eb33ce%252Fpa%252FBK85695_717c2ff412c1141ee3ae5ca0a4267286.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_717c2ff412c1141ee3ae5ca0a4267286.jpg saved to cache
2026-03-30 11:26:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 53fa9d2f-2c77-594a-a1ef-239816f3065d
2026-03-30 11:26:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_bd4083d8bc917121ac11bd39e965a95a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_6fc0c8e4979d40741460613701afbd4c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3a08d0>
2026-03-30 11:26:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53fa9d2f-2c77-594a-a1ef-239816f3065d/53fa9d2f-2c77-594a-a1ef-239816f3065d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:26:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fd1%252F4dd1ba1d67f5b8b2416b4bf9d9eb33ce%252Fpa%252FBK85695_bd4083d8bc917121ac11bd39e965a95a.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_bd4083d8bc917121ac11bd39e965a95a.jpg saved to cache
2026-03-30 11:26:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 53fa9d2f-2c77-594a-a1ef-239816f3065d
2026-03-30 11:26:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3a0690>
2026-03-30 11:26:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53fa9d2f-2c77-594a-a1ef-239816f3065d/53fa9d2f-2c77-594a-a1ef-239816f3065d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:26:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fd1%252F4dd1ba1d67f5b8b2416b4bf9d9eb33ce%252Fpa%252FBK85695_6fc0c8e4979d40741460613701afbd4c.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_6fc0c8e4979d40741460613701afbd4c.jpg saved to cache
2026-03-30 11:26:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 53fa9d2f-2c77-594a-a1ef-239816f3065d
2026-03-30 11:26:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 53fa9d2f-2c77-594a-a1ef-239816f3065d, skipping ID generation
2026-03-30 11:26:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53fa9d2f-2c77-594a-a1ef-239816f3065d with scrape type 1
2026-03-30 11:26:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 53fa9d2f-2c77-594a-a1ef-239816f3065d sending to next pipeline
2026-03-30 11:26:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 53fa9d2f-2c77-594a-a1ef-239816f3065d, identifier: BK85695
2026-03-30 11:26:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 53fa9d2f-2c77-594a-a1ef-239816f3065d with identifier: BK85695
2026-03-30 11:26:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 53fa9d2f-2c77-594a-a1ef-239816f3065d with identifier: BK85695
2026-03-30 11:26:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 53fa9d2f-2c77-594a-a1ef-239816f3065d with identifier: BK85695 to the API
2026-03-30 11:26:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_6fc0c8e4979d40741460613701afbd4c.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '0.9L',
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:26:53Z',
'fuel_type': 'petrol',
'id': '53fa9d2f-2c77-594a-a1ef-239816f3065d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK85695',
'listing': 'auction',
'location': 'ES, Castelló de la Plana',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 72760,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53fa9d2f-2c77-594a-a1ef-239816f3065d/53fa9d2f-2c77-594a-a1ef-239816f3065d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110182,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_6fc0c8e4979d40741460613701afbd4c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53fa9d2f-2c77-594a-a1ef-239816f3065d/53fa9d2f-2c77-594a-a1ef-239816f3065d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103130,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_bd4083d8bc917121ac11bd39e965a95a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53fa9d2f-2c77-594a-a1ef-239816f3065d/53fa9d2f-2c77-594a-a1ef-239816f3065d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93719,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_717c2ff412c1141ee3ae5ca0a4267286.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53fa9d2f-2c77-594a-a1ef-239816f3065d/53fa9d2f-2c77-594a-a1ef-239816f3065d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86199,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_fbbe574c498befa210b9091ebda904ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53fa9d2f-2c77-594a-a1ef-239816f3065d/53fa9d2f-2c77-594a-a1ef-239816f3065d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92845,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_f900c64b2ec38271aaa098f64de022fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53fa9d2f-2c77-594a-a1ef-239816f3065d/53fa9d2f-2c77-594a-a1ef-239816f3065d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94783,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_bd4bf99433d3072fa3fd149f2df1665d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53fa9d2f-2c77-594a-a1ef-239816f3065d/53fa9d2f-2c77-594a-a1ef-239816f3065d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78262,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_d3a606e3528386f6a39c8fdc1fa9b946.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53fa9d2f-2c77-594a-a1ef-239816f3065d/53fa9d2f-2c77-594a-a1ef-239816f3065d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96515,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_ca1f73e291d0cbb979f03053ee35a915.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53fa9d2f-2c77-594a-a1ef-239816f3065d/53fa9d2f-2c77-594a-a1ef-239816f3065d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107691,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_4d90dc15cef743b8912c3ca9c06fb968.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53fa9d2f-2c77-594a-a1ef-239816f3065d/53fa9d2f-2c77-594a-a1ef-239816f3065d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87236,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/d1/4dd1ba1d67f5b8b2416b4bf9d9eb33ce/pa/BK85695_202001dde8b1210ba1a5c36de1e27d18.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-11-19',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Sandero 0.9 TCe SL Xplore',
'transmission': 'manual',
'trim': 'SL Xplore',
'year': 2019}
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK85695%27 HTTP/1.1" 200 None
2026-03-30 11:26:27 [auto1.es] INFO: Saving data for BK85695: {'created_time': 1774869987.083787, 'last_price_update_time': 1774869987.083798, 'auction_closing_time': 1774970813.0}
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BK85695') HTTP/1.1" 204 0
2026-03-30 11:26:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MB25535/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/16/32167e987165e879829b53abbdc51232/pa/YZ56503_724f59c215164ed4f8af94f414504240.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ae9e990>
2026-03-30 11:26:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189ccad6-5211-5b15-970d-79e60f0c00fc/189ccad6-5211-5b15-970d-79e60f0c00fc_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F16%252F32167e987165e879829b53abbdc51232%252Fpa%252FYZ56503_724f59c215164ed4f8af94f414504240.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/16/32167e987165e879829b53abbdc51232/pa/YZ56503_724f59c215164ed4f8af94f414504240.jpg saved to cache
2026-03-30 11:26:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 189ccad6-5211-5b15-970d-79e60f0c00fc
2026-03-30 11:26:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:26:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DA85741> (referer: https://www.auto1.com/v1/car-details-view/DA85741/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d224c936-ff22-56cb-a131-fe9e27d8e036 with identifier: DA85741
2026-03-30 11:26:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d224c936-ff22-56cb-a131-fe9e27d8e036 with scrape type 1
2026-03-30 11:26:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d224c936-ff22-56cb-a131-fe9e27d8e036
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fb1%252Fcbb14418ae4cd3076c7dfc32f44b3f45%252Fpa%252FDA85741_8dd6a517adf037b58e7e5f973d3d8de6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/b1/cbb14418ae4cd3076c7dfc32f44b3f45/pa/DA85741_8dd6a517adf037b58e7e5f973d3d8de6.jpg already downloaded
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fb1%252Fcbb14418ae4cd3076c7dfc32f44b3f45%252Fpa%252FDA85741_fcbbee041ab353fe43759b8c3de40fba.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/b1/cbb14418ae4cd3076c7dfc32f44b3f45/pa/DA85741_fcbbee041ab353fe43759b8c3de40fba.jpg already downloaded
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fb1%252Fcbb14418ae4cd3076c7dfc32f44b3f45%252Fpa%252FDA85741_570130a7617872325dfacfc50f83bffa.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/b1/cbb14418ae4cd3076c7dfc32f44b3f45/pa/DA85741_570130a7617872325dfacfc50f83bffa.jpg already downloaded
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fb1%252Fcbb14418ae4cd3076c7dfc32f44b3f45%252Fpa%252FDA85741_4e679aec9df74762006fc8ab20439725.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/b1/cbb14418ae4cd3076c7dfc32f44b3f45/pa/DA85741_4e679aec9df74762006fc8ab20439725.jpg already downloaded
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fb1%252Fcbb14418ae4cd3076c7dfc32f44b3f45%252Fpa%252FDA85741_a2046dbe963c65cb49947f64f3d418e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/b1/cbb14418ae4cd3076c7dfc32f44b3f45/pa/DA85741_a2046dbe963c65cb49947f64f3d418e2.jpg already downloaded
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fb1%252Fcbb14418ae4cd3076c7dfc32f44b3f45%252Fpa%252FDA85741_e55ad79f3b180b670d86d4dcdf76acd2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/b1/cbb14418ae4cd3076c7dfc32f44b3f45/pa/DA85741_e55ad79f3b180b670d86d4dcdf76acd2.jpg already downloaded
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fb1%252Fcbb14418ae4cd3076c7dfc32f44b3f45%252Fpa%252FDA85741_c86ac371f0647a357dc7b99a16587a64.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/b1/cbb14418ae4cd3076c7dfc32f44b3f45/pa/DA85741_c86ac371f0647a357dc7b99a16587a64.jpg already downloaded
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fb1%252Fcbb14418ae4cd3076c7dfc32f44b3f45%252Fpa%252FDA85741_320c136ed9a4a868d2d6500351a3f766.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/b1/cbb14418ae4cd3076c7dfc32f44b3f45/pa/DA85741_320c136ed9a4a868d2d6500351a3f766.jpg already downloaded
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fb1%252Fcbb14418ae4cd3076c7dfc32f44b3f45%252Fpa%252FDA85741_3cdb7ce9ac7def86d28d96d179983346.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/b1/cbb14418ae4cd3076c7dfc32f44b3f45/pa/DA85741_3cdb7ce9ac7def86d28d96d179983346.jpg already downloaded
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fb1%252Fcbb14418ae4cd3076c7dfc32f44b3f45%252Fpa%252FDA85741_d80c5d9853b57fc4ccb70e76ff2212bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/b1/cbb14418ae4cd3076c7dfc32f44b3f45/pa/DA85741_d80c5d9853b57fc4ccb70e76ff2212bd.jpg already downloaded
2026-03-30 11:26:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d224c936-ff22-56cb-a131-fe9e27d8e036, identifier: DA85741
2026-03-30 11:26:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d224c936-ff22-56cb-a131-fe9e27d8e036 with identifier: DA85741
2026-03-30 11:26:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d224c936-ff22-56cb-a131-fe9e27d8e036 with identifier: DA85741
2026-03-30 11:26:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d224c936-ff22-56cb-a131-fe9e27d8e036 with identifier: DA85741 to the API
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DA85741>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 105,
'expiration_date': '2026-03-31T15:57:05Z',
'fuel_type': 'diesel',
'id': 'd224c936-ff22-56cb-a131-fe9e27d8e036',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA85741',
'listing': 'auction',
'location': 'ES, Sevilla',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 157915,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgcb/b1/cbb14418ae4cd3076c7dfc32f44b3f45/pa/DA85741_8dd6a517adf037b58e7e5f973d3d8de6.jpg',
'https://img-pa.auto1.com/imgcb/b1/cbb14418ae4cd3076c7dfc32f44b3f45/pa/DA85741_fcbbee041ab353fe43759b8c3de40fba.jpg',
'https://img-pa.auto1.com/imgcb/b1/cbb14418ae4cd3076c7dfc32f44b3f45/pa/DA85741_570130a7617872325dfacfc50f83bffa.jpg',
'https://img-pa.auto1.com/imgcb/b1/cbb14418ae4cd3076c7dfc32f44b3f45/pa/DA85741_4e679aec9df74762006fc8ab20439725.jpg',
'https://img-pa.auto1.com/imgcb/b1/cbb14418ae4cd3076c7dfc32f44b3f45/pa/DA85741_a2046dbe963c65cb49947f64f3d418e2.jpg',
'https://img-pa.auto1.com/imgcb/b1/cbb14418ae4cd3076c7dfc32f44b3f45/pa/DA85741_e55ad79f3b180b670d86d4dcdf76acd2.jpg',
'https://img-pa.auto1.com/imgcb/b1/cbb14418ae4cd3076c7dfc32f44b3f45/pa/DA85741_c86ac371f0647a357dc7b99a16587a64.jpg',
'https://img-pa.auto1.com/imgcb/b1/cbb14418ae4cd3076c7dfc32f44b3f45/pa/DA85741_320c136ed9a4a868d2d6500351a3f766.jpg',
'https://img-pa.auto1.com/imgcb/b1/cbb14418ae4cd3076c7dfc32f44b3f45/pa/DA85741_3cdb7ce9ac7def86d28d96d179983346.jpg',
'https://img-pa.auto1.com/imgcb/b1/cbb14418ae4cd3076c7dfc32f44b3f45/pa/DA85741_d80c5d9853b57fc4ccb70e76ff2212bd.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d224c936-ff22-56cb-a131-fe9e27d8e036/d224c936-ff22-56cb-a131-fe9e27d8e036_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96476,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcb/b1/cbb14418ae4cd3076c7dfc32f44b3f45/pa/DA85741_8dd6a517adf037b58e7e5f973d3d8de6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d224c936-ff22-56cb-a131-fe9e27d8e036/d224c936-ff22-56cb-a131-fe9e27d8e036_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91853,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcb/b1/cbb14418ae4cd3076c7dfc32f44b3f45/pa/DA85741_fcbbee041ab353fe43759b8c3de40fba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d224c936-ff22-56cb-a131-fe9e27d8e036/d224c936-ff22-56cb-a131-fe9e27d8e036_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99840,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcb/b1/cbb14418ae4cd3076c7dfc32f44b3f45/pa/DA85741_570130a7617872325dfacfc50f83bffa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d224c936-ff22-56cb-a131-fe9e27d8e036/d224c936-ff22-56cb-a131-fe9e27d8e036_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87214,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcb/b1/cbb14418ae4cd3076c7dfc32f44b3f45/pa/DA85741_4e679aec9df74762006fc8ab20439725.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d224c936-ff22-56cb-a131-fe9e27d8e036/d224c936-ff22-56cb-a131-fe9e27d8e036_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84448,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcb/b1/cbb14418ae4cd3076c7dfc32f44b3f45/pa/DA85741_a2046dbe963c65cb49947f64f3d418e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d224c936-ff22-56cb-a131-fe9e27d8e036/d224c936-ff22-56cb-a131-fe9e27d8e036_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110814,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcb/b1/cbb14418ae4cd3076c7dfc32f44b3f45/pa/DA85741_e55ad79f3b180b670d86d4dcdf76acd2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d224c936-ff22-56cb-a131-fe9e27d8e036/d224c936-ff22-56cb-a131-fe9e27d8e036_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79723,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcb/b1/cbb14418ae4cd3076c7dfc32f44b3f45/pa/DA85741_c86ac371f0647a357dc7b99a16587a64.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d224c936-ff22-56cb-a131-fe9e27d8e036/d224c936-ff22-56cb-a131-fe9e27d8e036_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97353,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcb/b1/cbb14418ae4cd3076c7dfc32f44b3f45/pa/DA85741_320c136ed9a4a868d2d6500351a3f766.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d224c936-ff22-56cb-a131-fe9e27d8e036/d224c936-ff22-56cb-a131-fe9e27d8e036_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85587,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcb/b1/cbb14418ae4cd3076c7dfc32f44b3f45/pa/DA85741_3cdb7ce9ac7def86d28d96d179983346.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d224c936-ff22-56cb-a131-fe9e27d8e036/d224c936-ff22-56cb-a131-fe9e27d8e036_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107607,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcb/b1/cbb14418ae4cd3076c7dfc32f44b3f45/pa/DA85741_d80c5d9853b57fc4ccb70e76ff2212bd.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-06-01',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VI 1.6 TDI Advance BlueMotion',
'transmission': 'manual',
'trim': 'Advance BlueMotion',
'year': 2010}
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DA85741%27 HTTP/1.1" 200 None
2026-03-30 11:26:29 [auto1.es] INFO: Saving data for DA85741: {'created_time': 1774869989.888824, 'last_price_update_time': 1774869989.888835, 'auction_closing_time': 1774972625.0}
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DA85741') HTTP/1.1" 204 0
2026-03-30 11:26:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/16/32167e987165e879829b53abbdc51232/pa/YZ56503_70deb55d339e5777824966e6cc8ed820.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/16/32167e987165e879829b53abbdc51232/pa/YZ56503_d0af76ff10796699354d610ad8d04f5f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad1ebd0>
2026-03-30 11:26:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189ccad6-5211-5b15-970d-79e60f0c00fc/189ccad6-5211-5b15-970d-79e60f0c00fc_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:26:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F16%252F32167e987165e879829b53abbdc51232%252Fpa%252FYZ56503_70deb55d339e5777824966e6cc8ed820.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/16/32167e987165e879829b53abbdc51232/pa/YZ56503_70deb55d339e5777824966e6cc8ed820.jpg saved to cache
2026-03-30 11:26:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 189ccad6-5211-5b15-970d-79e60f0c00fc
2026-03-30 11:26:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060feb350>
2026-03-30 11:26:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189ccad6-5211-5b15-970d-79e60f0c00fc/189ccad6-5211-5b15-970d-79e60f0c00fc_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:26:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F16%252F32167e987165e879829b53abbdc51232%252Fpa%252FYZ56503_d0af76ff10796699354d610ad8d04f5f.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/16/32167e987165e879829b53abbdc51232/pa/YZ56503_d0af76ff10796699354d610ad8d04f5f.jpg saved to cache
2026-03-30 11:26:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 189ccad6-5211-5b15-970d-79e60f0c00fc
2026-03-30 11:26:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 189ccad6-5211-5b15-970d-79e60f0c00fc, skipping ID generation
2026-03-30 11:26:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 189ccad6-5211-5b15-970d-79e60f0c00fc with scrape type 1
2026-03-30 11:26:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 189ccad6-5211-5b15-970d-79e60f0c00fc sending to next pipeline
2026-03-30 11:26:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 189ccad6-5211-5b15-970d-79e60f0c00fc, identifier: YZ56503
2026-03-30 11:26:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 189ccad6-5211-5b15-970d-79e60f0c00fc with identifier: YZ56503
2026-03-30 11:26:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 189ccad6-5211-5b15-970d-79e60f0c00fc with identifier: YZ56503
2026-03-30 11:26:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 189ccad6-5211-5b15-970d-79e60f0c00fc with identifier: YZ56503 to the API
2026-03-30 11:26:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img32/16/32167e987165e879829b53abbdc51232/pa/YZ56503_d0af76ff10796699354d610ad8d04f5f.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.6L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:33:53Z',
'fuel_type': 'petrol',
'id': '189ccad6-5211-5b15-970d-79e60f0c00fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ56503',
'listing': 'auction',
'location': 'ES, Castelló de la Plana',
'make': 'Peugeot',
'model': '308',
'odometer': 156596,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189ccad6-5211-5b15-970d-79e60f0c00fc/189ccad6-5211-5b15-970d-79e60f0c00fc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115462,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img32/16/32167e987165e879829b53abbdc51232/pa/YZ56503_d0af76ff10796699354d610ad8d04f5f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189ccad6-5211-5b15-970d-79e60f0c00fc/189ccad6-5211-5b15-970d-79e60f0c00fc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 124983,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img32/16/32167e987165e879829b53abbdc51232/pa/YZ56503_70deb55d339e5777824966e6cc8ed820.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189ccad6-5211-5b15-970d-79e60f0c00fc/189ccad6-5211-5b15-970d-79e60f0c00fc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85591,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img32/16/32167e987165e879829b53abbdc51232/pa/YZ56503_724f59c215164ed4f8af94f414504240.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189ccad6-5211-5b15-970d-79e60f0c00fc/189ccad6-5211-5b15-970d-79e60f0c00fc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81637,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img32/16/32167e987165e879829b53abbdc51232/pa/YZ56503_5a02242227ae2b382e747df7b61fb058.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189ccad6-5211-5b15-970d-79e60f0c00fc/189ccad6-5211-5b15-970d-79e60f0c00fc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69700,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img32/16/32167e987165e879829b53abbdc51232/pa/YZ56503_687a551b1e4f0444917e571c6699ce2a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189ccad6-5211-5b15-970d-79e60f0c00fc/189ccad6-5211-5b15-970d-79e60f0c00fc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96380,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img32/16/32167e987165e879829b53abbdc51232/pa/YZ56503_30a04197b3db12d0bc21610d617b78eb.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-01-11',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.6 THP Sport Plus',
'transmission': 'manual',
'trim': 'Sport Plus',
'year': 2009}
2026-03-30 11:26:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YZ56503%27 HTTP/1.1" 200 None
2026-03-30 11:26:30 [auto1.es] INFO: Saving data for YZ56503: {'created_time': 1774869990.59868, 'last_price_update_time': 1774869990.598692, 'auction_closing_time': 1774971233.0}
2026-03-30 11:26:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YZ56503') HTTP/1.1" 204 0
2026-03-30 11:26:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RN47557/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XX24085> (referer: https://www.auto1.com/v1/car-details-view/XX24085/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c1b8763-817b-5d40-b9d4-bd21022dc1bf with identifier: XX24085
2026-03-30 11:26:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c1b8763-817b-5d40-b9d4-bd21022dc1bf with scrape type 1
2026-03-30 11:26:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 8c1b8763-817b-5d40-b9d4-bd21022dc1bf
2026-03-30 11:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fa8%252Faaa844eef7a952e7ac62f7569330b5d1%252Fpa%252FXX24085_f8dd0e69715da5091f4d30844764a5c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/a8/aaa844eef7a952e7ac62f7569330b5d1/pa/XX24085_f8dd0e69715da5091f4d30844764a5c1.jpg not downloaded yet
2026-03-30 11:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fa8%252Faaa844eef7a952e7ac62f7569330b5d1%252Fpa%252FXX24085_946724d0186cfc785b412e3fcff51edb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/a8/aaa844eef7a952e7ac62f7569330b5d1/pa/XX24085_946724d0186cfc785b412e3fcff51edb.jpg not downloaded yet
2026-03-30 11:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fa8%252Faaa844eef7a952e7ac62f7569330b5d1%252Fpa%252FXX24085_d097a0f447c01c22e071b66951343a39.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/a8/aaa844eef7a952e7ac62f7569330b5d1/pa/XX24085_d097a0f447c01c22e071b66951343a39.jpg not downloaded yet
2026-03-30 11:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fa8%252Faaa844eef7a952e7ac62f7569330b5d1%252Fpa%252FXX24085_ff3fd9e741b55aa2615da6a0eef1e2d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/a8/aaa844eef7a952e7ac62f7569330b5d1/pa/XX24085_ff3fd9e741b55aa2615da6a0eef1e2d6.jpg not downloaded yet
2026-03-30 11:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fa8%252Faaa844eef7a952e7ac62f7569330b5d1%252Fpa%252FXX24085_b2ffc00ec65409980eb17069a2315f7c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/a8/aaa844eef7a952e7ac62f7569330b5d1/pa/XX24085_b2ffc00ec65409980eb17069a2315f7c.jpg not downloaded yet
2026-03-30 11:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fa8%252Faaa844eef7a952e7ac62f7569330b5d1%252Fpa%252FXX24085_352ad80261f6a8a0045a835919164165.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/a8/aaa844eef7a952e7ac62f7569330b5d1/pa/XX24085_352ad80261f6a8a0045a835919164165.jpg not downloaded yet
2026-03-30 11:26:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/a8/aaa844eef7a952e7ac62f7569330b5d1/pa/XX24085_f8dd0e69715da5091f4d30844764a5c1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3cf6d0>
2026-03-30 11:26:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c1b8763-817b-5d40-b9d4-bd21022dc1bf/8c1b8763-817b-5d40-b9d4-bd21022dc1bf_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fa8%252Faaa844eef7a952e7ac62f7569330b5d1%252Fpa%252FXX24085_f8dd0e69715da5091f4d30844764a5c1.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/a8/aaa844eef7a952e7ac62f7569330b5d1/pa/XX24085_f8dd0e69715da5091f4d30844764a5c1.jpg saved to cache
2026-03-30 11:26:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8c1b8763-817b-5d40-b9d4-bd21022dc1bf
2026-03-30 11:26:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/a8/aaa844eef7a952e7ac62f7569330b5d1/pa/XX24085_946724d0186cfc785b412e3fcff51edb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/a8/aaa844eef7a952e7ac62f7569330b5d1/pa/XX24085_352ad80261f6a8a0045a835919164165.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3a1310>
2026-03-30 11:26:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c1b8763-817b-5d40-b9d4-bd21022dc1bf/8c1b8763-817b-5d40-b9d4-bd21022dc1bf_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fa8%252Faaa844eef7a952e7ac62f7569330b5d1%252Fpa%252FXX24085_946724d0186cfc785b412e3fcff51edb.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/a8/aaa844eef7a952e7ac62f7569330b5d1/pa/XX24085_946724d0186cfc785b412e3fcff51edb.jpg saved to cache
2026-03-30 11:26:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8c1b8763-817b-5d40-b9d4-bd21022dc1bf
2026-03-30 11:26:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05aed5190>
2026-03-30 11:26:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c1b8763-817b-5d40-b9d4-bd21022dc1bf/8c1b8763-817b-5d40-b9d4-bd21022dc1bf_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fa8%252Faaa844eef7a952e7ac62f7569330b5d1%252Fpa%252FXX24085_352ad80261f6a8a0045a835919164165.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/a8/aaa844eef7a952e7ac62f7569330b5d1/pa/XX24085_352ad80261f6a8a0045a835919164165.jpg saved to cache
2026-03-30 11:26:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8c1b8763-817b-5d40-b9d4-bd21022dc1bf
2026-03-30 11:26:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/a8/aaa844eef7a952e7ac62f7569330b5d1/pa/XX24085_b2ffc00ec65409980eb17069a2315f7c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/a8/aaa844eef7a952e7ac62f7569330b5d1/pa/XX24085_ff3fd9e741b55aa2615da6a0eef1e2d6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060feac10>
2026-03-30 11:26:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c1b8763-817b-5d40-b9d4-bd21022dc1bf/8c1b8763-817b-5d40-b9d4-bd21022dc1bf_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fa8%252Faaa844eef7a952e7ac62f7569330b5d1%252Fpa%252FXX24085_b2ffc00ec65409980eb17069a2315f7c.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/a8/aaa844eef7a952e7ac62f7569330b5d1/pa/XX24085_b2ffc00ec65409980eb17069a2315f7c.jpg saved to cache
2026-03-30 11:26:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8c1b8763-817b-5d40-b9d4-bd21022dc1bf
2026-03-30 11:26:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4a6e10>
2026-03-30 11:26:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c1b8763-817b-5d40-b9d4-bd21022dc1bf/8c1b8763-817b-5d40-b9d4-bd21022dc1bf_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fa8%252Faaa844eef7a952e7ac62f7569330b5d1%252Fpa%252FXX24085_ff3fd9e741b55aa2615da6a0eef1e2d6.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/a8/aaa844eef7a952e7ac62f7569330b5d1/pa/XX24085_ff3fd9e741b55aa2615da6a0eef1e2d6.jpg saved to cache
2026-03-30 11:26:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8c1b8763-817b-5d40-b9d4-bd21022dc1bf
2026-03-30 11:26:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/a8/aaa844eef7a952e7ac62f7569330b5d1/pa/XX24085_d097a0f447c01c22e071b66951343a39.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a43eb90>
2026-03-30 11:26:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c1b8763-817b-5d40-b9d4-bd21022dc1bf/8c1b8763-817b-5d40-b9d4-bd21022dc1bf_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fa8%252Faaa844eef7a952e7ac62f7569330b5d1%252Fpa%252FXX24085_d097a0f447c01c22e071b66951343a39.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/a8/aaa844eef7a952e7ac62f7569330b5d1/pa/XX24085_d097a0f447c01c22e071b66951343a39.jpg saved to cache
2026-03-30 11:26:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8c1b8763-817b-5d40-b9d4-bd21022dc1bf
2026-03-30 11:26:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8c1b8763-817b-5d40-b9d4-bd21022dc1bf, skipping ID generation
2026-03-30 11:26:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c1b8763-817b-5d40-b9d4-bd21022dc1bf with scrape type 1
2026-03-30 11:26:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8c1b8763-817b-5d40-b9d4-bd21022dc1bf sending to next pipeline
2026-03-30 11:26:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8c1b8763-817b-5d40-b9d4-bd21022dc1bf, identifier: XX24085
2026-03-30 11:26:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8c1b8763-817b-5d40-b9d4-bd21022dc1bf with identifier: XX24085
2026-03-30 11:26:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8c1b8763-817b-5d40-b9d4-bd21022dc1bf with identifier: XX24085
2026-03-30 11:26:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8c1b8763-817b-5d40-b9d4-bd21022dc1bf with identifier: XX24085 to the API
2026-03-30 11:26:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaa/a8/aaa844eef7a952e7ac62f7569330b5d1/pa/XX24085_d097a0f447c01c22e071b66951343a39.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 3',
'engine': '1.9L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:17:15Z',
'fuel_type': 'diesel',
'id': '8c1b8763-817b-5d40-b9d4-bd21022dc1bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX24085',
'listing': 'auction',
'location': 'ES, Montcada i Reixac',
'make': 'Opel',
'model': 'Zafira',
'odometer': 180171,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1b8763-817b-5d40-b9d4-bd21022dc1bf/8c1b8763-817b-5d40-b9d4-bd21022dc1bf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81519,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/a8/aaa844eef7a952e7ac62f7569330b5d1/pa/XX24085_f8dd0e69715da5091f4d30844764a5c1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1b8763-817b-5d40-b9d4-bd21022dc1bf/8c1b8763-817b-5d40-b9d4-bd21022dc1bf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83085,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/a8/aaa844eef7a952e7ac62f7569330b5d1/pa/XX24085_946724d0186cfc785b412e3fcff51edb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1b8763-817b-5d40-b9d4-bd21022dc1bf/8c1b8763-817b-5d40-b9d4-bd21022dc1bf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78532,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/a8/aaa844eef7a952e7ac62f7569330b5d1/pa/XX24085_d097a0f447c01c22e071b66951343a39.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1b8763-817b-5d40-b9d4-bd21022dc1bf/8c1b8763-817b-5d40-b9d4-bd21022dc1bf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64229,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/a8/aaa844eef7a952e7ac62f7569330b5d1/pa/XX24085_ff3fd9e741b55aa2615da6a0eef1e2d6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1b8763-817b-5d40-b9d4-bd21022dc1bf/8c1b8763-817b-5d40-b9d4-bd21022dc1bf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51659,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/a8/aaa844eef7a952e7ac62f7569330b5d1/pa/XX24085_b2ffc00ec65409980eb17069a2315f7c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1b8763-817b-5d40-b9d4-bd21022dc1bf/8c1b8763-817b-5d40-b9d4-bd21022dc1bf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92276,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/a8/aaa844eef7a952e7ac62f7569330b5d1/pa/XX24085_352ad80261f6a8a0045a835919164165.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2006-03-13',
'seats_number': 7,
'seller_name': None,
'title': 'Opel Zafira 1.9 CDTI Enjoy',
'transmission': 'manual',
'trim': 'Enjoy',
'year': 2006}
2026-03-30 11:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XX24085%27 HTTP/1.1" 200 None
2026-03-30 11:26:37 [auto1.es] INFO: Saving data for XX24085: {'created_time': 1774869997.28884, 'last_price_update_time': 1774869997.288849, 'auction_closing_time': 1774970235.0}
2026-03-30 11:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XX24085') HTTP/1.1" 204 0
2026-03-30 11:26:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YJ93473> (referer: https://www.auto1.com/v1/car-details-view/YJ93473/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b1e4d1c-4aa9-56eb-898e-8254b64ca9bd with identifier: YJ93473
2026-03-30 11:26:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b1e4d1c-4aa9-56eb-898e-8254b64ca9bd with scrape type 1
2026-03-30 11:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4b1e4d1c-4aa9-56eb-898e-8254b64ca9bd
2026-03-30 11:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F7c%252F6f7ca4a2db3eead15f01434e1c9131dd%252Fpa%252FYJ93473_9f1086a54cc1fd37120041ca705028b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7c/6f7ca4a2db3eead15f01434e1c9131dd/pa/YJ93473_9f1086a54cc1fd37120041ca705028b7.jpg already downloaded
2026-03-30 11:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F7c%252F6f7ca4a2db3eead15f01434e1c9131dd%252Fpa%252FYJ93473_f6351bfabef59a5678f720556a0021c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7c/6f7ca4a2db3eead15f01434e1c9131dd/pa/YJ93473_f6351bfabef59a5678f720556a0021c2.jpg already downloaded
2026-03-30 11:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F7c%252F6f7ca4a2db3eead15f01434e1c9131dd%252Fpa%252FYJ93473_9d3ad97dcc4b90c10fae0c96b09ee9a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7c/6f7ca4a2db3eead15f01434e1c9131dd/pa/YJ93473_9d3ad97dcc4b90c10fae0c96b09ee9a6.jpg already downloaded
2026-03-30 11:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F7c%252F6f7ca4a2db3eead15f01434e1c9131dd%252Fpa%252FYJ93473_2ff6f102c5d6a99c5aa6dba3f8869fa5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7c/6f7ca4a2db3eead15f01434e1c9131dd/pa/YJ93473_2ff6f102c5d6a99c5aa6dba3f8869fa5.jpg already downloaded
2026-03-30 11:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F7c%252F6f7ca4a2db3eead15f01434e1c9131dd%252Fpa%252FYJ93473_66a3c8f4bd360239076de7bf9b43b893.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7c/6f7ca4a2db3eead15f01434e1c9131dd/pa/YJ93473_66a3c8f4bd360239076de7bf9b43b893.jpg already downloaded
2026-03-30 11:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F7c%252F6f7ca4a2db3eead15f01434e1c9131dd%252Fpa%252FYJ93473_9a0fd1f6f39281dff724bfd693025865.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7c/6f7ca4a2db3eead15f01434e1c9131dd/pa/YJ93473_9a0fd1f6f39281dff724bfd693025865.jpg already downloaded
2026-03-30 11:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F7c%252F6f7ca4a2db3eead15f01434e1c9131dd%252Fpa%252FYJ93473_e9498822ad8b05cbdcb89ab0ad2cb5de.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7c/6f7ca4a2db3eead15f01434e1c9131dd/pa/YJ93473_e9498822ad8b05cbdcb89ab0ad2cb5de.jpg already downloaded
2026-03-30 11:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F7c%252F6f7ca4a2db3eead15f01434e1c9131dd%252Fpa%252FYJ93473_d84920c5eeedc9a941cb8d349fb2dec2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7c/6f7ca4a2db3eead15f01434e1c9131dd/pa/YJ93473_d84920c5eeedc9a941cb8d349fb2dec2.jpg already downloaded
2026-03-30 11:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F7c%252F6f7ca4a2db3eead15f01434e1c9131dd%252Fpa%252FYJ93473_e4a2741da5f6ca2edbdc386901ae550a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7c/6f7ca4a2db3eead15f01434e1c9131dd/pa/YJ93473_e4a2741da5f6ca2edbdc386901ae550a.jpg already downloaded
2026-03-30 11:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F7c%252F6f7ca4a2db3eead15f01434e1c9131dd%252Fpa%252FYJ93473_4332cc4ac0b13d00e6e526dd4c3cde60.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7c/6f7ca4a2db3eead15f01434e1c9131dd/pa/YJ93473_4332cc4ac0b13d00e6e526dd4c3cde60.jpg not downloaded yet
2026-03-30 11:26:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/7c/6f7ca4a2db3eead15f01434e1c9131dd/pa/YJ93473_4332cc4ac0b13d00e6e526dd4c3cde60.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a42d190>
2026-03-30 11:26:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b1e4d1c-4aa9-56eb-898e-8254b64ca9bd/4b1e4d1c-4aa9-56eb-898e-8254b64ca9bd_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F7c%252F6f7ca4a2db3eead15f01434e1c9131dd%252Fpa%252FYJ93473_4332cc4ac0b13d00e6e526dd4c3cde60.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7c/6f7ca4a2db3eead15f01434e1c9131dd/pa/YJ93473_4332cc4ac0b13d00e6e526dd4c3cde60.jpg saved to cache
2026-03-30 11:26:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4b1e4d1c-4aa9-56eb-898e-8254b64ca9bd
2026-03-30 11:26:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4b1e4d1c-4aa9-56eb-898e-8254b64ca9bd, skipping ID generation
2026-03-30 11:26:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b1e4d1c-4aa9-56eb-898e-8254b64ca9bd with scrape type 1
2026-03-30 11:26:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4b1e4d1c-4aa9-56eb-898e-8254b64ca9bd sending to next pipeline
2026-03-30 11:26:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4b1e4d1c-4aa9-56eb-898e-8254b64ca9bd, identifier: YJ93473
2026-03-30 11:26:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4b1e4d1c-4aa9-56eb-898e-8254b64ca9bd with identifier: YJ93473
2026-03-30 11:26:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4b1e4d1c-4aa9-56eb-898e-8254b64ca9bd with identifier: YJ93473
2026-03-30 11:26:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4b1e4d1c-4aa9-56eb-898e-8254b64ca9bd with identifier: YJ93473 to the API
2026-03-30 11:26:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6f/7c/6f7ca4a2db3eead15f01434e1c9131dd/pa/YJ93473_4332cc4ac0b13d00e6e526dd4c3cde60.jpg>
{'auction_title': '',
'c_o_2_emission_value': 121,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2026-03-31T15:25:01Z',
'fuel_type': 'diesel',
'id': '4b1e4d1c-4aa9-56eb-898e-8254b64ca9bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ93473',
'listing': 'auction',
'location': 'ES',
'make': 'Mercedes-Benz',
'model': 'Citan',
'odometer': 227442,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b1e4d1c-4aa9-56eb-898e-8254b64ca9bd/4b1e4d1c-4aa9-56eb-898e-8254b64ca9bd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88165,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/7c/6f7ca4a2db3eead15f01434e1c9131dd/pa/YJ93473_9f1086a54cc1fd37120041ca705028b7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b1e4d1c-4aa9-56eb-898e-8254b64ca9bd/4b1e4d1c-4aa9-56eb-898e-8254b64ca9bd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87093,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/7c/6f7ca4a2db3eead15f01434e1c9131dd/pa/YJ93473_f6351bfabef59a5678f720556a0021c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b1e4d1c-4aa9-56eb-898e-8254b64ca9bd/4b1e4d1c-4aa9-56eb-898e-8254b64ca9bd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68994,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/7c/6f7ca4a2db3eead15f01434e1c9131dd/pa/YJ93473_9d3ad97dcc4b90c10fae0c96b09ee9a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b1e4d1c-4aa9-56eb-898e-8254b64ca9bd/4b1e4d1c-4aa9-56eb-898e-8254b64ca9bd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64047,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/7c/6f7ca4a2db3eead15f01434e1c9131dd/pa/YJ93473_2ff6f102c5d6a99c5aa6dba3f8869fa5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b1e4d1c-4aa9-56eb-898e-8254b64ca9bd/4b1e4d1c-4aa9-56eb-898e-8254b64ca9bd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68668,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/7c/6f7ca4a2db3eead15f01434e1c9131dd/pa/YJ93473_66a3c8f4bd360239076de7bf9b43b893.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b1e4d1c-4aa9-56eb-898e-8254b64ca9bd/4b1e4d1c-4aa9-56eb-898e-8254b64ca9bd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70118,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/7c/6f7ca4a2db3eead15f01434e1c9131dd/pa/YJ93473_9a0fd1f6f39281dff724bfd693025865.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b1e4d1c-4aa9-56eb-898e-8254b64ca9bd/4b1e4d1c-4aa9-56eb-898e-8254b64ca9bd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71089,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/7c/6f7ca4a2db3eead15f01434e1c9131dd/pa/YJ93473_e9498822ad8b05cbdcb89ab0ad2cb5de.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b1e4d1c-4aa9-56eb-898e-8254b64ca9bd/4b1e4d1c-4aa9-56eb-898e-8254b64ca9bd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77342,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/7c/6f7ca4a2db3eead15f01434e1c9131dd/pa/YJ93473_d84920c5eeedc9a941cb8d349fb2dec2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b1e4d1c-4aa9-56eb-898e-8254b64ca9bd/4b1e4d1c-4aa9-56eb-898e-8254b64ca9bd_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85970,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/7c/6f7ca4a2db3eead15f01434e1c9131dd/pa/YJ93473_e4a2741da5f6ca2edbdc386901ae550a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b1e4d1c-4aa9-56eb-898e-8254b64ca9bd/4b1e4d1c-4aa9-56eb-898e-8254b64ca9bd_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82248,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/7c/6f7ca4a2db3eead15f01434e1c9131dd/pa/YJ93473_4332cc4ac0b13d00e6e526dd4c3cde60.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-03-01',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz Citan 111 CDI Largo Select',
'transmission': 'manual',
'trim': 'Largo Select',
'year': 2020}
2026-03-30 11:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ93473%27 HTTP/1.1" 200 None
2026-03-30 11:26:39 [auto1.es] INFO: Saving data for YJ93473: {'created_time': 1774869999.548279, 'last_price_update_time': 1774869999.548289, 'auction_closing_time': 1774970701.0}
2026-03-30 11:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YJ93473') HTTP/1.1" 204 0
2026-03-30 11:26:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RF07608/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RK47874> (referer: https://www.auto1.com/v1/car-details-view/RK47874/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c650be45-72f5-5c59-b6fc-fe4fea55a43b with identifier: RK47874
2026-03-30 11:26:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c650be45-72f5-5c59-b6fc-fe4fea55a43b with scrape type 1
2026-03-30 11:26:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c650be45-72f5-5c59-b6fc-fe4fea55a43b
2026-03-30 11:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Ff7%252F4cf7de72c385a685e6aee21d5ae061f0%252Fpa%252FRK47874_40879fbd3157697cd2bd5f7ad4be2a18.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_40879fbd3157697cd2bd5f7ad4be2a18.jpg not downloaded yet
2026-03-30 11:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Ff7%252F4cf7de72c385a685e6aee21d5ae061f0%252Fpa%252FRK47874_e85c8ac2b94fb9fba745810b0fa7854a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_e85c8ac2b94fb9fba745810b0fa7854a.jpg not downloaded yet
2026-03-30 11:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Ff7%252F4cf7de72c385a685e6aee21d5ae061f0%252Fpa%252FRK47874_6797b64d6aed4eb5502d6113ca6b5574.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_6797b64d6aed4eb5502d6113ca6b5574.jpg not downloaded yet
2026-03-30 11:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Ff7%252F4cf7de72c385a685e6aee21d5ae061f0%252Fpa%252FRK47874_ca10110a529c2e1419e6dacfda2d1324.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_ca10110a529c2e1419e6dacfda2d1324.jpg not downloaded yet
2026-03-30 11:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Ff7%252F4cf7de72c385a685e6aee21d5ae061f0%252Fpa%252FRK47874_15c3d3628f2ec8f4dca870314221cc74.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_15c3d3628f2ec8f4dca870314221cc74.jpg not downloaded yet
2026-03-30 11:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Ff7%252F4cf7de72c385a685e6aee21d5ae061f0%252Fpa%252FRK47874_3f7de603e2d254322d0e83118d3c339b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_3f7de603e2d254322d0e83118d3c339b.jpg not downloaded yet
2026-03-30 11:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Ff7%252F4cf7de72c385a685e6aee21d5ae061f0%252Fpa%252FRK47874_86374b98cf1d46962b5a8cb247a82f53.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_86374b98cf1d46962b5a8cb247a82f53.jpg not downloaded yet
2026-03-30 11:26:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_40879fbd3157697cd2bd5f7ad4be2a18.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Ff7%252F4cf7de72c385a685e6aee21d5ae061f0%252Fpa%252FRK47874_7d2ed8b5292dd43b6de26617e7ee39e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_7d2ed8b5292dd43b6de26617e7ee39e0.jpg not downloaded yet
2026-03-30 11:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Ff7%252F4cf7de72c385a685e6aee21d5ae061f0%252Fpa%252FRK47874_d7a6eae3b009b103af71f2d22a535eec.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_d7a6eae3b009b103af71f2d22a535eec.jpg not downloaded yet
2026-03-30 11:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Ff7%252F4cf7de72c385a685e6aee21d5ae061f0%252Fpa%252FRK47874_2baf68973839efb41d1b3e6c7c852c50.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_2baf68973839efb41d1b3e6c7c852c50.jpg not downloaded yet
2026-03-30 11:26:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05aed4c10>
2026-03-30 11:26:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c650be45-72f5-5c59-b6fc-fe4fea55a43b/c650be45-72f5-5c59-b6fc-fe4fea55a43b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Ff7%252F4cf7de72c385a685e6aee21d5ae061f0%252Fpa%252FRK47874_40879fbd3157697cd2bd5f7ad4be2a18.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_40879fbd3157697cd2bd5f7ad4be2a18.jpg saved to cache
2026-03-30 11:26:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c650be45-72f5-5c59-b6fc-fe4fea55a43b
2026-03-30 11:26:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_e85c8ac2b94fb9fba745810b0fa7854a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_ca10110a529c2e1419e6dacfda2d1324.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_6797b64d6aed4eb5502d6113ca6b5574.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_86374b98cf1d46962b5a8cb247a82f53.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a43eed0>
2026-03-30 11:26:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c650be45-72f5-5c59-b6fc-fe4fea55a43b/c650be45-72f5-5c59-b6fc-fe4fea55a43b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Ff7%252F4cf7de72c385a685e6aee21d5ae061f0%252Fpa%252FRK47874_e85c8ac2b94fb9fba745810b0fa7854a.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_e85c8ac2b94fb9fba745810b0fa7854a.jpg saved to cache
2026-03-30 11:26:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c650be45-72f5-5c59-b6fc-fe4fea55a43b
2026-03-30 11:26:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad511d0>
2026-03-30 11:26:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c650be45-72f5-5c59-b6fc-fe4fea55a43b/c650be45-72f5-5c59-b6fc-fe4fea55a43b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Ff7%252F4cf7de72c385a685e6aee21d5ae061f0%252Fpa%252FRK47874_ca10110a529c2e1419e6dacfda2d1324.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_ca10110a529c2e1419e6dacfda2d1324.jpg saved to cache
2026-03-30 11:26:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c650be45-72f5-5c59-b6fc-fe4fea55a43b
2026-03-30 11:26:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad79710>
2026-03-30 11:26:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c650be45-72f5-5c59-b6fc-fe4fea55a43b/c650be45-72f5-5c59-b6fc-fe4fea55a43b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Ff7%252F4cf7de72c385a685e6aee21d5ae061f0%252Fpa%252FRK47874_6797b64d6aed4eb5502d6113ca6b5574.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_6797b64d6aed4eb5502d6113ca6b5574.jpg saved to cache
2026-03-30 11:26:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c650be45-72f5-5c59-b6fc-fe4fea55a43b
2026-03-30 11:26:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a323550>
2026-03-30 11:26:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c650be45-72f5-5c59-b6fc-fe4fea55a43b/c650be45-72f5-5c59-b6fc-fe4fea55a43b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Ff7%252F4cf7de72c385a685e6aee21d5ae061f0%252Fpa%252FRK47874_86374b98cf1d46962b5a8cb247a82f53.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_86374b98cf1d46962b5a8cb247a82f53.jpg saved to cache
2026-03-30 11:26:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c650be45-72f5-5c59-b6fc-fe4fea55a43b
2026-03-30 11:26:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_2baf68973839efb41d1b3e6c7c852c50.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_d7a6eae3b009b103af71f2d22a535eec.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_7d2ed8b5292dd43b6de26617e7ee39e0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_3f7de603e2d254322d0e83118d3c339b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3c6990>
2026-03-30 11:26:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c650be45-72f5-5c59-b6fc-fe4fea55a43b/c650be45-72f5-5c59-b6fc-fe4fea55a43b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Ff7%252F4cf7de72c385a685e6aee21d5ae061f0%252Fpa%252FRK47874_2baf68973839efb41d1b3e6c7c852c50.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_2baf68973839efb41d1b3e6c7c852c50.jpg saved to cache
2026-03-30 11:26:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c650be45-72f5-5c59-b6fc-fe4fea55a43b
2026-03-30 11:26:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3b27d0>
2026-03-30 11:26:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c650be45-72f5-5c59-b6fc-fe4fea55a43b/c650be45-72f5-5c59-b6fc-fe4fea55a43b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Ff7%252F4cf7de72c385a685e6aee21d5ae061f0%252Fpa%252FRK47874_d7a6eae3b009b103af71f2d22a535eec.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_d7a6eae3b009b103af71f2d22a535eec.jpg saved to cache
2026-03-30 11:26:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c650be45-72f5-5c59-b6fc-fe4fea55a43b
2026-03-30 11:26:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3b2390>
2026-03-30 11:26:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c650be45-72f5-5c59-b6fc-fe4fea55a43b/c650be45-72f5-5c59-b6fc-fe4fea55a43b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Ff7%252F4cf7de72c385a685e6aee21d5ae061f0%252Fpa%252FRK47874_7d2ed8b5292dd43b6de26617e7ee39e0.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_7d2ed8b5292dd43b6de26617e7ee39e0.jpg saved to cache
2026-03-30 11:26:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c650be45-72f5-5c59-b6fc-fe4fea55a43b
2026-03-30 11:26:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060feb710>
2026-03-30 11:26:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c650be45-72f5-5c59-b6fc-fe4fea55a43b/c650be45-72f5-5c59-b6fc-fe4fea55a43b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Ff7%252F4cf7de72c385a685e6aee21d5ae061f0%252Fpa%252FRK47874_3f7de603e2d254322d0e83118d3c339b.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_3f7de603e2d254322d0e83118d3c339b.jpg saved to cache
2026-03-30 11:26:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c650be45-72f5-5c59-b6fc-fe4fea55a43b
2026-03-30 11:26:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_15c3d3628f2ec8f4dca870314221cc74.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060cfc590>
2026-03-30 11:26:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c650be45-72f5-5c59-b6fc-fe4fea55a43b/c650be45-72f5-5c59-b6fc-fe4fea55a43b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Ff7%252F4cf7de72c385a685e6aee21d5ae061f0%252Fpa%252FRK47874_15c3d3628f2ec8f4dca870314221cc74.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_15c3d3628f2ec8f4dca870314221cc74.jpg saved to cache
2026-03-30 11:26:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c650be45-72f5-5c59-b6fc-fe4fea55a43b
2026-03-30 11:26:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c650be45-72f5-5c59-b6fc-fe4fea55a43b, skipping ID generation
2026-03-30 11:26:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c650be45-72f5-5c59-b6fc-fe4fea55a43b with scrape type 1
2026-03-30 11:26:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c650be45-72f5-5c59-b6fc-fe4fea55a43b sending to next pipeline
2026-03-30 11:26:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c650be45-72f5-5c59-b6fc-fe4fea55a43b, identifier: RK47874
2026-03-30 11:26:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c650be45-72f5-5c59-b6fc-fe4fea55a43b with identifier: RK47874
2026-03-30 11:26:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c650be45-72f5-5c59-b6fc-fe4fea55a43b with identifier: RK47874
2026-03-30 11:26:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c650be45-72f5-5c59-b6fc-fe4fea55a43b with identifier: RK47874 to the API
2026-03-30 11:26:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_15c3d3628f2ec8f4dca870314221cc74.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.1L',
'engine_horse_power': 135,
'expiration_date': '2026-03-31T15:24:55Z',
'fuel_type': 'diesel',
'id': 'c650be45-72f5-5c59-b6fc-fe4fea55a43b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK47874',
'listing': 'auction',
'location': 'ES, Barcelona',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 165596,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c650be45-72f5-5c59-b6fc-fe4fea55a43b/c650be45-72f5-5c59-b6fc-fe4fea55a43b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79993,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_40879fbd3157697cd2bd5f7ad4be2a18.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c650be45-72f5-5c59-b6fc-fe4fea55a43b/c650be45-72f5-5c59-b6fc-fe4fea55a43b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83481,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_e85c8ac2b94fb9fba745810b0fa7854a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c650be45-72f5-5c59-b6fc-fe4fea55a43b/c650be45-72f5-5c59-b6fc-fe4fea55a43b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95444,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_6797b64d6aed4eb5502d6113ca6b5574.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c650be45-72f5-5c59-b6fc-fe4fea55a43b/c650be45-72f5-5c59-b6fc-fe4fea55a43b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72449,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_ca10110a529c2e1419e6dacfda2d1324.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c650be45-72f5-5c59-b6fc-fe4fea55a43b/c650be45-72f5-5c59-b6fc-fe4fea55a43b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87163,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_15c3d3628f2ec8f4dca870314221cc74.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c650be45-72f5-5c59-b6fc-fe4fea55a43b/c650be45-72f5-5c59-b6fc-fe4fea55a43b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89870,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_3f7de603e2d254322d0e83118d3c339b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c650be45-72f5-5c59-b6fc-fe4fea55a43b/c650be45-72f5-5c59-b6fc-fe4fea55a43b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75564,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_86374b98cf1d46962b5a8cb247a82f53.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c650be45-72f5-5c59-b6fc-fe4fea55a43b/c650be45-72f5-5c59-b6fc-fe4fea55a43b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92729,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_7d2ed8b5292dd43b6de26617e7ee39e0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c650be45-72f5-5c59-b6fc-fe4fea55a43b/c650be45-72f5-5c59-b6fc-fe4fea55a43b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85649,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_d7a6eae3b009b103af71f2d22a535eec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c650be45-72f5-5c59-b6fc-fe4fea55a43b/c650be45-72f5-5c59-b6fc-fe4fea55a43b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73399,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/f7/4cf7de72c385a685e6aee21d5ae061f0/pa/RK47874_2baf68973839efb41d1b3e6c7c852c50.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-07-27',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 200 d Urban',
'transmission': 'automatic',
'trim': 'Urban',
'year': 2015}
2026-03-30 11:26:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK47874%27 HTTP/1.1" 200 None
2026-03-30 11:26:51 [auto1.es] INFO: Saving data for RK47874: {'created_time': 1774870011.541644, 'last_price_update_time': 1774870011.541655, 'auction_closing_time': 1774970695.0}
2026-03-30 11:26:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RK47874') HTTP/1.1" 204 0
2026-03-30 11:26:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BV86161> (referer: https://www.auto1.com/v1/car-details-view/BV86161/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff66a3f3-8c38-5876-932e-539e512933d5 with identifier: BV86161
2026-03-30 11:26:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff66a3f3-8c38-5876-932e-539e512933d5 with scrape type 1
2026-03-30 11:26:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ff66a3f3-8c38-5876-932e-539e512933d5
2026-03-30 11:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F35%252F5135e170db1bc7a8ad3a65e059d357be%252Fpa%252FBV86161_4b79e5717f4e21df8277591999bfb592.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/35/5135e170db1bc7a8ad3a65e059d357be/pa/BV86161_4b79e5717f4e21df8277591999bfb592.jpg not downloaded yet
2026-03-30 11:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F35%252F5135e170db1bc7a8ad3a65e059d357be%252Fpa%252FBV86161_bb68699ea5cd89c91f15f226057d352b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/35/5135e170db1bc7a8ad3a65e059d357be/pa/BV86161_bb68699ea5cd89c91f15f226057d352b.jpg not downloaded yet
2026-03-30 11:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F35%252F5135e170db1bc7a8ad3a65e059d357be%252Fpa%252FBV86161_ab264c08694e5dbdf79a5e65b99f6e23.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/35/5135e170db1bc7a8ad3a65e059d357be/pa/BV86161_ab264c08694e5dbdf79a5e65b99f6e23.jpg not downloaded yet
2026-03-30 11:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F35%252F5135e170db1bc7a8ad3a65e059d357be%252Fpa%252FBV86161_a05556233b62adc11f4ec9a9af4fbdc7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/35/5135e170db1bc7a8ad3a65e059d357be/pa/BV86161_a05556233b62adc11f4ec9a9af4fbdc7.jpg not downloaded yet
2026-03-30 11:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F35%252F5135e170db1bc7a8ad3a65e059d357be%252Fpa%252FBV86161_e1fa3bb12e6a3e649eda76121de79322.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/35/5135e170db1bc7a8ad3a65e059d357be/pa/BV86161_e1fa3bb12e6a3e649eda76121de79322.jpg not downloaded yet
2026-03-30 11:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F35%252F5135e170db1bc7a8ad3a65e059d357be%252Fpa%252FBV86161_35473636571fddfec49f39d43a470a1c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/35/5135e170db1bc7a8ad3a65e059d357be/pa/BV86161_35473636571fddfec49f39d43a470a1c.jpg not downloaded yet
2026-03-30 11:26:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/35/5135e170db1bc7a8ad3a65e059d357be/pa/BV86161_bb68699ea5cd89c91f15f226057d352b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/35/5135e170db1bc7a8ad3a65e059d357be/pa/BV86161_4b79e5717f4e21df8277591999bfb592.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/35/5135e170db1bc7a8ad3a65e059d357be/pa/BV86161_ab264c08694e5dbdf79a5e65b99f6e23.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/35/5135e170db1bc7a8ad3a65e059d357be/pa/BV86161_a05556233b62adc11f4ec9a9af4fbdc7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3a0310>
2026-03-30 11:26:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff66a3f3-8c38-5876-932e-539e512933d5/ff66a3f3-8c38-5876-932e-539e512933d5_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F35%252F5135e170db1bc7a8ad3a65e059d357be%252Fpa%252FBV86161_bb68699ea5cd89c91f15f226057d352b.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/35/5135e170db1bc7a8ad3a65e059d357be/pa/BV86161_bb68699ea5cd89c91f15f226057d352b.jpg saved to cache
2026-03-30 11:26:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ff66a3f3-8c38-5876-932e-539e512933d5
2026-03-30 11:26:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4a2610>
2026-03-30 11:26:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff66a3f3-8c38-5876-932e-539e512933d5/ff66a3f3-8c38-5876-932e-539e512933d5_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F35%252F5135e170db1bc7a8ad3a65e059d357be%252Fpa%252FBV86161_4b79e5717f4e21df8277591999bfb592.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/35/5135e170db1bc7a8ad3a65e059d357be/pa/BV86161_4b79e5717f4e21df8277591999bfb592.jpg saved to cache
2026-03-30 11:26:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff66a3f3-8c38-5876-932e-539e512933d5
2026-03-30 11:26:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad69910>
2026-03-30 11:26:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff66a3f3-8c38-5876-932e-539e512933d5/ff66a3f3-8c38-5876-932e-539e512933d5_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F35%252F5135e170db1bc7a8ad3a65e059d357be%252Fpa%252FBV86161_ab264c08694e5dbdf79a5e65b99f6e23.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/35/5135e170db1bc7a8ad3a65e059d357be/pa/BV86161_ab264c08694e5dbdf79a5e65b99f6e23.jpg saved to cache
2026-03-30 11:26:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ff66a3f3-8c38-5876-932e-539e512933d5
2026-03-30 11:26:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a469610>
2026-03-30 11:26:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff66a3f3-8c38-5876-932e-539e512933d5/ff66a3f3-8c38-5876-932e-539e512933d5_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F35%252F5135e170db1bc7a8ad3a65e059d357be%252Fpa%252FBV86161_a05556233b62adc11f4ec9a9af4fbdc7.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/35/5135e170db1bc7a8ad3a65e059d357be/pa/BV86161_a05556233b62adc11f4ec9a9af4fbdc7.jpg saved to cache
2026-03-30 11:26:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ff66a3f3-8c38-5876-932e-539e512933d5
2026-03-30 11:26:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/35/5135e170db1bc7a8ad3a65e059d357be/pa/BV86161_e1fa3bb12e6a3e649eda76121de79322.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/35/5135e170db1bc7a8ad3a65e059d357be/pa/BV86161_35473636571fddfec49f39d43a470a1c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:26:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad8ab10>
2026-03-30 11:26:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff66a3f3-8c38-5876-932e-539e512933d5/ff66a3f3-8c38-5876-932e-539e512933d5_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F35%252F5135e170db1bc7a8ad3a65e059d357be%252Fpa%252FBV86161_e1fa3bb12e6a3e649eda76121de79322.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/35/5135e170db1bc7a8ad3a65e059d357be/pa/BV86161_e1fa3bb12e6a3e649eda76121de79322.jpg saved to cache
2026-03-30 11:26:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ff66a3f3-8c38-5876-932e-539e512933d5
2026-03-30 11:26:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:26:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a49fd50>
2026-03-30 11:26:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:26:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:26:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:26:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff66a3f3-8c38-5876-932e-539e512933d5/ff66a3f3-8c38-5876-932e-539e512933d5_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F35%252F5135e170db1bc7a8ad3a65e059d357be%252Fpa%252FBV86161_35473636571fddfec49f39d43a470a1c.jpg') HTTP/1.1" 204 0
2026-03-30 11:26:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/35/5135e170db1bc7a8ad3a65e059d357be/pa/BV86161_35473636571fddfec49f39d43a470a1c.jpg saved to cache
2026-03-30 11:26:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ff66a3f3-8c38-5876-932e-539e512933d5
2026-03-30 11:26:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff66a3f3-8c38-5876-932e-539e512933d5, skipping ID generation
2026-03-30 11:26:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff66a3f3-8c38-5876-932e-539e512933d5 with scrape type 1
2026-03-30 11:26:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff66a3f3-8c38-5876-932e-539e512933d5 sending to next pipeline
2026-03-30 11:26:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ff66a3f3-8c38-5876-932e-539e512933d5, identifier: BV86161
2026-03-30 11:26:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ff66a3f3-8c38-5876-932e-539e512933d5 with identifier: BV86161
2026-03-30 11:26:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ff66a3f3-8c38-5876-932e-539e512933d5 with identifier: BV86161
2026-03-30 11:26:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ff66a3f3-8c38-5876-932e-539e512933d5 with identifier: BV86161 to the API
2026-03-30 11:26:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img51/35/5135e170db1bc7a8ad3a65e059d357be/pa/BV86161_35473636571fddfec49f39d43a470a1c.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:59:26Z',
'fuel_type': 'petrol',
'id': 'ff66a3f3-8c38-5876-932e-539e512933d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV86161',
'listing': 'auction',
'location': 'ES, Leganés',
'make': 'Citroen',
'model': 'C5',
'odometer': 51108,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff66a3f3-8c38-5876-932e-539e512933d5/ff66a3f3-8c38-5876-932e-539e512933d5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97965,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/35/5135e170db1bc7a8ad3a65e059d357be/pa/BV86161_4b79e5717f4e21df8277591999bfb592.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff66a3f3-8c38-5876-932e-539e512933d5/ff66a3f3-8c38-5876-932e-539e512933d5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85545,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/35/5135e170db1bc7a8ad3a65e059d357be/pa/BV86161_bb68699ea5cd89c91f15f226057d352b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff66a3f3-8c38-5876-932e-539e512933d5/ff66a3f3-8c38-5876-932e-539e512933d5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73054,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/35/5135e170db1bc7a8ad3a65e059d357be/pa/BV86161_ab264c08694e5dbdf79a5e65b99f6e23.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff66a3f3-8c38-5876-932e-539e512933d5/ff66a3f3-8c38-5876-932e-539e512933d5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90523,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/35/5135e170db1bc7a8ad3a65e059d357be/pa/BV86161_a05556233b62adc11f4ec9a9af4fbdc7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff66a3f3-8c38-5876-932e-539e512933d5/ff66a3f3-8c38-5876-932e-539e512933d5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77263,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/35/5135e170db1bc7a8ad3a65e059d357be/pa/BV86161_e1fa3bb12e6a3e649eda76121de79322.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff66a3f3-8c38-5876-932e-539e512933d5/ff66a3f3-8c38-5876-932e-539e512933d5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110221,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/35/5135e170db1bc7a8ad3a65e059d357be/pa/BV86161_35473636571fddfec49f39d43a470a1c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2005-09-26',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C5 2.0 Premier',
'transmission': 'manual',
'trim': 'Premier',
'year': 2005}
2026-03-30 11:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BV86161%27 HTTP/1.1" 200 None
2026-03-30 11:26:53 [auto1.es] INFO: Saving data for BV86161: {'created_time': 1774870013.63361, 'last_price_update_time': 1774870013.633621, 'auction_closing_time': 1774972766.0}
2026-03-30 11:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BV86161') HTTP/1.1" 204 0
2026-03-30 11:26:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:54 [auto1.es] INFO: Channel: 24h | Page: 11 | totalHits: 2236 | hits on page: 40
2026-03-30 11:26:54 [auto1.es] INFO: Found listing with ID: AE45269
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE45269%27 HTTP/1.1" 200 None
2026-03-30 11:26:54 [auto1.es] INFO: Scrape type for AE45269: 0
2026-03-30 11:26:54 [auto1.es] INFO: Found listing with ID: XZ25784
2026-03-30 11:26:54 [auto1.es] INFO: Found listing with ID: YS57234
2026-03-30 11:26:54 [auto1.es] INFO: Found listing with ID: SY46095
2026-03-30 11:26:54 [auto1.es] INFO: Found listing with ID: EK27191
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EK27191%27 HTTP/1.1" 200 None
2026-03-30 11:26:54 [auto1.es] INFO: Scrape type for EK27191: 2
2026-03-30 11:26:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 118cc27d-f676-5f7f-9ba2-7582e3d4a6bb with identifier: EK27191
2026-03-30 11:26:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 118cc27d-f676-5f7f-9ba2-7582e3d4a6bb with scrape type 2
2026-03-30 11:26:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 118cc27d-f676-5f7f-9ba2-7582e3d4a6bb with scrape type 2
2026-03-30 11:26:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 118cc27d-f676-5f7f-9ba2-7582e3d4a6bb, identifier: EK27191
2026-03-30 11:26:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 118cc27d-f676-5f7f-9ba2-7582e3d4a6bb with identifier: EK27191
2026-03-30 11:26:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 118cc27d-f676-5f7f-9ba2-7582e3d4a6bb with identifier: EK27191
2026-03-30 11:26:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 118cc27d-f676-5f7f-9ba2-7582e3d4a6bb with identifier: EK27191 to the API
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:21:58Z',
'fuel_type': 'diesel',
'id': '118cc27d-f676-5f7f-9ba2-7582e3d4a6bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK27191',
'listing': 'auction',
'make': 'Audi',
'model': 'A3',
'odometer': 263798,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1998-06-17',
'seller_name': None,
'title': 'Audi A3 1.9 TDI Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 1998}
2026-03-30 11:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EK27191%27 HTTP/1.1" 200 None
2026-03-30 11:26:55 [auto1.es] INFO: Saving data for EK27191: {'auction_closing_time': 1774970518.0, 'created_time': 1773432603.367539, 'last_price_update_time': 1774870015.057457}
2026-03-30 11:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EK27191') HTTP/1.1" 204 0
2026-03-30 11:26:55 [auto1.es] INFO: Found listing with ID: KM47082
2026-03-30 11:26:55 [auto1.es] INFO: Found listing with ID: JU86611
2026-03-30 11:26:55 [auto1.es] INFO: Found listing with ID: UC18876
2026-03-30 11:26:55 [auto1.es] INFO: Found listing with ID: XC17897
2026-03-30 11:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC17897%27 HTTP/1.1" 200 None
2026-03-30 11:26:55 [auto1.es] INFO: Scrape type for XC17897: 1
2026-03-30 11:26:55 [auto1.es] INFO: Found listing with ID: MR71351
2026-03-30 11:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MR71351%27 HTTP/1.1" 200 None
2026-03-30 11:26:55 [auto1.es] INFO: Scrape type for MR71351: 2
2026-03-30 11:26:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 027dc425-51b0-505f-b3fc-88434ece3b45 with identifier: MR71351
2026-03-30 11:26:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 027dc425-51b0-505f-b3fc-88434ece3b45 with scrape type 2
2026-03-30 11:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 027dc425-51b0-505f-b3fc-88434ece3b45 with scrape type 2
2026-03-30 11:26:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 027dc425-51b0-505f-b3fc-88434ece3b45, identifier: MR71351
2026-03-30 11:26:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 027dc425-51b0-505f-b3fc-88434ece3b45 with identifier: MR71351
2026-03-30 11:26:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 027dc425-51b0-505f-b3fc-88434ece3b45 with identifier: MR71351
2026-03-30 11:26:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 027dc425-51b0-505f-b3fc-88434ece3b45 with identifier: MR71351 to the API
2026-03-30 11:26:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:12:39Z',
'fuel_type': 'diesel',
'id': '027dc425-51b0-505f-b3fc-88434ece3b45',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR71351',
'listing': 'auction',
'make': 'Seat',
'model': 'Altea',
'odometer': 173413,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-04-06',
'seller_name': None,
'title': 'Seat Altea 2.0 TDI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2010}
2026-03-30 11:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MR71351%27 HTTP/1.1" 200 None
2026-03-30 11:26:56 [auto1.es] INFO: Saving data for MR71351: {'auction_closing_time': 1774969959.0, 'created_time': 1774436871.00451, 'last_price_update_time': 1774870016.256094}
2026-03-30 11:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MR71351') HTTP/1.1" 204 0
2026-03-30 11:26:56 [auto1.es] INFO: Found listing with ID: JT99347
2026-03-30 11:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JT99347%27 HTTP/1.1" 200 None
2026-03-30 11:26:56 [auto1.es] INFO: Scrape type for JT99347: 1
2026-03-30 11:26:56 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.817(s), this was the 1st time calling it.
2026-03-30 11:26:56 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.525860436671005 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:26:56 [auto1.es] INFO: Found listing with ID: LT09027
2026-03-30 11:26:56 [auto1.es] INFO: Found listing with ID: FL34882
2026-03-30 11:26:56 [auto1.es] INFO: Found listing with ID: RN16192
2026-03-30 11:26:56 [auto1.es] INFO: Found listing with ID: GV45247
2026-03-30 11:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GV45247%27 HTTP/1.1" 200 None
2026-03-30 11:26:56 [auto1.es] INFO: Scrape type for GV45247: 2
2026-03-30 11:26:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39ce1dcc-dad8-54c3-b5cb-682784567989 with identifier: GV45247
2026-03-30 11:26:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39ce1dcc-dad8-54c3-b5cb-682784567989 with scrape type 2
2026-03-30 11:26:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39ce1dcc-dad8-54c3-b5cb-682784567989 with scrape type 2
2026-03-30 11:26:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 39ce1dcc-dad8-54c3-b5cb-682784567989, identifier: GV45247
2026-03-30 11:26:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 39ce1dcc-dad8-54c3-b5cb-682784567989 with identifier: GV45247
2026-03-30 11:26:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 39ce1dcc-dad8-54c3-b5cb-682784567989 with identifier: GV45247
2026-03-30 11:26:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 39ce1dcc-dad8-54c3-b5cb-682784567989 with identifier: GV45247 to the API
2026-03-30 11:26:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:44:24Z',
'fuel_type': 'diesel',
'id': '39ce1dcc-dad8-54c3-b5cb-682784567989',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV45247',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-5',
'odometer': 96984,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-25',
'seller_name': None,
'title': 'Mazda CX-5 2.2 Turbodiesel Style 2WD',
'transmission': 'manual',
'trim': 'Style 2WD',
'year': 2014}
2026-03-30 11:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GV45247%27 HTTP/1.1" 200 None
2026-03-30 11:26:56 [auto1.es] INFO: Saving data for GV45247: {'auction_closing_time': 1774971864.0, 'created_time': 1773842915.133029, 'last_price_update_time': 1774870016.895392}
2026-03-30 11:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GV45247') HTTP/1.1" 204 0
2026-03-30 11:26:56 [auto1.es] INFO: Found listing with ID: XP89037
2026-03-30 11:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XP89037%27 HTTP/1.1" 200 None
2026-03-30 11:26:56 [auto1.es] INFO: Scrape type for XP89037: 2
2026-03-30 11:26:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af25fbda-decf-53df-9a40-84955c6d855a with identifier: XP89037
2026-03-30 11:26:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af25fbda-decf-53df-9a40-84955c6d855a with scrape type 2
2026-03-30 11:26:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af25fbda-decf-53df-9a40-84955c6d855a with scrape type 2
2026-03-30 11:26:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: af25fbda-decf-53df-9a40-84955c6d855a, identifier: XP89037
2026-03-30 11:26:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: af25fbda-decf-53df-9a40-84955c6d855a with identifier: XP89037
2026-03-30 11:26:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: af25fbda-decf-53df-9a40-84955c6d855a with identifier: XP89037
2026-03-30 11:26:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: af25fbda-decf-53df-9a40-84955c6d855a with identifier: XP89037 to the API
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 135,
'expiration_date': '2026-03-31T15:19:07Z',
'fuel_type': 'diesel',
'id': 'af25fbda-decf-53df-9a40-84955c6d855a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP89037',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 226445,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1999-06-16',
'seller_name': None,
'title': 'BMW 3er 320d',
'transmission': 'manual',
'trim': '',
'year': 1999}
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XP89037%27 HTTP/1.1" 200 None
2026-03-30 11:26:57 [auto1.es] INFO: Saving data for XP89037: {'auction_closing_time': 1774970347.0, 'created_time': 1774263978.039649, 'last_price_update_time': 1774870017.364791}
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XP89037') HTTP/1.1" 204 0
2026-03-30 11:26:57 [auto1.es] INFO: Found listing with ID: HM27570
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HM27570%27 HTTP/1.1" 200 None
2026-03-30 11:26:57 [auto1.es] INFO: Scrape type for HM27570: 2
2026-03-30 11:26:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f2fecbf-1e45-5902-802a-6e1e31f69641 with identifier: HM27570
2026-03-30 11:26:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f2fecbf-1e45-5902-802a-6e1e31f69641 with scrape type 2
2026-03-30 11:26:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f2fecbf-1e45-5902-802a-6e1e31f69641 with scrape type 2
2026-03-30 11:26:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2f2fecbf-1e45-5902-802a-6e1e31f69641, identifier: HM27570
2026-03-30 11:26:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2f2fecbf-1e45-5902-802a-6e1e31f69641 with identifier: HM27570
2026-03-30 11:26:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2f2fecbf-1e45-5902-802a-6e1e31f69641 with identifier: HM27570
2026-03-30 11:26:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2f2fecbf-1e45-5902-802a-6e1e31f69641 with identifier: HM27570 to the API
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 84,
'expiration_date': '2026-03-31T15:42:51Z',
'fuel_type': 'petrol',
'id': '2f2fecbf-1e45-5902-802a-6e1e31f69641',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM27570',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Bayon',
'odometer': 19352,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-05-19',
'seller_name': None,
'title': 'Hyundai Bayon 1.2 Klass 2WD',
'transmission': 'manual',
'trim': 'Klass 2WD',
'year': 2024}
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HM27570%27 HTTP/1.1" 200 None
2026-03-30 11:26:57 [auto1.es] INFO: Saving data for HM27570: {'auction_closing_time': 1774971771.0, 'created_time': 1774275038.468778, 'last_price_update_time': 1774870017.855389}
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HM27570') HTTP/1.1" 204 0
2026-03-30 11:26:57 [auto1.es] INFO: Found listing with ID: TE09393
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TE09393%27 HTTP/1.1" 200 None
2026-03-30 11:26:57 [auto1.es] INFO: Scrape type for TE09393: 2
2026-03-30 11:26:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98550f87-8cf3-5c8c-a44d-d407d1254ef8 with identifier: TE09393
2026-03-30 11:26:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98550f87-8cf3-5c8c-a44d-d407d1254ef8 with scrape type 2
2026-03-30 11:26:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98550f87-8cf3-5c8c-a44d-d407d1254ef8 with scrape type 2
2026-03-30 11:26:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 98550f87-8cf3-5c8c-a44d-d407d1254ef8, identifier: TE09393
2026-03-30 11:26:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LS16672> (referer: https://www.auto1.com/v1/car-details-view/LS16672/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MB25535> (referer: https://www.auto1.com/v1/car-details-view/MB25535/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 98550f87-8cf3-5c8c-a44d-d407d1254ef8 with identifier: TE09393
2026-03-30 11:26:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 98550f87-8cf3-5c8c-a44d-d407d1254ef8 with identifier: TE09393
2026-03-30 11:26:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 98550f87-8cf3-5c8c-a44d-d407d1254ef8 with identifier: TE09393 to the API
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:17:39Z',
'fuel_type': 'petrol',
'id': '98550f87-8cf3-5c8c-a44d-d407d1254ef8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE09393',
'listing': 'auction',
'make': 'Honda',
'model': 'FR-V',
'odometer': 145679,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-12-26',
'seller_name': None,
'title': 'Honda FR-V 2.0 VTEC Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2006}
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TE09393%27 HTTP/1.1" 200 None
2026-03-30 11:26:58 [auto1.es] INFO: Saving data for TE09393: {'auction_closing_time': 1774970259.0, 'created_time': 1774263974.17896, 'last_price_update_time': 1774870018.420747}
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TE09393') HTTP/1.1" 204 0
2026-03-30 11:26:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:58 [auto1.es] INFO: Found listing with ID: XM49513
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XM49513%27 HTTP/1.1" 200 None
2026-03-30 11:26:58 [auto1.es] INFO: Scrape type for XM49513: 2
2026-03-30 11:26:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef1dcef8-7388-5731-b581-95bd8b6d0538 with identifier: XM49513
2026-03-30 11:26:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef1dcef8-7388-5731-b581-95bd8b6d0538 with scrape type 2
2026-03-30 11:26:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef1dcef8-7388-5731-b581-95bd8b6d0538 with scrape type 2
2026-03-30 11:26:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ef1dcef8-7388-5731-b581-95bd8b6d0538, identifier: XM49513
2026-03-30 11:26:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ef1dcef8-7388-5731-b581-95bd8b6d0538 with identifier: XM49513
2026-03-30 11:26:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ef1dcef8-7388-5731-b581-95bd8b6d0538 with identifier: XM49513
2026-03-30 11:26:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ef1dcef8-7388-5731-b581-95bd8b6d0538 with identifier: XM49513 to the API
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:44:28Z',
'fuel_type': 'diesel',
'id': 'ef1dcef8-7388-5731-b581-95bd8b6d0538',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM49513',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 195328,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-07',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Edition Plus',
'transmission': 'manual',
'trim': 'Edition Plus',
'year': 2010}
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XM49513%27 HTTP/1.1" 200 None
2026-03-30 11:26:58 [auto1.es] INFO: Saving data for XM49513: {'auction_closing_time': 1774971868.0, 'created_time': 1774263984.763111, 'last_price_update_time': 1774870018.881805}
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XM49513') HTTP/1.1" 204 0
2026-03-30 11:26:58 [auto1.es] INFO: Found listing with ID: PC53610
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PC53610%27 HTTP/1.1" 200 None
2026-03-30 11:26:58 [auto1.es] INFO: Scrape type for PC53610: 2
2026-03-30 11:26:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efe41a9f-043f-563b-bb4c-b8dddff86f96 with identifier: PC53610
2026-03-30 11:26:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efe41a9f-043f-563b-bb4c-b8dddff86f96 with scrape type 2
2026-03-30 11:26:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efe41a9f-043f-563b-bb4c-b8dddff86f96 with scrape type 2
2026-03-30 11:26:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: efe41a9f-043f-563b-bb4c-b8dddff86f96, identifier: PC53610
2026-03-30 11:26:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UG86344> (referer: https://www.auto1.com/v1/car-details-view/UG86344/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: efe41a9f-043f-563b-bb4c-b8dddff86f96 with identifier: PC53610
2026-03-30 11:26:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: efe41a9f-043f-563b-bb4c-b8dddff86f96 with identifier: PC53610
2026-03-30 11:26:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: efe41a9f-043f-563b-bb4c-b8dddff86f96 with identifier: PC53610 to the API
2026-03-30 11:26:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:46:01Z',
'fuel_type': 'diesel',
'id': 'efe41a9f-043f-563b-bb4c-b8dddff86f96',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC53610',
'listing': 'auction',
'make': 'Mazda',
'model': '6',
'odometer': 354838,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-04-01',
'seller_name': None,
'title': 'Mazda 6 2.0 Diesel CD Active Sport',
'transmission': 'manual',
'trim': 'CD Active Sport',
'year': 2007}
2026-03-30 11:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PC53610%27 HTTP/1.1" 200 None
2026-03-30 11:26:59 [auto1.es] INFO: Saving data for PC53610: {'auction_closing_time': 1774971961.0, 'created_time': 1774275470.745767, 'last_price_update_time': 1774870019.322436}
2026-03-30 11:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PC53610') HTTP/1.1" 204 0
2026-03-30 11:26:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7c82816-a81e-56d4-8c0f-f34e352a0f2e with identifier: LS16672
2026-03-30 11:26:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7c82816-a81e-56d4-8c0f-f34e352a0f2e with scrape type 1
2026-03-30 11:26:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item f7c82816-a81e-56d4-8c0f-f34e352a0f2e
2026-03-30 11:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F16%252F4c168c8c136aa5946aa3348026846a5c%252Fpa%252FLS16672_ee5ed301c10b6a8d38c0c4a54f057e60.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/16/4c168c8c136aa5946aa3348026846a5c/pa/LS16672_ee5ed301c10b6a8d38c0c4a54f057e60.jpg not downloaded yet
2026-03-30 11:26:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa2c06df-7627-597a-8a65-146c25695d08 with identifier: MB25535
2026-03-30 11:26:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa2c06df-7627-597a-8a65-146c25695d08 with scrape type 1
2026-03-30 11:26:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fa2c06df-7627-597a-8a65-146c25695d08
2026-03-30 11:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F39%252F1c399d2f3d609946b4591cc23b55e1ca%252Fpa%252FMB25535_2cd1d821518a6f924c69503d5d5d13f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/39/1c399d2f3d609946b4591cc23b55e1ca/pa/MB25535_2cd1d821518a6f924c69503d5d5d13f2.jpg already downloaded
2026-03-30 11:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F39%252F1c399d2f3d609946b4591cc23b55e1ca%252Fpa%252FMB25535_aaac71cdae41fe9242372f73b169e689.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/39/1c399d2f3d609946b4591cc23b55e1ca/pa/MB25535_aaac71cdae41fe9242372f73b169e689.jpg already downloaded
2026-03-30 11:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F39%252F1c399d2f3d609946b4591cc23b55e1ca%252Fpa%252FMB25535_d1d9ad2c483c207d50410907b7951ce7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/39/1c399d2f3d609946b4591cc23b55e1ca/pa/MB25535_d1d9ad2c483c207d50410907b7951ce7.jpg already downloaded
2026-03-30 11:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F39%252F1c399d2f3d609946b4591cc23b55e1ca%252Fpa%252FMB25535_77325b8497e8693ca485525ad9336f58.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/39/1c399d2f3d609946b4591cc23b55e1ca/pa/MB25535_77325b8497e8693ca485525ad9336f58.jpg already downloaded
2026-03-30 11:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F39%252F1c399d2f3d609946b4591cc23b55e1ca%252Fpa%252FMB25535_dcbf06190d52fc1f61a186d504ac13b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/39/1c399d2f3d609946b4591cc23b55e1ca/pa/MB25535_dcbf06190d52fc1f61a186d504ac13b7.jpg already downloaded
2026-03-30 11:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F39%252F1c399d2f3d609946b4591cc23b55e1ca%252Fpa%252FMB25535_c46203e6080ef6fac56e8bae53c20606.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/39/1c399d2f3d609946b4591cc23b55e1ca/pa/MB25535_c46203e6080ef6fac56e8bae53c20606.jpg already downloaded
2026-03-30 11:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F39%252F1c399d2f3d609946b4591cc23b55e1ca%252Fpa%252FMB25535_dda401569d1c9f5e10259c9ef2d7ba0d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/39/1c399d2f3d609946b4591cc23b55e1ca/pa/MB25535_dda401569d1c9f5e10259c9ef2d7ba0d.jpg already downloaded
2026-03-30 11:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F39%252F1c399d2f3d609946b4591cc23b55e1ca%252Fpa%252FMB25535_23d8ea6789c514c0760679d78339f407.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/39/1c399d2f3d609946b4591cc23b55e1ca/pa/MB25535_23d8ea6789c514c0760679d78339f407.jpg already downloaded
2026-03-30 11:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F39%252F1c399d2f3d609946b4591cc23b55e1ca%252Fpa%252FMB25535_40653780eb490cc1f8629be80f78b0a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/39/1c399d2f3d609946b4591cc23b55e1ca/pa/MB25535_40653780eb490cc1f8629be80f78b0a4.jpg already downloaded
2026-03-30 11:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F39%252F1c399d2f3d609946b4591cc23b55e1ca%252Fpa%252FMB25535_cf8148dc35ead91eeb1cf72359ebb227.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:26:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/39/1c399d2f3d609946b4591cc23b55e1ca/pa/MB25535_cf8148dc35ead91eeb1cf72359ebb227.jpg already downloaded
2026-03-30 11:26:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fa2c06df-7627-597a-8a65-146c25695d08, identifier: MB25535
2026-03-30 11:26:59 [auto1.es] INFO: Found listing with ID: KJ27740
2026-03-30 11:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KJ27740%27 HTTP/1.1" 200 None
2026-03-30 11:26:59 [auto1.es] INFO: Scrape type for KJ27740: 1
2026-03-30 11:26:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fa2c06df-7627-597a-8a65-146c25695d08 with identifier: MB25535
2026-03-30 11:26:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fa2c06df-7627-597a-8a65-146c25695d08 with identifier: MB25535
2026-03-30 11:26:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fa2c06df-7627-597a-8a65-146c25695d08 with identifier: MB25535 to the API
2026-03-30 11:26:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MB25535>
{'auction_title': '',
'c_o_2_emission_value': 117,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 102,
'expiration_date': '2026-03-31T15:34:58Z',
'fuel_type': 'petrol',
'id': 'fa2c06df-7627-597a-8a65-146c25695d08',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB25535',
'listing': 'auction',
'location': 'ES, El Prat de Llobregat (Barcelona)',
'make': 'MINI',
'model': 'MINI',
'odometer': 181147,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img1c/39/1c399d2f3d609946b4591cc23b55e1ca/pa/MB25535_2cd1d821518a6f924c69503d5d5d13f2.jpg',
'https://img-pa.auto1.com/img1c/39/1c399d2f3d609946b4591cc23b55e1ca/pa/MB25535_aaac71cdae41fe9242372f73b169e689.jpg',
'https://img-pa.auto1.com/img1c/39/1c399d2f3d609946b4591cc23b55e1ca/pa/MB25535_d1d9ad2c483c207d50410907b7951ce7.jpg',
'https://img-pa.auto1.com/img1c/39/1c399d2f3d609946b4591cc23b55e1ca/pa/MB25535_77325b8497e8693ca485525ad9336f58.jpg',
'https://img-pa.auto1.com/img1c/39/1c399d2f3d609946b4591cc23b55e1ca/pa/MB25535_dcbf06190d52fc1f61a186d504ac13b7.jpg',
'https://img-pa.auto1.com/img1c/39/1c399d2f3d609946b4591cc23b55e1ca/pa/MB25535_c46203e6080ef6fac56e8bae53c20606.jpg',
'https://img-pa.auto1.com/img1c/39/1c399d2f3d609946b4591cc23b55e1ca/pa/MB25535_dda401569d1c9f5e10259c9ef2d7ba0d.jpg',
'https://img-pa.auto1.com/img1c/39/1c399d2f3d609946b4591cc23b55e1ca/pa/MB25535_23d8ea6789c514c0760679d78339f407.jpg',
'https://img-pa.auto1.com/img1c/39/1c399d2f3d609946b4591cc23b55e1ca/pa/MB25535_40653780eb490cc1f8629be80f78b0a4.jpg',
'https://img-pa.auto1.com/img1c/39/1c399d2f3d609946b4591cc23b55e1ca/pa/MB25535_cf8148dc35ead91eeb1cf72359ebb227.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa2c06df-7627-597a-8a65-146c25695d08/fa2c06df-7627-597a-8a65-146c25695d08_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59253,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/img1c/39/1c399d2f3d609946b4591cc23b55e1ca/pa/MB25535_2cd1d821518a6f924c69503d5d5d13f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa2c06df-7627-597a-8a65-146c25695d08/fa2c06df-7627-597a-8a65-146c25695d08_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56949,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/img1c/39/1c399d2f3d609946b4591cc23b55e1ca/pa/MB25535_aaac71cdae41fe9242372f73b169e689.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa2c06df-7627-597a-8a65-146c25695d08/fa2c06df-7627-597a-8a65-146c25695d08_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62112,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/img1c/39/1c399d2f3d609946b4591cc23b55e1ca/pa/MB25535_d1d9ad2c483c207d50410907b7951ce7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa2c06df-7627-597a-8a65-146c25695d08/fa2c06df-7627-597a-8a65-146c25695d08_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46654,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/img1c/39/1c399d2f3d609946b4591cc23b55e1ca/pa/MB25535_77325b8497e8693ca485525ad9336f58.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa2c06df-7627-597a-8a65-146c25695d08/fa2c06df-7627-597a-8a65-146c25695d08_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52684,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/img1c/39/1c399d2f3d609946b4591cc23b55e1ca/pa/MB25535_dcbf06190d52fc1f61a186d504ac13b7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa2c06df-7627-597a-8a65-146c25695d08/fa2c06df-7627-597a-8a65-146c25695d08_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62715,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/img1c/39/1c399d2f3d609946b4591cc23b55e1ca/pa/MB25535_c46203e6080ef6fac56e8bae53c20606.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa2c06df-7627-597a-8a65-146c25695d08/fa2c06df-7627-597a-8a65-146c25695d08_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49001,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/img1c/39/1c399d2f3d609946b4591cc23b55e1ca/pa/MB25535_dda401569d1c9f5e10259c9ef2d7ba0d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa2c06df-7627-597a-8a65-146c25695d08/fa2c06df-7627-597a-8a65-146c25695d08_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54371,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/img1c/39/1c399d2f3d609946b4591cc23b55e1ca/pa/MB25535_23d8ea6789c514c0760679d78339f407.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa2c06df-7627-597a-8a65-146c25695d08/fa2c06df-7627-597a-8a65-146c25695d08_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52686,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/img1c/39/1c399d2f3d609946b4591cc23b55e1ca/pa/MB25535_40653780eb490cc1f8629be80f78b0a4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa2c06df-7627-597a-8a65-146c25695d08/fa2c06df-7627-597a-8a65-146c25695d08_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45942,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/img1c/39/1c399d2f3d609946b4591cc23b55e1ca/pa/MB25535_cf8148dc35ead91eeb1cf72359ebb227.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-08-11',
'seats_number': 5,
'seller_name': None,
'title': 'MINI One',
'transmission': 'manual',
'trim': '',
'year': 2020}
2026-03-30 11:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MB25535%27 HTTP/1.1" 200 None
2026-03-30 11:27:00 [auto1.es] INFO: Saving data for MB25535: {'created_time': 1774870020.044883, 'last_price_update_time': 1774870020.044894, 'auction_closing_time': 1774971298.0}
2026-03-30 11:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MB25535') HTTP/1.1" 204 0
2026-03-30 11:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F16%252F4c168c8c136aa5946aa3348026846a5c%252Fpa%252FLS16672_79f78bbd7dc4b47cd7aeefb950db98f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/16/4c168c8c136aa5946aa3348026846a5c/pa/LS16672_79f78bbd7dc4b47cd7aeefb950db98f9.jpg not downloaded yet
2026-03-30 11:27:00 [auto1.es] INFO: Found listing with ID: KF41905
2026-03-30 11:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KF41905%27 HTTP/1.1" 200 None
2026-03-30 11:27:00 [auto1.es] INFO: Scrape type for KF41905: 1
2026-03-30 11:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F16%252F4c168c8c136aa5946aa3348026846a5c%252Fpa%252FLS16672_eaf414ce64fde795d95555c10bd4a8a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/16/4c168c8c136aa5946aa3348026846a5c/pa/LS16672_eaf414ce64fde795d95555c10bd4a8a2.jpg not downloaded yet
2026-03-30 11:27:00 [auto1.es] INFO: Found listing with ID: AL28647
2026-03-30 11:27:00 [auto1.es] INFO: Found listing with ID: YY88672
2026-03-30 11:27:00 [auto1.es] INFO: Found listing with ID: FJ13099
2026-03-30 11:27:00 [auto1.es] INFO: Found listing with ID: AE25317
2026-03-30 11:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE25317%27 HTTP/1.1" 200 None
2026-03-30 11:27:00 [auto1.es] INFO: Scrape type for AE25317: 1
2026-03-30 11:27:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 502d3740-314f-5843-a028-26deb3dc8245 with identifier: UG86344
2026-03-30 11:27:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 502d3740-314f-5843-a028-26deb3dc8245 with scrape type 1
2026-03-30 11:27:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 502d3740-314f-5843-a028-26deb3dc8245
2026-03-30 11:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d7fa99d56b36f273d16ec02c1e9f0e%252Fpa%252FUG86344_b932dcb52854de7c4a14f5a12fb9f197.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_b932dcb52854de7c4a14f5a12fb9f197.jpg not downloaded yet
2026-03-30 11:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F16%252F4c168c8c136aa5946aa3348026846a5c%252Fpa%252FLS16672_cfcb4f025ad47344e3f9bff022ba5a84.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/16/4c168c8c136aa5946aa3348026846a5c/pa/LS16672_cfcb4f025ad47344e3f9bff022ba5a84.jpg not downloaded yet
2026-03-30 11:27:00 [auto1.es] INFO: Found listing with ID: KS42961
2026-03-30 11:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KS42961%27 HTTP/1.1" 200 None
2026-03-30 11:27:00 [auto1.es] INFO: Scrape type for KS42961: 2
2026-03-30 11:27:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 163bda9a-f042-5f2e-a012-b5420b3a7ef8 with identifier: KS42961
2026-03-30 11:27:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 163bda9a-f042-5f2e-a012-b5420b3a7ef8 with scrape type 2
2026-03-30 11:27:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 163bda9a-f042-5f2e-a012-b5420b3a7ef8 with scrape type 2
2026-03-30 11:27:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 163bda9a-f042-5f2e-a012-b5420b3a7ef8, identifier: KS42961
2026-03-30 11:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d7fa99d56b36f273d16ec02c1e9f0e%252Fpa%252FUG86344_1273f343e149d837473a094598ebd46f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_1273f343e149d837473a094598ebd46f.jpg not downloaded yet
2026-03-30 11:27:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/16/4c168c8c136aa5946aa3348026846a5c/pa/LS16672_ee5ed301c10b6a8d38c0c4a54f057e60.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 163bda9a-f042-5f2e-a012-b5420b3a7ef8 with identifier: KS42961
2026-03-30 11:27:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 163bda9a-f042-5f2e-a012-b5420b3a7ef8 with identifier: KS42961
2026-03-30 11:27:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 163bda9a-f042-5f2e-a012-b5420b3a7ef8 with identifier: KS42961 to the API
2026-03-30 11:27:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 73,
'expiration_date': '2026-03-31T15:29:25Z',
'fuel_type': 'petrol',
'id': '163bda9a-f042-5f2e-a012-b5420b3a7ef8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS42961',
'listing': 'auction',
'make': 'Peugeot',
'model': '207',
'odometer': 114839,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-04-26',
'seller_name': None,
'title': 'Peugeot 207 1.4 X Line',
'transmission': 'manual',
'trim': 'X Line',
'year': 2007}
2026-03-30 11:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KS42961%27 HTTP/1.1" 200 None
2026-03-30 11:27:00 [auto1.es] INFO: Saving data for KS42961: {'auction_closing_time': 1774970965.0, 'created_time': 1773180854.966403, 'last_price_update_time': 1774870020.748007}
2026-03-30 11:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KS42961') HTTP/1.1" 204 0
2026-03-30 11:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F16%252F4c168c8c136aa5946aa3348026846a5c%252Fpa%252FLS16672_5885c4dc46ef07864c3f23a961bc1b1c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/16/4c168c8c136aa5946aa3348026846a5c/pa/LS16672_5885c4dc46ef07864c3f23a961bc1b1c.jpg not downloaded yet
2026-03-30 11:27:00 [auto1.es] INFO: Found listing with ID: NF92534
2026-03-30 11:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NF92534%27 HTTP/1.1" 200 None
2026-03-30 11:27:00 [auto1.es] INFO: Scrape type for NF92534: 2
2026-03-30 11:27:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 158bdd38-d994-57d5-82ca-629217451489 with identifier: NF92534
2026-03-30 11:27:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 158bdd38-d994-57d5-82ca-629217451489 with scrape type 2
2026-03-30 11:27:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 158bdd38-d994-57d5-82ca-629217451489 with scrape type 2
2026-03-30 11:27:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 158bdd38-d994-57d5-82ca-629217451489, identifier: NF92534
2026-03-30 11:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d7fa99d56b36f273d16ec02c1e9f0e%252Fpa%252FUG86344_37732f696d13c6b8bf570f91db33bec2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_37732f696d13c6b8bf570f91db33bec2.jpg not downloaded yet
2026-03-30 11:27:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 158bdd38-d994-57d5-82ca-629217451489 with identifier: NF92534
2026-03-30 11:27:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 158bdd38-d994-57d5-82ca-629217451489 with identifier: NF92534
2026-03-30 11:27:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 158bdd38-d994-57d5-82ca-629217451489 with identifier: NF92534 to the API
2026-03-30 11:27:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:28:59Z',
'fuel_type': 'petrol',
'id': '158bdd38-d994-57d5-82ca-629217451489',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF92534',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 146348,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-08',
'seller_name': None,
'title': 'Opel Astra 1.4 SIDI Turbo Business Start/Stop',
'transmission': 'automatic',
'trim': 'Business Start/Stop',
'year': 2018}
2026-03-30 11:27:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NF92534%27 HTTP/1.1" 200 None
2026-03-30 11:27:01 [auto1.es] INFO: Saving data for NF92534: {'auction_closing_time': 1774970939.0, 'created_time': 1773659753.969639, 'last_price_update_time': 1774870021.292085}
2026-03-30 11:27:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NF92534') HTTP/1.1" 204 0
2026-03-30 11:27:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F16%252F4c168c8c136aa5946aa3348026846a5c%252Fpa%252FLS16672_f20939a6170deb834e54b522a8ddaf4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/16/4c168c8c136aa5946aa3348026846a5c/pa/LS16672_f20939a6170deb834e54b522a8ddaf4c.jpg not downloaded yet
2026-03-30 11:27:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/16/4c168c8c136aa5946aa3348026846a5c/pa/LS16672_79f78bbd7dc4b47cd7aeefb950db98f9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/16/4c168c8c136aa5946aa3348026846a5c/pa/LS16672_eaf414ce64fde795d95555c10bd4a8a2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:01 [auto1.es] INFO: Found listing with ID: CG52866
2026-03-30 11:27:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CG52866%27 HTTP/1.1" 200 None
2026-03-30 11:27:01 [auto1.es] INFO: Scrape type for CG52866: 2
2026-03-30 11:27:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 941e0f74-04da-5bb8-bb18-b113ccf20bd2 with identifier: CG52866
2026-03-30 11:27:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 941e0f74-04da-5bb8-bb18-b113ccf20bd2 with scrape type 2
2026-03-30 11:27:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 941e0f74-04da-5bb8-bb18-b113ccf20bd2 with scrape type 2
2026-03-30 11:27:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 941e0f74-04da-5bb8-bb18-b113ccf20bd2, identifier: CG52866
2026-03-30 11:27:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d7fa99d56b36f273d16ec02c1e9f0e%252Fpa%252FUG86344_a3639a6aff23673c4cb69343213773f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_a3639a6aff23673c4cb69343213773f8.jpg not downloaded yet
2026-03-30 11:27:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a384c50>
2026-03-30 11:27:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7c82816-a81e-56d4-8c0f-f34e352a0f2e/f7c82816-a81e-56d4-8c0f-f34e352a0f2e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:27:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F16%252F4c168c8c136aa5946aa3348026846a5c%252Fpa%252FLS16672_ee5ed301c10b6a8d38c0c4a54f057e60.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/16/4c168c8c136aa5946aa3348026846a5c/pa/LS16672_ee5ed301c10b6a8d38c0c4a54f057e60.jpg saved to cache
2026-03-30 11:27:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f7c82816-a81e-56d4-8c0f-f34e352a0f2e
2026-03-30 11:27:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/16/4c168c8c136aa5946aa3348026846a5c/pa/LS16672_cfcb4f025ad47344e3f9bff022ba5a84.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_b932dcb52854de7c4a14f5a12fb9f197.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 941e0f74-04da-5bb8-bb18-b113ccf20bd2 with identifier: CG52866
2026-03-30 11:27:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:27:01 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-30 11:27:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:27:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:27:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 941e0f74-04da-5bb8-bb18-b113ccf20bd2 with identifier: CG52866
2026-03-30 11:27:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 941e0f74-04da-5bb8-bb18-b113ccf20bd2 with identifier: CG52866 to the API
2026-03-30 11:27:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'violet',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 135,
'expiration_date': '2026-03-31T15:51:32Z',
'fuel_type': 'petrol',
'id': '941e0f74-04da-5bb8-bb18-b113ccf20bd2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG52866',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 153577,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1998-03-11',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 200 Avantgarde',
'transmission': 'manual',
'trim': 'Avantgarde',
'year': 1998}
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CG52866%27 HTTP/1.1" 200 None
2026-03-30 11:27:02 [auto1.es] INFO: Saving data for CG52866: {'auction_closing_time': 1774972292.0, 'created_time': 1772753190.925182, 'last_price_update_time': 1774870022.490556}
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CG52866') HTTP/1.1" 204 0
2026-03-30 11:27:02 [auto1.es] INFO: Found listing with ID: GU22619
2026-03-30 11:27:02 [auto1.es] INFO: Found listing with ID: FR20157
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FR20157%27 HTTP/1.1" 200 None
2026-03-30 11:27:02 [auto1.es] INFO: Scrape type for FR20157: 2
2026-03-30 11:27:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50b7860c-4571-50e9-b889-96708076a610 with identifier: FR20157
2026-03-30 11:27:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50b7860c-4571-50e9-b889-96708076a610 with scrape type 2
2026-03-30 11:27:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50b7860c-4571-50e9-b889-96708076a610 with scrape type 2
2026-03-30 11:27:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 50b7860c-4571-50e9-b889-96708076a610, identifier: FR20157
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d7fa99d56b36f273d16ec02c1e9f0e%252Fpa%252FUG86344_e10b78acfef2b461fa494ab807571257.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_e10b78acfef2b461fa494ab807571257.jpg not downloaded yet
2026-03-30 11:27:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 50b7860c-4571-50e9-b889-96708076a610 with identifier: FR20157
2026-03-30 11:27:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 50b7860c-4571-50e9-b889-96708076a610 with identifier: FR20157
2026-03-30 11:27:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 50b7860c-4571-50e9-b889-96708076a610 with identifier: FR20157 to the API
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 70,
'expiration_date': '2026-03-31T15:42:57Z',
'fuel_type': 'petrol',
'id': '50b7860c-4571-50e9-b889-96708076a610',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR20157',
'listing': 'auction',
'make': 'Fiat',
'model': '500C',
'odometer': 48694,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-24',
'seller_name': None,
'title': 'Fiat 500C 1.2 Lounge',
'transmission': 'automatic',
'trim': 'Lounge',
'year': 2021}
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FR20157%27 HTTP/1.1" 200 None
2026-03-30 11:27:02 [auto1.es] INFO: Saving data for FR20157: {'auction_closing_time': 1774971777.0, 'created_time': 1774296392.990234, 'last_price_update_time': 1774870022.973726}
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FR20157') HTTP/1.1" 204 0
2026-03-30 11:27:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:27:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a393810>
2026-03-30 11:27:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7c82816-a81e-56d4-8c0f-f34e352a0f2e/f7c82816-a81e-56d4-8c0f-f34e352a0f2e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F16%252F4c168c8c136aa5946aa3348026846a5c%252Fpa%252FLS16672_79f78bbd7dc4b47cd7aeefb950db98f9.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/16/4c168c8c136aa5946aa3348026846a5c/pa/LS16672_79f78bbd7dc4b47cd7aeefb950db98f9.jpg saved to cache
2026-03-30 11:27:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f7c82816-a81e-56d4-8c0f-f34e352a0f2e
2026-03-30 11:27:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3dbfd0>
2026-03-30 11:27:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7c82816-a81e-56d4-8c0f-f34e352a0f2e/f7c82816-a81e-56d4-8c0f-f34e352a0f2e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F16%252F4c168c8c136aa5946aa3348026846a5c%252Fpa%252FLS16672_eaf414ce64fde795d95555c10bd4a8a2.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/16/4c168c8c136aa5946aa3348026846a5c/pa/LS16672_eaf414ce64fde795d95555c10bd4a8a2.jpg saved to cache
2026-03-30 11:27:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f7c82816-a81e-56d4-8c0f-f34e352a0f2e
2026-03-30 11:27:03 [auto1.es] INFO: Found listing with ID: ZA02456
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZA02456%27 HTTP/1.1" 200 None
2026-03-30 11:27:03 [auto1.es] INFO: Scrape type for ZA02456: 2
2026-03-30 11:27:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e2044af-7bfa-527a-8775-bcc642ba2c66 with identifier: ZA02456
2026-03-30 11:27:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e2044af-7bfa-527a-8775-bcc642ba2c66 with scrape type 2
2026-03-30 11:27:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e2044af-7bfa-527a-8775-bcc642ba2c66 with scrape type 2
2026-03-30 11:27:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2e2044af-7bfa-527a-8775-bcc642ba2c66, identifier: ZA02456
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d7fa99d56b36f273d16ec02c1e9f0e%252Fpa%252FUG86344_0c57b9ab585ca88e3917c06c602ebce3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_0c57b9ab585ca88e3917c06c602ebce3.jpg not downloaded yet
2026-03-30 11:27:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a20d750>
2026-03-30 11:27:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7c82816-a81e-56d4-8c0f-f34e352a0f2e/f7c82816-a81e-56d4-8c0f-f34e352a0f2e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F16%252F4c168c8c136aa5946aa3348026846a5c%252Fpa%252FLS16672_cfcb4f025ad47344e3f9bff022ba5a84.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/16/4c168c8c136aa5946aa3348026846a5c/pa/LS16672_cfcb4f025ad47344e3f9bff022ba5a84.jpg saved to cache
2026-03-30 11:27:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f7c82816-a81e-56d4-8c0f-f34e352a0f2e
2026-03-30 11:27:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a235810>
2026-03-30 11:27:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502d3740-314f-5843-a028-26deb3dc8245/502d3740-314f-5843-a028-26deb3dc8245_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d7fa99d56b36f273d16ec02c1e9f0e%252Fpa%252FUG86344_b932dcb52854de7c4a14f5a12fb9f197.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_b932dcb52854de7c4a14f5a12fb9f197.jpg saved to cache
2026-03-30 11:27:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 502d3740-314f-5843-a028-26deb3dc8245
2026-03-30 11:27:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_37732f696d13c6b8bf570f91db33bec2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/16/4c168c8c136aa5946aa3348026846a5c/pa/LS16672_5885c4dc46ef07864c3f23a961bc1b1c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2e2044af-7bfa-527a-8775-bcc642ba2c66 with identifier: ZA02456
2026-03-30 11:27:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2e2044af-7bfa-527a-8775-bcc642ba2c66 with identifier: ZA02456
2026-03-30 11:27:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2e2044af-7bfa-527a-8775-bcc642ba2c66 with identifier: ZA02456 to the API
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-31T15:15:58Z',
'fuel_type': 'diesel',
'id': '2e2044af-7bfa-527a-8775-bcc642ba2c66',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA02456',
'listing': 'auction',
'make': 'Audi',
'model': 'A5 Sportback',
'odometer': 52994,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-11',
'seller_name': None,
'title': 'Audi A5 Sportback 35 TDI Mild-Hybrid S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2022}
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZA02456%27 HTTP/1.1" 200 None
2026-03-30 11:27:03 [auto1.es] INFO: Saving data for ZA02456: {'auction_closing_time': 1774970158.0, 'created_time': 1773127055.254312, 'last_price_update_time': 1774870023.700213}
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZA02456') HTTP/1.1" 204 0
2026-03-30 11:27:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_1273f343e149d837473a094598ebd46f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/16/4c168c8c136aa5946aa3348026846a5c/pa/LS16672_f20939a6170deb834e54b522a8ddaf4c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:03 [auto1.es] INFO: Found listing with ID: KM07584
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KM07584%27 HTTP/1.1" 200 None
2026-03-30 11:27:03 [auto1.es] INFO: Scrape type for KM07584: 2
2026-03-30 11:27:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72ca9e45-6eda-5733-acbc-b60f25e45230 with identifier: KM07584
2026-03-30 11:27:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72ca9e45-6eda-5733-acbc-b60f25e45230 with scrape type 2
2026-03-30 11:27:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72ca9e45-6eda-5733-acbc-b60f25e45230 with scrape type 2
2026-03-30 11:27:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 72ca9e45-6eda-5733-acbc-b60f25e45230, identifier: KM07584
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d7fa99d56b36f273d16ec02c1e9f0e%252Fpa%252FUG86344_8c07b241ed52941549a85d3ef63f8e4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_8c07b241ed52941549a85d3ef63f8e4c.jpg not downloaded yet
2026-03-30 11:27:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 72ca9e45-6eda-5733-acbc-b60f25e45230 with identifier: KM07584
2026-03-30 11:27:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 72ca9e45-6eda-5733-acbc-b60f25e45230 with identifier: KM07584
2026-03-30 11:27:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 72ca9e45-6eda-5733-acbc-b60f25e45230 with identifier: KM07584 to the API
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:49:55Z',
'fuel_type': 'petrol',
'id': '72ca9e45-6eda-5733-acbc-b60f25e45230',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM07584',
'listing': 'auction',
'make': 'Renault',
'model': 'Captur',
'odometer': 19442,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-29',
'seller_name': None,
'title': 'Renault Captur 1.3 TCe Mild-Hybrid Techno',
'transmission': 'manual',
'trim': 'Techno',
'year': 2023}
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KM07584%27 HTTP/1.1" 200 None
2026-03-30 11:27:04 [auto1.es] INFO: Saving data for KM07584: {'auction_closing_time': 1774972195.0, 'created_time': 1774350727.673712, 'last_price_update_time': 1774870024.252729}
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KM07584') HTTP/1.1" 204 0
2026-03-30 11:27:04 [auto1.es] INFO: Found listing with ID: KN50238
2026-03-30 11:27:04 [auto1.es] INFO: Found listing with ID: DG01155
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DG01155%27 HTTP/1.1" 200 None
2026-03-30 11:27:04 [auto1.es] INFO: Scrape type for DG01155: 1
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d7fa99d56b36f273d16ec02c1e9f0e%252Fpa%252FUG86344_43186dba2f1f97d9b9c5b4f122b416df.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_43186dba2f1f97d9b9c5b4f122b416df.jpg not downloaded yet
2026-03-30 11:27:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RN47557> (referer: https://www.auto1.com/v1/car-details-view/RN47557/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a23d010>
2026-03-30 11:27:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502d3740-314f-5843-a028-26deb3dc8245/502d3740-314f-5843-a028-26deb3dc8245_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d7fa99d56b36f273d16ec02c1e9f0e%252Fpa%252FUG86344_37732f696d13c6b8bf570f91db33bec2.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_37732f696d13c6b8bf570f91db33bec2.jpg saved to cache
2026-03-30 11:27:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 502d3740-314f-5843-a028-26deb3dc8245
2026-03-30 11:27:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060d04e50>
2026-03-30 11:27:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7c82816-a81e-56d4-8c0f-f34e352a0f2e/f7c82816-a81e-56d4-8c0f-f34e352a0f2e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F16%252F4c168c8c136aa5946aa3348026846a5c%252Fpa%252FLS16672_5885c4dc46ef07864c3f23a961bc1b1c.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/16/4c168c8c136aa5946aa3348026846a5c/pa/LS16672_5885c4dc46ef07864c3f23a961bc1b1c.jpg saved to cache
2026-03-30 11:27:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f7c82816-a81e-56d4-8c0f-f34e352a0f2e
2026-03-30 11:27:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a227910>
2026-03-30 11:27:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502d3740-314f-5843-a028-26deb3dc8245/502d3740-314f-5843-a028-26deb3dc8245_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d7fa99d56b36f273d16ec02c1e9f0e%252Fpa%252FUG86344_1273f343e149d837473a094598ebd46f.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_1273f343e149d837473a094598ebd46f.jpg saved to cache
2026-03-30 11:27:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 502d3740-314f-5843-a028-26deb3dc8245
2026-03-30 11:27:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a209c10>
2026-03-30 11:27:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7c82816-a81e-56d4-8c0f-f34e352a0f2e/f7c82816-a81e-56d4-8c0f-f34e352a0f2e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F16%252F4c168c8c136aa5946aa3348026846a5c%252Fpa%252FLS16672_f20939a6170deb834e54b522a8ddaf4c.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/16/4c168c8c136aa5946aa3348026846a5c/pa/LS16672_f20939a6170deb834e54b522a8ddaf4c.jpg saved to cache
2026-03-30 11:27:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f7c82816-a81e-56d4-8c0f-f34e352a0f2e
2026-03-30 11:27:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f7c82816-a81e-56d4-8c0f-f34e352a0f2e, skipping ID generation
2026-03-30 11:27:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7c82816-a81e-56d4-8c0f-f34e352a0f2e with scrape type 1
2026-03-30 11:27:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f7c82816-a81e-56d4-8c0f-f34e352a0f2e sending to next pipeline
2026-03-30 11:27:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f7c82816-a81e-56d4-8c0f-f34e352a0f2e, identifier: LS16672
2026-03-30 11:27:04 [scrapy.extensions.logstats] INFO: Crawled 163 pages (at 21 pages/min), scraped 192 items (at 25 items/min)
2026-03-30 11:27:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 161MiB
2026-03-30 11:27:04 [auto1.es] INFO: Found listing with ID: PM66959
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PM66959%27 HTTP/1.1" 200 None
2026-03-30 11:27:04 [auto1.es] INFO: Scrape type for PM66959: 1
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d7fa99d56b36f273d16ec02c1e9f0e%252Fpa%252FUG86344_3a46a978d0598850706525e9645bf44b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_3a46a978d0598850706525e9645bf44b.jpg not downloaded yet
2026-03-30 11:27:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f7c82816-a81e-56d4-8c0f-f34e352a0f2e with identifier: LS16672
2026-03-30 11:27:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f7c82816-a81e-56d4-8c0f-f34e352a0f2e with identifier: LS16672
2026-03-30 11:27:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f7c82816-a81e-56d4-8c0f-f34e352a0f2e with identifier: LS16672 to the API
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4c/16/4c168c8c136aa5946aa3348026846a5c/pa/LS16672_f20939a6170deb834e54b522a8ddaf4c.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.9L',
'engine_horse_power': 105,
'expiration_date': '2026-03-31T15:41:43Z',
'fuel_type': 'diesel',
'id': 'f7c82816-a81e-56d4-8c0f-f34e352a0f2e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS16672',
'listing': 'auction',
'location': 'ES, Barberà del Vallès',
'make': 'Seat',
'model': 'Leon',
'odometer': 260536,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7c82816-a81e-56d4-8c0f-f34e352a0f2e/f7c82816-a81e-56d4-8c0f-f34e352a0f2e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106731,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/16/4c168c8c136aa5946aa3348026846a5c/pa/LS16672_ee5ed301c10b6a8d38c0c4a54f057e60.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7c82816-a81e-56d4-8c0f-f34e352a0f2e/f7c82816-a81e-56d4-8c0f-f34e352a0f2e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91693,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/16/4c168c8c136aa5946aa3348026846a5c/pa/LS16672_79f78bbd7dc4b47cd7aeefb950db98f9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7c82816-a81e-56d4-8c0f-f34e352a0f2e/f7c82816-a81e-56d4-8c0f-f34e352a0f2e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71683,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/16/4c168c8c136aa5946aa3348026846a5c/pa/LS16672_eaf414ce64fde795d95555c10bd4a8a2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7c82816-a81e-56d4-8c0f-f34e352a0f2e/f7c82816-a81e-56d4-8c0f-f34e352a0f2e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63034,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/16/4c168c8c136aa5946aa3348026846a5c/pa/LS16672_cfcb4f025ad47344e3f9bff022ba5a84.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7c82816-a81e-56d4-8c0f-f34e352a0f2e/f7c82816-a81e-56d4-8c0f-f34e352a0f2e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70451,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/16/4c168c8c136aa5946aa3348026846a5c/pa/LS16672_5885c4dc46ef07864c3f23a961bc1b1c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7c82816-a81e-56d4-8c0f-f34e352a0f2e/f7c82816-a81e-56d4-8c0f-f34e352a0f2e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99603,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/16/4c168c8c136aa5946aa3348026846a5c/pa/LS16672_f20939a6170deb834e54b522a8ddaf4c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-07-16',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Leon 1.9 TDI Style Ecomotive',
'transmission': 'manual',
'trim': 'Style Ecomotive',
'year': 2009}
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LS16672%27 HTTP/1.1" 200 None
2026-03-30 11:27:05 [auto1.es] INFO: Saving data for LS16672: {'created_time': 1774870025.019014, 'last_price_update_time': 1774870025.019025, 'auction_closing_time': 1774971703.0}
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LS16672') HTTP/1.1" 204 0
2026-03-30 11:27:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_e10b78acfef2b461fa494ab807571257.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_0c57b9ab585ca88e3917c06c602ebce3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_a3639a6aff23673c4cb69343213773f8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:05 [auto1.es] INFO: Found listing with ID: VU06116
2026-03-30 11:27:05 [auto1.es] INFO: Found listing with ID: BS90699
2026-03-30 11:27:05 [auto1.es] INFO: Found listing with ID: ZL43792
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL43792%27 HTTP/1.1" 200 None
2026-03-30 11:27:05 [auto1.es] INFO: Scrape type for ZL43792: 2
2026-03-30 11:27:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 065174aa-1c06-5f9e-b813-020d8f056368 with identifier: ZL43792
2026-03-30 11:27:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 065174aa-1c06-5f9e-b813-020d8f056368 with scrape type 2
2026-03-30 11:27:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 065174aa-1c06-5f9e-b813-020d8f056368 with scrape type 2
2026-03-30 11:27:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 065174aa-1c06-5f9e-b813-020d8f056368, identifier: ZL43792
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d7fa99d56b36f273d16ec02c1e9f0e%252Fpa%252FUG86344_dd82a0465c99c4b81df6a40c60a3bf28.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_dd82a0465c99c4b81df6a40c60a3bf28.jpg not downloaded yet
2026-03-30 11:27:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b9f4f04-b880-5ee9-8b22-c54f7729eabc with identifier: RN47557
2026-03-30 11:27:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b9f4f04-b880-5ee9-8b22-c54f7729eabc with scrape type 1
2026-03-30 11:27:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1b9f4f04-b880-5ee9-8b22-c54f7729eabc
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1a%252Fae1a038166a7603e79c1578813dbae0a%252Fpa%252FRN47557_9848c34b8f792ee1f8efa11eb9c860af.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_9848c34b8f792ee1f8efa11eb9c860af.jpg not downloaded yet
2026-03-30 11:27:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 065174aa-1c06-5f9e-b813-020d8f056368 with identifier: ZL43792
2026-03-30 11:27:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 065174aa-1c06-5f9e-b813-020d8f056368 with identifier: ZL43792
2026-03-30 11:27:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 065174aa-1c06-5f9e-b813-020d8f056368 with identifier: ZL43792 to the API
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:46:17Z',
'fuel_type': 'petrol',
'id': '065174aa-1c06-5f9e-b813-020d8f056368',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL43792',
'listing': 'auction',
'make': 'Peugeot',
'model': '1007',
'odometer': 101658,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-07-06',
'seller_name': None,
'title': 'Peugeot 1007 1.4 Premium',
'transmission': 'automatic',
'trim': 'Premium',
'year': 2005}
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL43792%27 HTTP/1.1" 200 None
2026-03-30 11:27:05 [auto1.es] INFO: Saving data for ZL43792: {'auction_closing_time': 1774971977.0, 'created_time': 1774263977.590889, 'last_price_update_time': 1774870025.498761}
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZL43792') HTTP/1.1" 204 0
2026-03-30 11:27:05 [auto1.es] INFO: Found listing with ID: LE48212
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LE48212%27 HTTP/1.1" 200 None
2026-03-30 11:27:05 [auto1.es] INFO: Scrape type for LE48212: 2
2026-03-30 11:27:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2618fc86-a7ad-5c9c-8dab-8568b3fa17c2 with identifier: LE48212
2026-03-30 11:27:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2618fc86-a7ad-5c9c-8dab-8568b3fa17c2 with scrape type 2
2026-03-30 11:27:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2618fc86-a7ad-5c9c-8dab-8568b3fa17c2 with scrape type 2
2026-03-30 11:27:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2618fc86-a7ad-5c9c-8dab-8568b3fa17c2, identifier: LE48212
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1a%252Fae1a038166a7603e79c1578813dbae0a%252Fpa%252FRN47557_779f861be1e988d060e258d3b3e0166d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_779f861be1e988d060e258d3b3e0166d.jpg not downloaded yet
2026-03-30 11:27:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2618fc86-a7ad-5c9c-8dab-8568b3fa17c2 with identifier: LE48212
2026-03-30 11:27:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2618fc86-a7ad-5c9c-8dab-8568b3fa17c2 with identifier: LE48212
2026-03-30 11:27:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2618fc86-a7ad-5c9c-8dab-8568b3fa17c2 with identifier: LE48212 to the API
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:27:36Z',
'fuel_type': 'diesel',
'id': '2618fc86-a7ad-5c9c-8dab-8568b3fa17c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE48212',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Vito',
'odometer': 141291,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-23',
'seller_name': None,
'title': 'Mercedes-Benz Vito 111 CDI Lang',
'transmission': 'manual',
'trim': 'Lang',
'year': 2018}
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LE48212%27 HTTP/1.1" 200 None
2026-03-30 11:27:05 [auto1.es] INFO: Saving data for LE48212: {'auction_closing_time': 1774970856.0, 'created_time': 1773691536.582231, 'last_price_update_time': 1774870025.983319}
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LE48212') HTTP/1.1" 204 0
2026-03-30 11:27:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_8c07b241ed52941549a85d3ef63f8e4c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1a%252Fae1a038166a7603e79c1578813dbae0a%252Fpa%252FRN47557_5e61babdbbcbd95de590b3c254ec40ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_5e61babdbbcbd95de590b3c254ec40ef.jpg not downloaded yet
2026-03-30 11:27:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a2003d0>
2026-03-30 11:27:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502d3740-314f-5843-a028-26deb3dc8245/502d3740-314f-5843-a028-26deb3dc8245_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d7fa99d56b36f273d16ec02c1e9f0e%252Fpa%252FUG86344_e10b78acfef2b461fa494ab807571257.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_e10b78acfef2b461fa494ab807571257.jpg saved to cache
2026-03-30 11:27:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 502d3740-314f-5843-a028-26deb3dc8245
2026-03-30 11:27:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4b4e50>
2026-03-30 11:27:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502d3740-314f-5843-a028-26deb3dc8245/502d3740-314f-5843-a028-26deb3dc8245_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d7fa99d56b36f273d16ec02c1e9f0e%252Fpa%252FUG86344_0c57b9ab585ca88e3917c06c602ebce3.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_0c57b9ab585ca88e3917c06c602ebce3.jpg saved to cache
2026-03-30 11:27:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 502d3740-314f-5843-a028-26deb3dc8245
2026-03-30 11:27:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a32c150>
2026-03-30 11:27:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502d3740-314f-5843-a028-26deb3dc8245/502d3740-314f-5843-a028-26deb3dc8245_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d7fa99d56b36f273d16ec02c1e9f0e%252Fpa%252FUG86344_a3639a6aff23673c4cb69343213773f8.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_a3639a6aff23673c4cb69343213773f8.jpg saved to cache
2026-03-30 11:27:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 502d3740-314f-5843-a028-26deb3dc8245
2026-03-30 11:27:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_43186dba2f1f97d9b9c5b4f122b416df.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_3a46a978d0598850706525e9645bf44b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1a%252Fae1a038166a7603e79c1578813dbae0a%252Fpa%252FRN47557_01348f008e685e81c3970761b0a85fa9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_01348f008e685e81c3970761b0a85fa9.jpg not downloaded yet
2026-03-30 11:27:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VL95678/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:06 [auto1.es] INFO: Channel: 24h | Page: 12 | totalHits: 2236 | hits on page: 40
2026-03-30 11:27:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4bcd10>
2026-03-30 11:27:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502d3740-314f-5843-a028-26deb3dc8245/502d3740-314f-5843-a028-26deb3dc8245_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d7fa99d56b36f273d16ec02c1e9f0e%252Fpa%252FUG86344_8c07b241ed52941549a85d3ef63f8e4c.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_8c07b241ed52941549a85d3ef63f8e4c.jpg saved to cache
2026-03-30 11:27:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 502d3740-314f-5843-a028-26deb3dc8245
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1a%252Fae1a038166a7603e79c1578813dbae0a%252Fpa%252FRN47557_d3ac3a328d385ced3bc68914e0eb4d0d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_d3ac3a328d385ced3bc68914e0eb4d0d.jpg not downloaded yet
2026-03-30 11:27:06 [auto1.es] INFO: Found listing with ID: ZL36103
2026-03-30 11:27:06 [auto1.es] INFO: Found listing with ID: YA12950
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YA12950%27 HTTP/1.1" 200 None
2026-03-30 11:27:06 [auto1.es] INFO: Scrape type for YA12950: 2
2026-03-30 11:27:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fd5c659-5f25-5e8a-b3cd-3d4c5658b155 with identifier: YA12950
2026-03-30 11:27:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fd5c659-5f25-5e8a-b3cd-3d4c5658b155 with scrape type 2
2026-03-30 11:27:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2fd5c659-5f25-5e8a-b3cd-3d4c5658b155 with scrape type 2
2026-03-30 11:27:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2fd5c659-5f25-5e8a-b3cd-3d4c5658b155, identifier: YA12950
2026-03-30 11:27:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_9848c34b8f792ee1f8efa11eb9c860af.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1a%252Fae1a038166a7603e79c1578813dbae0a%252Fpa%252FRN47557_c930d4dc2ffad41867b615b3ab55ee4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_c930d4dc2ffad41867b615b3ab55ee4f.jpg not downloaded yet
2026-03-30 11:27:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2fd5c659-5f25-5e8a-b3cd-3d4c5658b155 with identifier: YA12950
2026-03-30 11:27:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2fd5c659-5f25-5e8a-b3cd-3d4c5658b155 with identifier: YA12950
2026-03-30 11:27:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2fd5c659-5f25-5e8a-b3cd-3d4c5658b155 with identifier: YA12950 to the API
2026-03-30 11:27:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-31T15:17:22Z',
'fuel_type': 'diesel',
'id': '2fd5c659-5f25-5e8a-b3cd-3d4c5658b155',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA12950',
'listing': 'auction',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 205512,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-23',
'seller_name': None,
'title': 'Citroen Berlingo 1.5 Blue-HDi Feel M',
'transmission': 'manual',
'trim': 'Feel M',
'year': 2021}
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YA12950%27 HTTP/1.1" 200 None
2026-03-30 11:27:07 [auto1.es] INFO: Saving data for YA12950: {'auction_closing_time': 1774970242.0, 'created_time': 1773238363.137876, 'last_price_update_time': 1774870027.396709}
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YA12950') HTTP/1.1" 204 0
2026-03-30 11:27:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_dd82a0465c99c4b81df6a40c60a3bf28.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:07 [auto1.es] INFO: Found listing with ID: YP69224
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YP69224%27 HTTP/1.1" 200 None
2026-03-30 11:27:07 [auto1.es] INFO: Scrape type for YP69224: 1
2026-03-30 11:27:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_779f861be1e988d060e258d3b3e0166d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1a%252Fae1a038166a7603e79c1578813dbae0a%252Fpa%252FRN47557_57b60cd4c7d2b7bd246baa62898a33bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_57b60cd4c7d2b7bd246baa62898a33bb.jpg not downloaded yet
2026-03-30 11:27:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_5e61babdbbcbd95de590b3c254ec40ef.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:07 [auto1.es] INFO: Found listing with ID: YH27551
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH27551%27 HTTP/1.1" 200 None
2026-03-30 11:27:07 [auto1.es] INFO: Scrape type for YH27551: 2
2026-03-30 11:27:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b695171-964d-5c99-9b2b-7b0e3068aa07 with identifier: YH27551
2026-03-30 11:27:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b695171-964d-5c99-9b2b-7b0e3068aa07 with scrape type 2
2026-03-30 11:27:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b695171-964d-5c99-9b2b-7b0e3068aa07 with scrape type 2
2026-03-30 11:27:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5b695171-964d-5c99-9b2b-7b0e3068aa07, identifier: YH27551
2026-03-30 11:27:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XC17897/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JW87659> (referer: https://www.auto1.com/v1/car-details-view/JW87659/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a324e50>
2026-03-30 11:27:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502d3740-314f-5843-a028-26deb3dc8245/502d3740-314f-5843-a028-26deb3dc8245_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d7fa99d56b36f273d16ec02c1e9f0e%252Fpa%252FUG86344_43186dba2f1f97d9b9c5b4f122b416df.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_43186dba2f1f97d9b9c5b4f122b416df.jpg saved to cache
2026-03-30 11:27:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 502d3740-314f-5843-a028-26deb3dc8245
2026-03-30 11:27:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a492c10>
2026-03-30 11:27:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502d3740-314f-5843-a028-26deb3dc8245/502d3740-314f-5843-a028-26deb3dc8245_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d7fa99d56b36f273d16ec02c1e9f0e%252Fpa%252FUG86344_3a46a978d0598850706525e9645bf44b.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_3a46a978d0598850706525e9645bf44b.jpg saved to cache
2026-03-30 11:27:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 502d3740-314f-5843-a028-26deb3dc8245
2026-03-30 11:27:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a251a50>
2026-03-30 11:27:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b9f4f04-b880-5ee9-8b22-c54f7729eabc/1b9f4f04-b880-5ee9-8b22-c54f7729eabc_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1a%252Fae1a038166a7603e79c1578813dbae0a%252Fpa%252FRN47557_9848c34b8f792ee1f8efa11eb9c860af.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_9848c34b8f792ee1f8efa11eb9c860af.jpg saved to cache
2026-03-30 11:27:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1b9f4f04-b880-5ee9-8b22-c54f7729eabc
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1a%252Fae1a038166a7603e79c1578813dbae0a%252Fpa%252FRN47557_95b0f4b23e821ec870b0595600516d83.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_95b0f4b23e821ec870b0595600516d83.jpg not downloaded yet
2026-03-30 11:27:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5b695171-964d-5c99-9b2b-7b0e3068aa07 with identifier: YH27551
2026-03-30 11:27:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5b695171-964d-5c99-9b2b-7b0e3068aa07 with identifier: YH27551
2026-03-30 11:27:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5b695171-964d-5c99-9b2b-7b0e3068aa07 with identifier: YH27551 to the API
2026-03-30 11:27:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-31T15:06:00Z',
'fuel_type': 'diesel',
'id': '5b695171-964d-5c99-9b2b-7b0e3068aa07',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH27551',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 207309,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-06',
'seller_name': None,
'title': 'Kia Sportage 1.6 CRDi GT Line Essential 2WD',
'transmission': 'automatic',
'trim': 'GT Line Essential 2WD',
'year': 2018}
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH27551%27 HTTP/1.1" 200 None
2026-03-30 11:27:08 [auto1.es] INFO: Saving data for YH27551: {'auction_closing_time': 1774969560.0, 'created_time': 1774523173.436151, 'last_price_update_time': 1774870028.179805}
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YH27551') HTTP/1.1" 204 0
2026-03-30 11:27:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:08 [auto1.es] INFO: Found listing with ID: AH43574
2026-03-30 11:27:08 [auto1.es] INFO: Found listing with ID: MR95745
2026-03-30 11:27:08 [auto1.es] INFO: Found listing with ID: FR76848
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FR76848%27 HTTP/1.1" 200 None
2026-03-30 11:27:08 [auto1.es] INFO: Scrape type for FR76848: 1
2026-03-30 11:27:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_d3ac3a328d385ced3bc68914e0eb4d0d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1a%252Fae1a038166a7603e79c1578813dbae0a%252Fpa%252FRN47557_52fb14971089a431d2f0669754ec3403.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_52fb14971089a431d2f0669754ec3403.jpg not downloaded yet
2026-03-30 11:27:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a248f90>
2026-03-30 11:27:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502d3740-314f-5843-a028-26deb3dc8245/502d3740-314f-5843-a028-26deb3dc8245_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d7fa99d56b36f273d16ec02c1e9f0e%252Fpa%252FUG86344_dd82a0465c99c4b81df6a40c60a3bf28.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_dd82a0465c99c4b81df6a40c60a3bf28.jpg saved to cache
2026-03-30 11:27:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 502d3740-314f-5843-a028-26deb3dc8245
2026-03-30 11:27:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 502d3740-314f-5843-a028-26deb3dc8245, skipping ID generation
2026-03-30 11:27:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 502d3740-314f-5843-a028-26deb3dc8245 with scrape type 1
2026-03-30 11:27:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 502d3740-314f-5843-a028-26deb3dc8245 sending to next pipeline
2026-03-30 11:27:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 502d3740-314f-5843-a028-26deb3dc8245, identifier: UG86344
2026-03-30 11:27:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ae4a010>
2026-03-30 11:27:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b9f4f04-b880-5ee9-8b22-c54f7729eabc/1b9f4f04-b880-5ee9-8b22-c54f7729eabc_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1a%252Fae1a038166a7603e79c1578813dbae0a%252Fpa%252FRN47557_779f861be1e988d060e258d3b3e0166d.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_779f861be1e988d060e258d3b3e0166d.jpg saved to cache
2026-03-30 11:27:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1b9f4f04-b880-5ee9-8b22-c54f7729eabc
2026-03-30 11:27:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4acd50>
2026-03-30 11:27:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b9f4f04-b880-5ee9-8b22-c54f7729eabc/1b9f4f04-b880-5ee9-8b22-c54f7729eabc_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1a%252Fae1a038166a7603e79c1578813dbae0a%252Fpa%252FRN47557_5e61babdbbcbd95de590b3c254ec40ef.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_5e61babdbbcbd95de590b3c254ec40ef.jpg saved to cache
2026-03-30 11:27:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1b9f4f04-b880-5ee9-8b22-c54f7729eabc
2026-03-30 11:27:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 017c573b-093b-53b1-b74b-e0934a35704e with identifier: JW87659
2026-03-30 11:27:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 017c573b-093b-53b1-b74b-e0934a35704e with scrape type 1
2026-03-30 11:27:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 017c573b-093b-53b1-b74b-e0934a35704e
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F6f%252F176fcd8315639d28d2c2fac517629727%252Fpa%252FJW87659_08429a0bf7969c20e60e2a03cbb68a0f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/6f/176fcd8315639d28d2c2fac517629727/pa/JW87659_08429a0bf7969c20e60e2a03cbb68a0f.jpg not downloaded yet
2026-03-30 11:27:08 [auto1.es] INFO: Found listing with ID: LN55332
2026-03-30 11:27:08 [auto1.es] INFO: Found listing with ID: BM68375
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BM68375%27 HTTP/1.1" 200 None
2026-03-30 11:27:08 [auto1.es] INFO: Scrape type for BM68375: 2
2026-03-30 11:27:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a532255b-77c2-5bc7-9816-40ad5557b37c with identifier: BM68375
2026-03-30 11:27:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a532255b-77c2-5bc7-9816-40ad5557b37c with scrape type 2
2026-03-30 11:27:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a532255b-77c2-5bc7-9816-40ad5557b37c with scrape type 2
2026-03-30 11:27:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a532255b-77c2-5bc7-9816-40ad5557b37c, identifier: BM68375
2026-03-30 11:27:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 502d3740-314f-5843-a028-26deb3dc8245 with identifier: UG86344
2026-03-30 11:27:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 502d3740-314f-5843-a028-26deb3dc8245 with identifier: UG86344
2026-03-30 11:27:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 502d3740-314f-5843-a028-26deb3dc8245 with identifier: UG86344 to the API
2026-03-30 11:27:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_dd82a0465c99c4b81df6a40c60a3bf28.jpg>
{'auction_title': '',
'c_o_2_emission_value': 126,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 185,
'expiration_date': '2026-03-31T15:39:45Z',
'fuel_type': 'diesel',
'id': '502d3740-314f-5843-a028-26deb3dc8245',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG86344',
'listing': 'auction',
'location': 'ES, Churra (Murcia)',
'make': 'BMW',
'model': '1er',
'odometer': 398300,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502d3740-314f-5843-a028-26deb3dc8245/502d3740-314f-5843-a028-26deb3dc8245_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100010,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_b932dcb52854de7c4a14f5a12fb9f197.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502d3740-314f-5843-a028-26deb3dc8245/502d3740-314f-5843-a028-26deb3dc8245_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95671,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_1273f343e149d837473a094598ebd46f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502d3740-314f-5843-a028-26deb3dc8245/502d3740-314f-5843-a028-26deb3dc8245_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94371,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_37732f696d13c6b8bf570f91db33bec2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502d3740-314f-5843-a028-26deb3dc8245/502d3740-314f-5843-a028-26deb3dc8245_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82195,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_a3639a6aff23673c4cb69343213773f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502d3740-314f-5843-a028-26deb3dc8245/502d3740-314f-5843-a028-26deb3dc8245_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93749,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_e10b78acfef2b461fa494ab807571257.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502d3740-314f-5843-a028-26deb3dc8245/502d3740-314f-5843-a028-26deb3dc8245_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90249,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_0c57b9ab585ca88e3917c06c602ebce3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502d3740-314f-5843-a028-26deb3dc8245/502d3740-314f-5843-a028-26deb3dc8245_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80196,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_8c07b241ed52941549a85d3ef63f8e4c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502d3740-314f-5843-a028-26deb3dc8245/502d3740-314f-5843-a028-26deb3dc8245_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85835,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_43186dba2f1f97d9b9c5b4f122b416df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502d3740-314f-5843-a028-26deb3dc8245/502d3740-314f-5843-a028-26deb3dc8245_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91282,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_3a46a978d0598850706525e9645bf44b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502d3740-314f-5843-a028-26deb3dc8245/502d3740-314f-5843-a028-26deb3dc8245_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79220,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/d7/19d7fa99d56b36f273d16ec02c1e9f0e/pa/UG86344_dd82a0465c99c4b81df6a40c60a3bf28.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-04-07',
'seats_number': 4,
'seller_name': None,
'title': 'BMW 1er 120d xDrive Sport',
'transmission': 'manual',
'trim': 'xDrive Sport',
'year': 2013}
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG86344%27 HTTP/1.1" 200 None
2026-03-30 11:27:09 [auto1.es] INFO: Saving data for UG86344: {'created_time': 1774870029.121349, 'last_price_update_time': 1774870029.121359, 'auction_closing_time': 1774971585.0}
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UG86344') HTTP/1.1" 204 0
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1a%252Fae1a038166a7603e79c1578813dbae0a%252Fpa%252FRN47557_9d677849e6ffe1ee5b0f6c638f3dee4b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_9d677849e6ffe1ee5b0f6c638f3dee4b.jpg not downloaded yet
2026-03-30 11:27:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a532255b-77c2-5bc7-9816-40ad5557b37c with identifier: BM68375
2026-03-30 11:27:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a532255b-77c2-5bc7-9816-40ad5557b37c with identifier: BM68375
2026-03-30 11:27:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a532255b-77c2-5bc7-9816-40ad5557b37c with identifier: BM68375 to the API
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:03:50Z',
'fuel_type': 'diesel',
'id': 'a532255b-77c2-5bc7-9816-40ad5557b37c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM68375',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Scirocco',
'odometer': 254594,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-09-26',
'seller_name': None,
'title': 'Volkswagen Scirocco 2.0 TDI',
'transmission': 'manual',
'trim': '',
'year': 2010}
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BM68375%27 HTTP/1.1" 200 None
2026-03-30 11:27:09 [auto1.es] INFO: Saving data for BM68375: {'auction_closing_time': 1774969430.0, 'created_time': 1774091170.055487, 'last_price_update_time': 1774870029.468539}
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BM68375') HTTP/1.1" 204 0
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F6f%252F176fcd8315639d28d2c2fac517629727%252Fpa%252FJW87659_01732b977c4ec1d98ea1757797941977.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/6f/176fcd8315639d28d2c2fac517629727/pa/JW87659_01732b977c4ec1d98ea1757797941977.jpg not downloaded yet
2026-03-30 11:27:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RF07608> (referer: https://www.auto1.com/v1/car-details-view/RF07608/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_01348f008e685e81c3970761b0a85fa9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_c930d4dc2ffad41867b615b3ab55ee4f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_57b60cd4c7d2b7bd246baa62898a33bb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:09 [auto1.es] INFO: Found listing with ID: HB80191
2026-03-30 11:27:09 [auto1.es] INFO: Found listing with ID: JX17367
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JX17367%27 HTTP/1.1" 200 None
2026-03-30 11:27:09 [auto1.es] INFO: Scrape type for JX17367: 2
2026-03-30 11:27:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64148b65-247e-5408-8f20-b42dc60c72c4 with identifier: JX17367
2026-03-30 11:27:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64148b65-247e-5408-8f20-b42dc60c72c4 with scrape type 2
2026-03-30 11:27:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64148b65-247e-5408-8f20-b42dc60c72c4 with scrape type 2
2026-03-30 11:27:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 64148b65-247e-5408-8f20-b42dc60c72c4, identifier: JX17367
2026-03-30 11:27:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3ed490>
2026-03-30 11:27:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b9f4f04-b880-5ee9-8b22-c54f7729eabc/1b9f4f04-b880-5ee9-8b22-c54f7729eabc_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1a%252Fae1a038166a7603e79c1578813dbae0a%252Fpa%252FRN47557_d3ac3a328d385ced3bc68914e0eb4d0d.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_d3ac3a328d385ced3bc68914e0eb4d0d.jpg saved to cache
2026-03-30 11:27:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1b9f4f04-b880-5ee9-8b22-c54f7729eabc
2026-03-30 11:27:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 64148b65-247e-5408-8f20-b42dc60c72c4 with identifier: JX17367
2026-03-30 11:27:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 64148b65-247e-5408-8f20-b42dc60c72c4 with identifier: JX17367
2026-03-30 11:27:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 64148b65-247e-5408-8f20-b42dc60c72c4 with identifier: JX17367 to the API
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:56:55Z',
'fuel_type': 'petrol',
'id': '64148b65-247e-5408-8f20-b42dc60c72c4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX17367',
'listing': 'auction',
'make': 'Nissan',
'model': 'Pixo',
'odometer': 329641,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-04-13',
'seller_name': None,
'title': 'Nissan Pixo 1.0 Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2010}
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JX17367%27 HTTP/1.1" 200 None
2026-03-30 11:27:10 [auto1.es] INFO: Saving data for JX17367: {'auction_closing_time': 1774972615.0, 'created_time': 1773129732.056813, 'last_price_update_time': 1774870030.034527}
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JX17367') HTTP/1.1" 204 0
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F6f%252F176fcd8315639d28d2c2fac517629727%252Fpa%252FJW87659_2ad727e97be030bad97271c6b5aa7ea4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/6f/176fcd8315639d28d2c2fac517629727/pa/JW87659_2ad727e97be030bad97271c6b5aa7ea4.jpg not downloaded yet
2026-03-30 11:27:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_95b0f4b23e821ec870b0595600516d83.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:10 [auto1.es] INFO: Found listing with ID: WZ10661
2026-03-30 11:27:10 [auto1.es] INFO: Found listing with ID: RJ36097
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RJ36097%27 HTTP/1.1" 200 None
2026-03-30 11:27:10 [auto1.es] INFO: Scrape type for RJ36097: 0
2026-03-30 11:27:10 [auto1.es] INFO: Found listing with ID: GD10545
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GD10545%27 HTTP/1.1" 200 None
2026-03-30 11:27:10 [auto1.es] INFO: Scrape type for GD10545: 0
2026-03-30 11:27:10 [auto1.es] INFO: Found listing with ID: FV95952
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FV95952%27 HTTP/1.1" 200 None
2026-03-30 11:27:10 [auto1.es] INFO: Scrape type for FV95952: 0
2026-03-30 11:27:10 [auto1.es] INFO: Found listing with ID: HZ87853
2026-03-30 11:27:10 [auto1.es] INFO: Found listing with ID: HU46093
2026-03-30 11:27:10 [auto1.es] INFO: Found listing with ID: SP06471
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SP06471%27 HTTP/1.1" 200 None
2026-03-30 11:27:10 [auto1.es] INFO: Scrape type for SP06471: 0
2026-03-30 11:27:10 [auto1.es] INFO: Found listing with ID: ZJ75396
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZJ75396%27 HTTP/1.1" 200 None
2026-03-30 11:27:10 [auto1.es] INFO: Scrape type for ZJ75396: 0
2026-03-30 11:27:10 [auto1.es] INFO: Found listing with ID: MF17439
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MF17439%27 HTTP/1.1" 200 None
2026-03-30 11:27:10 [auto1.es] INFO: Scrape type for MF17439: 0
2026-03-30 11:27:10 [auto1.es] INFO: Found listing with ID: DA93296
2026-03-30 11:27:10 [auto1.es] INFO: Found listing with ID: CW87826
2026-03-30 11:27:10 [auto1.es] INFO: Found listing with ID: KZ56767
2026-03-30 11:27:10 [auto1.es] INFO: Found listing with ID: AB71147
2026-03-30 11:27:10 [auto1.es] INFO: Found listing with ID: GF89520
2026-03-30 11:27:10 [auto1.es] INFO: Found listing with ID: AV31208
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AV31208%27 HTTP/1.1" 200 None
2026-03-30 11:27:10 [auto1.es] INFO: Scrape type for AV31208: 0
2026-03-30 11:27:10 [auto1.es] INFO: Found listing with ID: MZ99822
2026-03-30 11:27:10 [auto1.es] INFO: Found listing with ID: RL18296
2026-03-30 11:27:10 [auto1.es] INFO: Found listing with ID: BN81239
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BN81239%27 HTTP/1.1" 200 None
2026-03-30 11:27:10 [auto1.es] INFO: Scrape type for BN81239: 0
2026-03-30 11:27:10 [auto1.es] INFO: Found listing with ID: KV37790
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KV37790%27 HTTP/1.1" 200 None
2026-03-30 11:27:10 [auto1.es] INFO: Scrape type for KV37790: 0
2026-03-30 11:27:10 [auto1.es] INFO: Found listing with ID: AP29688
2026-03-30 11:27:10 [auto1.es] INFO: Found listing with ID: FM74939
2026-03-30 11:27:10 [auto1.es] INFO: Found listing with ID: XS10937
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XS10937%27 HTTP/1.1" 200 None
2026-03-30 11:27:10 [auto1.es] INFO: Scrape type for XS10937: 0
2026-03-30 11:27:10 [auto1.es] INFO: Found listing with ID: MD97530
2026-03-30 11:27:10 [auto1.es] INFO: Found listing with ID: HR79714
2026-03-30 11:27:10 [auto1.es] INFO: Found listing with ID: HA53879
2026-03-30 11:27:10 [auto1.es] INFO: Found listing with ID: NA38669
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA38669%27 HTTP/1.1" 200 None
2026-03-30 11:27:10 [auto1.es] INFO: Scrape type for NA38669: 0
2026-03-30 11:27:10 [auto1.es] INFO: Found listing with ID: ZM37153
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZM37153%27 HTTP/1.1" 200 None
2026-03-30 11:27:10 [auto1.es] INFO: Scrape type for ZM37153: 0
2026-03-30 11:27:10 [auto1.es] INFO: Found listing with ID: RS33188
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RS33188%27 HTTP/1.1" 200 None
2026-03-30 11:27:10 [auto1.es] INFO: Scrape type for RS33188: 0
2026-03-30 11:27:10 [auto1.es] INFO: Found listing with ID: VK08624
2026-03-30 11:27:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JT99347/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F6f%252F176fcd8315639d28d2c2fac517629727%252Fpa%252FJW87659_f660606a7acc7df4ce731379a192d3de.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/6f/176fcd8315639d28d2c2fac517629727/pa/JW87659_f660606a7acc7df4ce731379a192d3de.jpg not downloaded yet
2026-03-30 11:27:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d6eb5cd-f422-5109-a38c-e49c1a6515dc with identifier: RF07608
2026-03-30 11:27:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d6eb5cd-f422-5109-a38c-e49c1a6515dc with scrape type 1
2026-03-30 11:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 0d6eb5cd-f422-5109-a38c-e49c1a6515dc
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Ffb%252F02fbb9499915fc646d7a8e20eea6d73b%252Fpa%252FRF07608_d2f17c44b0da472d768cc43783c65b99.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/fb/02fbb9499915fc646d7a8e20eea6d73b/pa/RF07608_d2f17c44b0da472d768cc43783c65b99.jpg not downloaded yet
2026-03-30 11:27:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc06e977dd0>
2026-03-30 11:27:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b9f4f04-b880-5ee9-8b22-c54f7729eabc/1b9f4f04-b880-5ee9-8b22-c54f7729eabc_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1a%252Fae1a038166a7603e79c1578813dbae0a%252Fpa%252FRN47557_01348f008e685e81c3970761b0a85fa9.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_01348f008e685e81c3970761b0a85fa9.jpg saved to cache
2026-03-30 11:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1b9f4f04-b880-5ee9-8b22-c54f7729eabc
2026-03-30 11:27:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a20d190>
2026-03-30 11:27:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b9f4f04-b880-5ee9-8b22-c54f7729eabc/1b9f4f04-b880-5ee9-8b22-c54f7729eabc_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1a%252Fae1a038166a7603e79c1578813dbae0a%252Fpa%252FRN47557_c930d4dc2ffad41867b615b3ab55ee4f.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_c930d4dc2ffad41867b615b3ab55ee4f.jpg saved to cache
2026-03-30 11:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1b9f4f04-b880-5ee9-8b22-c54f7729eabc
2026-03-30 11:27:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad49e50>
2026-03-30 11:27:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b9f4f04-b880-5ee9-8b22-c54f7729eabc/1b9f4f04-b880-5ee9-8b22-c54f7729eabc_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1a%252Fae1a038166a7603e79c1578813dbae0a%252Fpa%252FRN47557_57b60cd4c7d2b7bd246baa62898a33bb.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_57b60cd4c7d2b7bd246baa62898a33bb.jpg saved to cache
2026-03-30 11:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1b9f4f04-b880-5ee9-8b22-c54f7729eabc
2026-03-30 11:27:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/6f/176fcd8315639d28d2c2fac517629727/pa/JW87659_08429a0bf7969c20e60e2a03cbb68a0f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_52fb14971089a431d2f0669754ec3403.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F6f%252F176fcd8315639d28d2c2fac517629727%252Fpa%252FJW87659_5f90dfca0ad0b8b1c52ea5373434b572.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/6f/176fcd8315639d28d2c2fac517629727/pa/JW87659_5f90dfca0ad0b8b1c52ea5373434b572.jpg not downloaded yet
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Ffb%252F02fbb9499915fc646d7a8e20eea6d73b%252Fpa%252FRF07608_68194c5131e64d6e16ca36bc8b24dba1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/fb/02fbb9499915fc646d7a8e20eea6d73b/pa/RF07608_68194c5131e64d6e16ca36bc8b24dba1.jpg not downloaded yet
2026-03-30 11:27:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KJ27740/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a465750>
2026-03-30 11:27:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b9f4f04-b880-5ee9-8b22-c54f7729eabc/1b9f4f04-b880-5ee9-8b22-c54f7729eabc_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1a%252Fae1a038166a7603e79c1578813dbae0a%252Fpa%252FRN47557_95b0f4b23e821ec870b0595600516d83.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_95b0f4b23e821ec870b0595600516d83.jpg saved to cache
2026-03-30 11:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1b9f4f04-b880-5ee9-8b22-c54f7729eabc
2026-03-30 11:27:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F6f%252F176fcd8315639d28d2c2fac517629727%252Fpa%252FJW87659_d2f7ed3dbf45e03f5ce1cf39a925f64b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/6f/176fcd8315639d28d2c2fac517629727/pa/JW87659_d2f7ed3dbf45e03f5ce1cf39a925f64b.jpg not downloaded yet
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Ffb%252F02fbb9499915fc646d7a8e20eea6d73b%252Fpa%252FRF07608_7e8099ddce7cbf11d1d0edc38b704f87.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/fb/02fbb9499915fc646d7a8e20eea6d73b/pa/RF07608_7e8099ddce7cbf11d1d0edc38b704f87.jpg not downloaded yet
2026-03-30 11:27:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/6f/176fcd8315639d28d2c2fac517629727/pa/JW87659_2ad727e97be030bad97271c6b5aa7ea4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Ffb%252F02fbb9499915fc646d7a8e20eea6d73b%252Fpa%252FRF07608_e614f86df70a25529722e092e0946b4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/fb/02fbb9499915fc646d7a8e20eea6d73b/pa/RF07608_e614f86df70a25529722e092e0946b4a.jpg not downloaded yet
2026-03-30 11:27:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060ff3850>
2026-03-30 11:27:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_017c573b-093b-53b1-b74b-e0934a35704e/017c573b-093b-53b1-b74b-e0934a35704e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F6f%252F176fcd8315639d28d2c2fac517629727%252Fpa%252FJW87659_08429a0bf7969c20e60e2a03cbb68a0f.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/6f/176fcd8315639d28d2c2fac517629727/pa/JW87659_08429a0bf7969c20e60e2a03cbb68a0f.jpg saved to cache
2026-03-30 11:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 017c573b-093b-53b1-b74b-e0934a35704e
2026-03-30 11:27:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a294a50>
2026-03-30 11:27:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b9f4f04-b880-5ee9-8b22-c54f7729eabc/1b9f4f04-b880-5ee9-8b22-c54f7729eabc_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1a%252Fae1a038166a7603e79c1578813dbae0a%252Fpa%252FRN47557_52fb14971089a431d2f0669754ec3403.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_52fb14971089a431d2f0669754ec3403.jpg saved to cache
2026-03-30 11:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1b9f4f04-b880-5ee9-8b22-c54f7729eabc
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Ffb%252F02fbb9499915fc646d7a8e20eea6d73b%252Fpa%252FRF07608_33589ba3172bf529625dc66031a850f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/fb/02fbb9499915fc646d7a8e20eea6d73b/pa/RF07608_33589ba3172bf529625dc66031a850f5.jpg not downloaded yet
2026-03-30 11:27:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/fb/02fbb9499915fc646d7a8e20eea6d73b/pa/RF07608_d2f17c44b0da472d768cc43783c65b99.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/6f/176fcd8315639d28d2c2fac517629727/pa/JW87659_01732b977c4ec1d98ea1757797941977.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_9d677849e6ffe1ee5b0f6c638f3dee4b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Ffb%252F02fbb9499915fc646d7a8e20eea6d73b%252Fpa%252FRF07608_4397dc4f98be1770d9d435907b387c71.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/fb/02fbb9499915fc646d7a8e20eea6d73b/pa/RF07608_4397dc4f98be1770d9d435907b387c71.jpg not downloaded yet
2026-03-30 11:27:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AG97977/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4b6b90>
2026-03-30 11:27:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_017c573b-093b-53b1-b74b-e0934a35704e/017c573b-093b-53b1-b74b-e0934a35704e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F6f%252F176fcd8315639d28d2c2fac517629727%252Fpa%252FJW87659_2ad727e97be030bad97271c6b5aa7ea4.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/6f/176fcd8315639d28d2c2fac517629727/pa/JW87659_2ad727e97be030bad97271c6b5aa7ea4.jpg saved to cache
2026-03-30 11:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 017c573b-093b-53b1-b74b-e0934a35704e
2026-03-30 11:27:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/6f/176fcd8315639d28d2c2fac517629727/pa/JW87659_f660606a7acc7df4ce731379a192d3de.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ae9f550>
2026-03-30 11:27:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d6eb5cd-f422-5109-a38c-e49c1a6515dc/0d6eb5cd-f422-5109-a38c-e49c1a6515dc_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Ffb%252F02fbb9499915fc646d7a8e20eea6d73b%252Fpa%252FRF07608_d2f17c44b0da472d768cc43783c65b99.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/fb/02fbb9499915fc646d7a8e20eea6d73b/pa/RF07608_d2f17c44b0da472d768cc43783c65b99.jpg saved to cache
2026-03-30 11:27:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d6eb5cd-f422-5109-a38c-e49c1a6515dc
2026-03-30 11:27:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4a3810>
2026-03-30 11:27:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_017c573b-093b-53b1-b74b-e0934a35704e/017c573b-093b-53b1-b74b-e0934a35704e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F6f%252F176fcd8315639d28d2c2fac517629727%252Fpa%252FJW87659_01732b977c4ec1d98ea1757797941977.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/6f/176fcd8315639d28d2c2fac517629727/pa/JW87659_01732b977c4ec1d98ea1757797941977.jpg saved to cache
2026-03-30 11:27:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 017c573b-093b-53b1-b74b-e0934a35704e
2026-03-30 11:27:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/fb/02fbb9499915fc646d7a8e20eea6d73b/pa/RF07608_e614f86df70a25529722e092e0946b4a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/fb/02fbb9499915fc646d7a8e20eea6d73b/pa/RF07608_7e8099ddce7cbf11d1d0edc38b704f87.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3c61d0>
2026-03-30 11:27:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b9f4f04-b880-5ee9-8b22-c54f7729eabc/1b9f4f04-b880-5ee9-8b22-c54f7729eabc_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F1a%252Fae1a038166a7603e79c1578813dbae0a%252Fpa%252FRN47557_9d677849e6ffe1ee5b0f6c638f3dee4b.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_9d677849e6ffe1ee5b0f6c638f3dee4b.jpg saved to cache
2026-03-30 11:27:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1b9f4f04-b880-5ee9-8b22-c54f7729eabc
2026-03-30 11:27:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b9f4f04-b880-5ee9-8b22-c54f7729eabc, skipping ID generation
2026-03-30 11:27:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b9f4f04-b880-5ee9-8b22-c54f7729eabc with scrape type 1
2026-03-30 11:27:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1b9f4f04-b880-5ee9-8b22-c54f7729eabc sending to next pipeline
2026-03-30 11:27:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1b9f4f04-b880-5ee9-8b22-c54f7729eabc, identifier: RN47557
2026-03-30 11:27:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a211090>
2026-03-30 11:27:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_017c573b-093b-53b1-b74b-e0934a35704e/017c573b-093b-53b1-b74b-e0934a35704e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F6f%252F176fcd8315639d28d2c2fac517629727%252Fpa%252FJW87659_f660606a7acc7df4ce731379a192d3de.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/6f/176fcd8315639d28d2c2fac517629727/pa/JW87659_f660606a7acc7df4ce731379a192d3de.jpg saved to cache
2026-03-30 11:27:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 017c573b-093b-53b1-b74b-e0934a35704e
2026-03-30 11:27:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1b9f4f04-b880-5ee9-8b22-c54f7729eabc with identifier: RN47557
2026-03-30 11:27:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1b9f4f04-b880-5ee9-8b22-c54f7729eabc with identifier: RN47557
2026-03-30 11:27:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1b9f4f04-b880-5ee9-8b22-c54f7729eabc with identifier: RN47557 to the API
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_9d677849e6ffe1ee5b0f6c638f3dee4b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.7L',
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:41:28Z',
'fuel_type': 'diesel',
'id': '1b9f4f04-b880-5ee9-8b22-c54f7729eabc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN47557',
'listing': 'auction',
'location': 'ES, La Roda de AndalucÃa',
'make': 'Kia',
'model': 'Carens',
'odometer': 160975,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b9f4f04-b880-5ee9-8b22-c54f7729eabc/1b9f4f04-b880-5ee9-8b22-c54f7729eabc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81929,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_9848c34b8f792ee1f8efa11eb9c860af.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b9f4f04-b880-5ee9-8b22-c54f7729eabc/1b9f4f04-b880-5ee9-8b22-c54f7729eabc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80676,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_779f861be1e988d060e258d3b3e0166d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b9f4f04-b880-5ee9-8b22-c54f7729eabc/1b9f4f04-b880-5ee9-8b22-c54f7729eabc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86605,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_5e61babdbbcbd95de590b3c254ec40ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b9f4f04-b880-5ee9-8b22-c54f7729eabc/1b9f4f04-b880-5ee9-8b22-c54f7729eabc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70056,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_01348f008e685e81c3970761b0a85fa9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b9f4f04-b880-5ee9-8b22-c54f7729eabc/1b9f4f04-b880-5ee9-8b22-c54f7729eabc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76323,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_d3ac3a328d385ced3bc68914e0eb4d0d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b9f4f04-b880-5ee9-8b22-c54f7729eabc/1b9f4f04-b880-5ee9-8b22-c54f7729eabc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85934,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_c930d4dc2ffad41867b615b3ab55ee4f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b9f4f04-b880-5ee9-8b22-c54f7729eabc/1b9f4f04-b880-5ee9-8b22-c54f7729eabc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70036,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_57b60cd4c7d2b7bd246baa62898a33bb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b9f4f04-b880-5ee9-8b22-c54f7729eabc/1b9f4f04-b880-5ee9-8b22-c54f7729eabc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85544,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_95b0f4b23e821ec870b0595600516d83.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b9f4f04-b880-5ee9-8b22-c54f7729eabc/1b9f4f04-b880-5ee9-8b22-c54f7729eabc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89595,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_52fb14971089a431d2f0669754ec3403.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b9f4f04-b880-5ee9-8b22-c54f7729eabc/1b9f4f04-b880-5ee9-8b22-c54f7729eabc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73743,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/1a/ae1a038166a7603e79c1578813dbae0a/pa/RN47557_9d677849e6ffe1ee5b0f6c638f3dee4b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-08-18',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Carens 1.7 CRDi Concept',
'transmission': 'manual',
'trim': 'Concept',
'year': 2014}
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RN47557%27 HTTP/1.1" 200 None
2026-03-30 11:27:11 [auto1.es] INFO: Saving data for RN47557: {'created_time': 1774870031.727527, 'last_price_update_time': 1774870031.727539, 'auction_closing_time': 1774971688.0}
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RN47557') HTTP/1.1" 204 0
2026-03-30 11:27:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/fb/02fbb9499915fc646d7a8e20eea6d73b/pa/RF07608_4397dc4f98be1770d9d435907b387c71.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/fb/02fbb9499915fc646d7a8e20eea6d73b/pa/RF07608_33589ba3172bf529625dc66031a850f5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/6f/176fcd8315639d28d2c2fac517629727/pa/JW87659_d2f7ed3dbf45e03f5ce1cf39a925f64b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/fb/02fbb9499915fc646d7a8e20eea6d73b/pa/RF07608_68194c5131e64d6e16ca36bc8b24dba1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05aeb13d0>
2026-03-30 11:27:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d6eb5cd-f422-5109-a38c-e49c1a6515dc/0d6eb5cd-f422-5109-a38c-e49c1a6515dc_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Ffb%252F02fbb9499915fc646d7a8e20eea6d73b%252Fpa%252FRF07608_e614f86df70a25529722e092e0946b4a.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/fb/02fbb9499915fc646d7a8e20eea6d73b/pa/RF07608_e614f86df70a25529722e092e0946b4a.jpg saved to cache
2026-03-30 11:27:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0d6eb5cd-f422-5109-a38c-e49c1a6515dc
2026-03-30 11:27:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ae70cd0>
2026-03-30 11:27:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d6eb5cd-f422-5109-a38c-e49c1a6515dc/0d6eb5cd-f422-5109-a38c-e49c1a6515dc_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Ffb%252F02fbb9499915fc646d7a8e20eea6d73b%252Fpa%252FRF07608_7e8099ddce7cbf11d1d0edc38b704f87.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/fb/02fbb9499915fc646d7a8e20eea6d73b/pa/RF07608_7e8099ddce7cbf11d1d0edc38b704f87.jpg saved to cache
2026-03-30 11:27:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0d6eb5cd-f422-5109-a38c-e49c1a6515dc
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a36fb10>
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d6eb5cd-f422-5109-a38c-e49c1a6515dc/0d6eb5cd-f422-5109-a38c-e49c1a6515dc_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Ffb%252F02fbb9499915fc646d7a8e20eea6d73b%252Fpa%252FRF07608_4397dc4f98be1770d9d435907b387c71.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/fb/02fbb9499915fc646d7a8e20eea6d73b/pa/RF07608_4397dc4f98be1770d9d435907b387c71.jpg saved to cache
2026-03-30 11:27:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0d6eb5cd-f422-5109-a38c-e49c1a6515dc
2026-03-30 11:27:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/6f/176fcd8315639d28d2c2fac517629727/pa/JW87659_5f90dfca0ad0b8b1c52ea5373434b572.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060fe6410>
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d6eb5cd-f422-5109-a38c-e49c1a6515dc/0d6eb5cd-f422-5109-a38c-e49c1a6515dc_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Ffb%252F02fbb9499915fc646d7a8e20eea6d73b%252Fpa%252FRF07608_33589ba3172bf529625dc66031a850f5.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/fb/02fbb9499915fc646d7a8e20eea6d73b/pa/RF07608_33589ba3172bf529625dc66031a850f5.jpg saved to cache
2026-03-30 11:27:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0d6eb5cd-f422-5109-a38c-e49c1a6515dc
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ae9ec10>
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_017c573b-093b-53b1-b74b-e0934a35704e/017c573b-093b-53b1-b74b-e0934a35704e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F6f%252F176fcd8315639d28d2c2fac517629727%252Fpa%252FJW87659_d2f7ed3dbf45e03f5ce1cf39a925f64b.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/6f/176fcd8315639d28d2c2fac517629727/pa/JW87659_d2f7ed3dbf45e03f5ce1cf39a925f64b.jpg saved to cache
2026-03-30 11:27:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 017c573b-093b-53b1-b74b-e0934a35704e
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ae72a50>
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d6eb5cd-f422-5109-a38c-e49c1a6515dc/0d6eb5cd-f422-5109-a38c-e49c1a6515dc_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Ffb%252F02fbb9499915fc646d7a8e20eea6d73b%252Fpa%252FRF07608_68194c5131e64d6e16ca36bc8b24dba1.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/fb/02fbb9499915fc646d7a8e20eea6d73b/pa/RF07608_68194c5131e64d6e16ca36bc8b24dba1.jpg saved to cache
2026-03-30 11:27:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0d6eb5cd-f422-5109-a38c-e49c1a6515dc
2026-03-30 11:27:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d6eb5cd-f422-5109-a38c-e49c1a6515dc, skipping ID generation
2026-03-30 11:27:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d6eb5cd-f422-5109-a38c-e49c1a6515dc with scrape type 1
2026-03-30 11:27:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d6eb5cd-f422-5109-a38c-e49c1a6515dc sending to next pipeline
2026-03-30 11:27:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0d6eb5cd-f422-5109-a38c-e49c1a6515dc, identifier: RF07608
2026-03-30 11:27:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0d6eb5cd-f422-5109-a38c-e49c1a6515dc with identifier: RF07608
2026-03-30 11:27:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0d6eb5cd-f422-5109-a38c-e49c1a6515dc with identifier: RF07608
2026-03-30 11:27:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0d6eb5cd-f422-5109-a38c-e49c1a6515dc with identifier: RF07608 to the API
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img02/fb/02fbb9499915fc646d7a8e20eea6d73b/pa/RF07608_68194c5131e64d6e16ca36bc8b24dba1.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'engine_horse_power': 100,
'expiration_date': '2026-03-31T15:41:17Z',
'fuel_type': 'petrol',
'id': '0d6eb5cd-f422-5109-a38c-e49c1a6515dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF07608',
'listing': 'auction',
'location': 'ES, Manresa',
'make': 'Ford',
'model': 'Focus',
'odometer': 52261,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d6eb5cd-f422-5109-a38c-e49c1a6515dc/0d6eb5cd-f422-5109-a38c-e49c1a6515dc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114139,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/fb/02fbb9499915fc646d7a8e20eea6d73b/pa/RF07608_d2f17c44b0da472d768cc43783c65b99.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d6eb5cd-f422-5109-a38c-e49c1a6515dc/0d6eb5cd-f422-5109-a38c-e49c1a6515dc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90855,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/fb/02fbb9499915fc646d7a8e20eea6d73b/pa/RF07608_68194c5131e64d6e16ca36bc8b24dba1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d6eb5cd-f422-5109-a38c-e49c1a6515dc/0d6eb5cd-f422-5109-a38c-e49c1a6515dc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86203,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/fb/02fbb9499915fc646d7a8e20eea6d73b/pa/RF07608_7e8099ddce7cbf11d1d0edc38b704f87.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d6eb5cd-f422-5109-a38c-e49c1a6515dc/0d6eb5cd-f422-5109-a38c-e49c1a6515dc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64136,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/fb/02fbb9499915fc646d7a8e20eea6d73b/pa/RF07608_e614f86df70a25529722e092e0946b4a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d6eb5cd-f422-5109-a38c-e49c1a6515dc/0d6eb5cd-f422-5109-a38c-e49c1a6515dc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82389,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/fb/02fbb9499915fc646d7a8e20eea6d73b/pa/RF07608_33589ba3172bf529625dc66031a850f5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d6eb5cd-f422-5109-a38c-e49c1a6515dc/0d6eb5cd-f422-5109-a38c-e49c1a6515dc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108982,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/fb/02fbb9499915fc646d7a8e20eea6d73b/pa/RF07608_4397dc4f98be1770d9d435907b387c71.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2000-02-29',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 1.6 Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2000}
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RF07608%27 HTTP/1.1" 200 None
2026-03-30 11:27:12 [auto1.es] INFO: Saving data for RF07608: {'created_time': 1774870032.67711, 'last_price_update_time': 1774870032.67712, 'auction_closing_time': 1774971677.0}
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RF07608') HTTP/1.1" 204 0
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ae7fe50>
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_017c573b-093b-53b1-b74b-e0934a35704e/017c573b-093b-53b1-b74b-e0934a35704e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F6f%252F176fcd8315639d28d2c2fac517629727%252Fpa%252FJW87659_5f90dfca0ad0b8b1c52ea5373434b572.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/6f/176fcd8315639d28d2c2fac517629727/pa/JW87659_5f90dfca0ad0b8b1c52ea5373434b572.jpg saved to cache
2026-03-30 11:27:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 017c573b-093b-53b1-b74b-e0934a35704e
2026-03-30 11:27:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 017c573b-093b-53b1-b74b-e0934a35704e, skipping ID generation
2026-03-30 11:27:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 017c573b-093b-53b1-b74b-e0934a35704e with scrape type 1
2026-03-30 11:27:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 017c573b-093b-53b1-b74b-e0934a35704e sending to next pipeline
2026-03-30 11:27:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 017c573b-093b-53b1-b74b-e0934a35704e, identifier: JW87659
2026-03-30 11:27:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 017c573b-093b-53b1-b74b-e0934a35704e with identifier: JW87659
2026-03-30 11:27:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 017c573b-093b-53b1-b74b-e0934a35704e with identifier: JW87659
2026-03-30 11:27:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 017c573b-093b-53b1-b74b-e0934a35704e with identifier: JW87659 to the API
2026-03-30 11:27:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img17/6f/176fcd8315639d28d2c2fac517629727/pa/JW87659_5f90dfca0ad0b8b1c52ea5373434b572.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:15:21Z',
'fuel_type': 'diesel',
'id': '017c573b-093b-53b1-b74b-e0934a35704e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW87659',
'listing': 'auction',
'location': 'ES, Jerez de la Frontera',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 167311,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_017c573b-093b-53b1-b74b-e0934a35704e/017c573b-093b-53b1-b74b-e0934a35704e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105392,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/6f/176fcd8315639d28d2c2fac517629727/pa/JW87659_08429a0bf7969c20e60e2a03cbb68a0f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_017c573b-093b-53b1-b74b-e0934a35704e/017c573b-093b-53b1-b74b-e0934a35704e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110292,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/6f/176fcd8315639d28d2c2fac517629727/pa/JW87659_01732b977c4ec1d98ea1757797941977.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_017c573b-093b-53b1-b74b-e0934a35704e/017c573b-093b-53b1-b74b-e0934a35704e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87093,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/6f/176fcd8315639d28d2c2fac517629727/pa/JW87659_2ad727e97be030bad97271c6b5aa7ea4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_017c573b-093b-53b1-b74b-e0934a35704e/017c573b-093b-53b1-b74b-e0934a35704e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86466,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/6f/176fcd8315639d28d2c2fac517629727/pa/JW87659_f660606a7acc7df4ce731379a192d3de.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_017c573b-093b-53b1-b74b-e0934a35704e/017c573b-093b-53b1-b74b-e0934a35704e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75993,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/6f/176fcd8315639d28d2c2fac517629727/pa/JW87659_5f90dfca0ad0b8b1c52ea5373434b572.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_017c573b-093b-53b1-b74b-e0934a35704e/017c573b-093b-53b1-b74b-e0934a35704e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77350,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/6f/176fcd8315639d28d2c2fac517629727/pa/JW87659_d2f7ed3dbf45e03f5ce1cf39a925f64b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-05-26',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Ibiza 1.6 TDI Reference',
'transmission': 'manual',
'trim': 'Reference',
'year': 2013}
2026-03-30 11:27:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW87659%27 HTTP/1.1" 200 None
2026-03-30 11:27:13 [auto1.es] INFO: Saving data for JW87659: {'created_time': 1774870033.207575, 'last_price_update_time': 1774870033.207586, 'auction_closing_time': 1774970121.0}
2026-03-30 11:27:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JW87659') HTTP/1.1" 204 0
2026-03-30 11:27:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AE25317/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DG01155/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YP69224/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:19 [auto1.es] INFO: Channel: 24h | Page: 13 | totalHits: 2237 | hits on page: 40
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: VK08624
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: ZE40464
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: SF77258
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SF77258%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.es] INFO: Scrape type for SF77258: 0
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: BF57593
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: BM87438
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: CP82441
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CP82441%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.es] INFO: Scrape type for CP82441: 0
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: BP19687
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: CP16982
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: XG07152
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XG07152%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.es] INFO: Scrape type for XG07152: 0
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: LL26626
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: HK75891
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: DA17068
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DA17068%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.es] INFO: Scrape type for DA17068: 0
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: SN19973
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: NN48613
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: DM10276
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DM10276%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.es] INFO: Scrape type for DM10276: 0
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: FA27272
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: MS32637
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: MR15790
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: UT51952
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT51952%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.es] INFO: Scrape type for UT51952: 0
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: XV15787
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XV15787%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.es] INFO: Scrape type for XV15787: 0
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: JT97247
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: LB47883
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LB47883%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.es] INFO: Scrape type for LB47883: 0
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: RE29588
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RE29588%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.es] INFO: Scrape type for RE29588: 0
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: PU95944
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PU95944%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.es] INFO: Scrape type for PU95944: 0
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: VC54810
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC54810%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.es] INFO: Scrape type for VC54810: 0
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: PM70964
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PM70964%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.es] INFO: Scrape type for PM70964: 0
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: RC14934
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: EP76379
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: DL91172
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: YH74863
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: SW02884
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: EV89270
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: TM60854
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: RS73770
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RS73770%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.es] INFO: Scrape type for RS73770: 0
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: CP22124
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CP22124%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.es] INFO: Scrape type for CP22124: 0
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: FP58894
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FP58894%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.es] INFO: Scrape type for FP58894: 0
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: JV83587
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JV83587%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.es] INFO: Scrape type for JV83587: 0
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: VJ60171
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VJ60171%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.es] INFO: Scrape type for VJ60171: 0
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: AF99504
2026-03-30 11:27:19 [auto1.es] INFO: Found listing with ID: SM68144
2026-03-30 11:27:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FR76848/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PM66959/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KF41905/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KJ27740> (referer: https://www.auto1.com/v1/car-details-view/KJ27740/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e63a1546-6548-5c5e-b588-ae1ebccdd90b with identifier: KJ27740
2026-03-30 11:27:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e63a1546-6548-5c5e-b588-ae1ebccdd90b with scrape type 1
2026-03-30 11:27:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item e63a1546-6548-5c5e-b588-ae1ebccdd90b
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F78%252F977805a014f59979fce07fc3e28b2a6f%252Fpa%252FKJ27740_94dcff43e2f495424bc781babb243ea5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/78/977805a014f59979fce07fc3e28b2a6f/pa/KJ27740_94dcff43e2f495424bc781babb243ea5.jpg not downloaded yet
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F78%252F977805a014f59979fce07fc3e28b2a6f%252Fpa%252FKJ27740_3f86b35dcea22407f533fcd51c150676.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/78/977805a014f59979fce07fc3e28b2a6f/pa/KJ27740_3f86b35dcea22407f533fcd51c150676.jpg not downloaded yet
2026-03-30 11:27:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AG97977> (referer: https://www.auto1.com/v1/car-details-view/AG97977/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F78%252F977805a014f59979fce07fc3e28b2a6f%252Fpa%252FKJ27740_01ea302c2971c7651c7f8591951eae99.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/78/977805a014f59979fce07fc3e28b2a6f/pa/KJ27740_01ea302c2971c7651c7f8591951eae99.jpg not downloaded yet
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F78%252F977805a014f59979fce07fc3e28b2a6f%252Fpa%252FKJ27740_ce76f84e2efee802b558791ca01bb543.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/78/977805a014f59979fce07fc3e28b2a6f/pa/KJ27740_ce76f84e2efee802b558791ca01bb543.jpg not downloaded yet
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F78%252F977805a014f59979fce07fc3e28b2a6f%252Fpa%252FKJ27740_5dd358fa4cba9939bb03891a56ce9d8f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/78/977805a014f59979fce07fc3e28b2a6f/pa/KJ27740_5dd358fa4cba9939bb03891a56ce9d8f.jpg not downloaded yet
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F78%252F977805a014f59979fce07fc3e28b2a6f%252Fpa%252FKJ27740_949a86993278003b278da93783d63fe4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/78/977805a014f59979fce07fc3e28b2a6f/pa/KJ27740_949a86993278003b278da93783d63fe4.jpg not downloaded yet
2026-03-30 11:27:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/78/977805a014f59979fce07fc3e28b2a6f/pa/KJ27740_94dcff43e2f495424bc781babb243ea5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8fe388b-88a1-5daf-b963-edd319f68574 with identifier: AG97977
2026-03-30 11:27:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8fe388b-88a1-5daf-b963-edd319f68574 with scrape type 1
2026-03-30 11:27:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d8fe388b-88a1-5daf-b963-edd319f68574
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F0e%252Fe00e3cbfa31f28005d9bcc26a855d628%252Fpa%252FAG97977_12d14e351ba758373e94d4b2368a7138.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_12d14e351ba758373e94d4b2368a7138.jpg not downloaded yet
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F0e%252Fe00e3cbfa31f28005d9bcc26a855d628%252Fpa%252FAG97977_2686675601cae46d5154ad2ca1cadcf0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_2686675601cae46d5154ad2ca1cadcf0.jpg not downloaded yet
2026-03-30 11:27:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VL95678> (referer: https://www.auto1.com/v1/car-details-view/VL95678/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F0e%252Fe00e3cbfa31f28005d9bcc26a855d628%252Fpa%252FAG97977_12b11aee657440c438c2213f394aab80.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_12b11aee657440c438c2213f394aab80.jpg not downloaded yet
2026-03-30 11:27:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F0e%252Fe00e3cbfa31f28005d9bcc26a855d628%252Fpa%252FAG97977_67c6cc17ffc25d34f52c759d775c538a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_67c6cc17ffc25d34f52c759d775c538a.jpg not downloaded yet
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F0e%252Fe00e3cbfa31f28005d9bcc26a855d628%252Fpa%252FAG97977_53a4e4ace08a029f3faebe6a0a46e637.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_53a4e4ace08a029f3faebe6a0a46e637.jpg not downloaded yet
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F0e%252Fe00e3cbfa31f28005d9bcc26a855d628%252Fpa%252FAG97977_f0fb9aea423e51627228433e4096c663.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_f0fb9aea423e51627228433e4096c663.jpg not downloaded yet
2026-03-30 11:27:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a252650>
2026-03-30 11:27:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e63a1546-6548-5c5e-b588-ae1ebccdd90b/e63a1546-6548-5c5e-b588-ae1ebccdd90b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F78%252F977805a014f59979fce07fc3e28b2a6f%252Fpa%252FKJ27740_94dcff43e2f495424bc781babb243ea5.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/78/977805a014f59979fce07fc3e28b2a6f/pa/KJ27740_94dcff43e2f495424bc781babb243ea5.jpg saved to cache
2026-03-30 11:27:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e63a1546-6548-5c5e-b588-ae1ebccdd90b
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F0e%252Fe00e3cbfa31f28005d9bcc26a855d628%252Fpa%252FAG97977_5c8ab5349880c21f865c12f2299cf4f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_5c8ab5349880c21f865c12f2299cf4f6.jpg not downloaded yet
2026-03-30 11:27:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/78/977805a014f59979fce07fc3e28b2a6f/pa/KJ27740_3f86b35dcea22407f533fcd51c150676.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/78/977805a014f59979fce07fc3e28b2a6f/pa/KJ27740_ce76f84e2efee802b558791ca01bb543.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_2686675601cae46d5154ad2ca1cadcf0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/78/977805a014f59979fce07fc3e28b2a6f/pa/KJ27740_01ea302c2971c7651c7f8591951eae99.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F0e%252Fe00e3cbfa31f28005d9bcc26a855d628%252Fpa%252FAG97977_f278127e69850524e0195670301d9340.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_f278127e69850524e0195670301d9340.jpg not downloaded yet
2026-03-30 11:27:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2e51624-19c1-5cb4-9789-a874bb3e41b4 with identifier: VL95678
2026-03-30 11:27:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2e51624-19c1-5cb4-9789-a874bb3e41b4 with scrape type 1
2026-03-30 11:27:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e2e51624-19c1-5cb4-9789-a874bb3e41b4
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F03%252F5603d1ff05af3fe2667a2090d9863c6c%252Fpa%252FVL95678_2efc46e97585034cf66fbb567bcb0de6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_2efc46e97585034cf66fbb567bcb0de6.jpg not downloaded yet
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F0e%252Fe00e3cbfa31f28005d9bcc26a855d628%252Fpa%252FAG97977_0c84f5ff967a20e9f59b537bf83df756.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_0c84f5ff967a20e9f59b537bf83df756.jpg not downloaded yet
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F03%252F5603d1ff05af3fe2667a2090d9863c6c%252Fpa%252FVL95678_c86e7dce15edec4fada70fb7158974b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_c86e7dce15edec4fada70fb7158974b4.jpg not downloaded yet
2026-03-30 11:27:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/78/977805a014f59979fce07fc3e28b2a6f/pa/KJ27740_949a86993278003b278da93783d63fe4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F0e%252Fe00e3cbfa31f28005d9bcc26a855d628%252Fpa%252FAG97977_7e397db753ea0e6e9931f8e85852fdfc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_7e397db753ea0e6e9931f8e85852fdfc.jpg not downloaded yet
2026-03-30 11:27:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_67c6cc17ffc25d34f52c759d775c538a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_f0fb9aea423e51627228433e4096c663.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_53a4e4ace08a029f3faebe6a0a46e637.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F03%252F5603d1ff05af3fe2667a2090d9863c6c%252Fpa%252FVL95678_9d6666b38943c7bd71d87183521fc888.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_9d6666b38943c7bd71d87183521fc888.jpg not downloaded yet
2026-03-30 11:27:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_5c8ab5349880c21f865c12f2299cf4f6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F03%252F5603d1ff05af3fe2667a2090d9863c6c%252Fpa%252FVL95678_66498ee197a7fa53e2c7c68c4432d2a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_66498ee197a7fa53e2c7c68c4432d2a3.jpg not downloaded yet
2026-03-30 11:27:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a268b10>
2026-03-30 11:27:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e63a1546-6548-5c5e-b588-ae1ebccdd90b/e63a1546-6548-5c5e-b588-ae1ebccdd90b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F78%252F977805a014f59979fce07fc3e28b2a6f%252Fpa%252FKJ27740_3f86b35dcea22407f533fcd51c150676.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/78/977805a014f59979fce07fc3e28b2a6f/pa/KJ27740_3f86b35dcea22407f533fcd51c150676.jpg saved to cache
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e63a1546-6548-5c5e-b588-ae1ebccdd90b
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a323950>
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e63a1546-6548-5c5e-b588-ae1ebccdd90b/e63a1546-6548-5c5e-b588-ae1ebccdd90b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F78%252F977805a014f59979fce07fc3e28b2a6f%252Fpa%252FKJ27740_ce76f84e2efee802b558791ca01bb543.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/78/977805a014f59979fce07fc3e28b2a6f/pa/KJ27740_ce76f84e2efee802b558791ca01bb543.jpg saved to cache
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e63a1546-6548-5c5e-b588-ae1ebccdd90b
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a485210>
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8fe388b-88a1-5daf-b963-edd319f68574/d8fe388b-88a1-5daf-b963-edd319f68574_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F0e%252Fe00e3cbfa31f28005d9bcc26a855d628%252Fpa%252FAG97977_2686675601cae46d5154ad2ca1cadcf0.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_2686675601cae46d5154ad2ca1cadcf0.jpg saved to cache
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d8fe388b-88a1-5daf-b963-edd319f68574
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F03%252F5603d1ff05af3fe2667a2090d9863c6c%252Fpa%252FVL95678_38d7ad035ad8c7bc2bc6e6567eff8393.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_38d7ad035ad8c7bc2bc6e6567eff8393.jpg not downloaded yet
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a2a48d0>
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e63a1546-6548-5c5e-b588-ae1ebccdd90b/e63a1546-6548-5c5e-b588-ae1ebccdd90b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F78%252F977805a014f59979fce07fc3e28b2a6f%252Fpa%252FKJ27740_01ea302c2971c7651c7f8591951eae99.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/78/977805a014f59979fce07fc3e28b2a6f/pa/KJ27740_01ea302c2971c7651c7f8591951eae99.jpg saved to cache
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e63a1546-6548-5c5e-b588-ae1ebccdd90b
2026-03-30 11:27:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_0c84f5ff967a20e9f59b537bf83df756.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_2efc46e97585034cf66fbb567bcb0de6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_f278127e69850524e0195670301d9340.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_c86e7dce15edec4fada70fb7158974b4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F03%252F5603d1ff05af3fe2667a2090d9863c6c%252Fpa%252FVL95678_7e4371b37b4170277ff6e43a08e8a2e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_7e4371b37b4170277ff6e43a08e8a2e8.jpg not downloaded yet
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad40b90>
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e63a1546-6548-5c5e-b588-ae1ebccdd90b/e63a1546-6548-5c5e-b588-ae1ebccdd90b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F78%252F977805a014f59979fce07fc3e28b2a6f%252Fpa%252FKJ27740_949a86993278003b278da93783d63fe4.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/78/977805a014f59979fce07fc3e28b2a6f/pa/KJ27740_949a86993278003b278da93783d63fe4.jpg saved to cache
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e63a1546-6548-5c5e-b588-ae1ebccdd90b
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad7bbd0>
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8fe388b-88a1-5daf-b963-edd319f68574/d8fe388b-88a1-5daf-b963-edd319f68574_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F0e%252Fe00e3cbfa31f28005d9bcc26a855d628%252Fpa%252FAG97977_67c6cc17ffc25d34f52c759d775c538a.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_67c6cc17ffc25d34f52c759d775c538a.jpg saved to cache
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d8fe388b-88a1-5daf-b963-edd319f68574
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a237550>
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8fe388b-88a1-5daf-b963-edd319f68574/d8fe388b-88a1-5daf-b963-edd319f68574_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F0e%252Fe00e3cbfa31f28005d9bcc26a855d628%252Fpa%252FAG97977_f0fb9aea423e51627228433e4096c663.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_f0fb9aea423e51627228433e4096c663.jpg saved to cache
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d8fe388b-88a1-5daf-b963-edd319f68574
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a2c9fd0>
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8fe388b-88a1-5daf-b963-edd319f68574/d8fe388b-88a1-5daf-b963-edd319f68574_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F0e%252Fe00e3cbfa31f28005d9bcc26a855d628%252Fpa%252FAG97977_53a4e4ace08a029f3faebe6a0a46e637.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_53a4e4ace08a029f3faebe6a0a46e637.jpg saved to cache
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d8fe388b-88a1-5daf-b963-edd319f68574
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a2349d0>
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8fe388b-88a1-5daf-b963-edd319f68574/d8fe388b-88a1-5daf-b963-edd319f68574_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F0e%252Fe00e3cbfa31f28005d9bcc26a855d628%252Fpa%252FAG97977_5c8ab5349880c21f865c12f2299cf4f6.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_5c8ab5349880c21f865c12f2299cf4f6.jpg saved to cache
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d8fe388b-88a1-5daf-b963-edd319f68574
2026-03-30 11:27:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_7e397db753ea0e6e9931f8e85852fdfc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F03%252F5603d1ff05af3fe2667a2090d9863c6c%252Fpa%252FVL95678_fe4d36849c90c020ed94d953e9b360d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_fe4d36849c90c020ed94d953e9b360d9.jpg not downloaded yet
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a43f550>
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8fe388b-88a1-5daf-b963-edd319f68574/d8fe388b-88a1-5daf-b963-edd319f68574_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F0e%252Fe00e3cbfa31f28005d9bcc26a855d628%252Fpa%252FAG97977_0c84f5ff967a20e9f59b537bf83df756.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_0c84f5ff967a20e9f59b537bf83df756.jpg saved to cache
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d8fe388b-88a1-5daf-b963-edd319f68574
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a331b90>
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e51624-19c1-5cb4-9789-a874bb3e41b4/e2e51624-19c1-5cb4-9789-a874bb3e41b4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F03%252F5603d1ff05af3fe2667a2090d9863c6c%252Fpa%252FVL95678_2efc46e97585034cf66fbb567bcb0de6.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_2efc46e97585034cf66fbb567bcb0de6.jpg saved to cache
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e2e51624-19c1-5cb4-9789-a874bb3e41b4
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a23f1d0>
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8fe388b-88a1-5daf-b963-edd319f68574/d8fe388b-88a1-5daf-b963-edd319f68574_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F0e%252Fe00e3cbfa31f28005d9bcc26a855d628%252Fpa%252FAG97977_f278127e69850524e0195670301d9340.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_f278127e69850524e0195670301d9340.jpg saved to cache
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d8fe388b-88a1-5daf-b963-edd319f68574
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad4a3d0>
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e51624-19c1-5cb4-9789-a874bb3e41b4/e2e51624-19c1-5cb4-9789-a874bb3e41b4_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F03%252F5603d1ff05af3fe2667a2090d9863c6c%252Fpa%252FVL95678_c86e7dce15edec4fada70fb7158974b4.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_c86e7dce15edec4fada70fb7158974b4.jpg saved to cache
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e2e51624-19c1-5cb4-9789-a874bb3e41b4
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F03%252F5603d1ff05af3fe2667a2090d9863c6c%252Fpa%252FVL95678_2fc5d506553d8482868682564c61b53f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_2fc5d506553d8482868682564c61b53f.jpg not downloaded yet
2026-03-30 11:27:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_66498ee197a7fa53e2c7c68c4432d2a3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_38d7ad035ad8c7bc2bc6e6567eff8393.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_12b11aee657440c438c2213f394aab80.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_12d14e351ba758373e94d4b2368a7138.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_9d6666b38943c7bd71d87183521fc888.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F03%252F5603d1ff05af3fe2667a2090d9863c6c%252Fpa%252FVL95678_8a8e007d4f32c442e12fa2c13d209273.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_8a8e007d4f32c442e12fa2c13d209273.jpg not downloaded yet
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a33c610>
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8fe388b-88a1-5daf-b963-edd319f68574/d8fe388b-88a1-5daf-b963-edd319f68574_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F0e%252Fe00e3cbfa31f28005d9bcc26a855d628%252Fpa%252FAG97977_7e397db753ea0e6e9931f8e85852fdfc.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_7e397db753ea0e6e9931f8e85852fdfc.jpg saved to cache
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d8fe388b-88a1-5daf-b963-edd319f68574
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F03%252F5603d1ff05af3fe2667a2090d9863c6c%252Fpa%252FVL95678_f45054993b101de0ea1e9e87a4fd4bb2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_f45054993b101de0ea1e9e87a4fd4bb2.jpg not downloaded yet
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a432510>
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e51624-19c1-5cb4-9789-a874bb3e41b4/e2e51624-19c1-5cb4-9789-a874bb3e41b4_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F03%252F5603d1ff05af3fe2667a2090d9863c6c%252Fpa%252FVL95678_66498ee197a7fa53e2c7c68c4432d2a3.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_66498ee197a7fa53e2c7c68c4432d2a3.jpg saved to cache
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e2e51624-19c1-5cb4-9789-a874bb3e41b4
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a43ba50>
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e51624-19c1-5cb4-9789-a874bb3e41b4/e2e51624-19c1-5cb4-9789-a874bb3e41b4_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F03%252F5603d1ff05af3fe2667a2090d9863c6c%252Fpa%252FVL95678_38d7ad035ad8c7bc2bc6e6567eff8393.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_38d7ad035ad8c7bc2bc6e6567eff8393.jpg saved to cache
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e2e51624-19c1-5cb4-9789-a874bb3e41b4
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc0610c08d0>
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8fe388b-88a1-5daf-b963-edd319f68574/d8fe388b-88a1-5daf-b963-edd319f68574_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F0e%252Fe00e3cbfa31f28005d9bcc26a855d628%252Fpa%252FAG97977_12b11aee657440c438c2213f394aab80.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_12b11aee657440c438c2213f394aab80.jpg saved to cache
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d8fe388b-88a1-5daf-b963-edd319f68574
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a490c50>
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8fe388b-88a1-5daf-b963-edd319f68574/d8fe388b-88a1-5daf-b963-edd319f68574_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F0e%252Fe00e3cbfa31f28005d9bcc26a855d628%252Fpa%252FAG97977_12d14e351ba758373e94d4b2368a7138.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_12d14e351ba758373e94d4b2368a7138.jpg saved to cache
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d8fe388b-88a1-5daf-b963-edd319f68574
2026-03-30 11:27:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d8fe388b-88a1-5daf-b963-edd319f68574, skipping ID generation
2026-03-30 11:27:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8fe388b-88a1-5daf-b963-edd319f68574 with scrape type 1
2026-03-30 11:27:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d8fe388b-88a1-5daf-b963-edd319f68574 sending to next pipeline
2026-03-30 11:27:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d8fe388b-88a1-5daf-b963-edd319f68574, identifier: AG97977
2026-03-30 11:27:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060d54ed0>
2026-03-30 11:27:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e51624-19c1-5cb4-9789-a874bb3e41b4/e2e51624-19c1-5cb4-9789-a874bb3e41b4_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:27:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F03%252F5603d1ff05af3fe2667a2090d9863c6c%252Fpa%252FVL95678_9d6666b38943c7bd71d87183521fc888.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_9d6666b38943c7bd71d87183521fc888.jpg saved to cache
2026-03-30 11:27:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e2e51624-19c1-5cb4-9789-a874bb3e41b4
2026-03-30 11:27:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d8fe388b-88a1-5daf-b963-edd319f68574 with identifier: AG97977
2026-03-30 11:27:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d8fe388b-88a1-5daf-b963-edd319f68574 with identifier: AG97977
2026-03-30 11:27:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d8fe388b-88a1-5daf-b963-edd319f68574 with identifier: AG97977 to the API
2026-03-30 11:27:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_12d14e351ba758373e94d4b2368a7138.jpg>
{'auction_title': '',
'c_o_2_emission_value': 101,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.8L',
'engine_horse_power': 136,
'expiration_date': '2026-03-31T15:09:32Z',
'fuel_type': 'hybrid',
'id': 'd8fe388b-88a1-5daf-b963-edd319f68574',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG97977',
'listing': 'auction',
'location': 'ES, Churra (Murcia)',
'make': 'Toyota',
'model': 'Prius+',
'odometer': 250137,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8fe388b-88a1-5daf-b963-edd319f68574/d8fe388b-88a1-5daf-b963-edd319f68574_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94479,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_12d14e351ba758373e94d4b2368a7138.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8fe388b-88a1-5daf-b963-edd319f68574/d8fe388b-88a1-5daf-b963-edd319f68574_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89661,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_2686675601cae46d5154ad2ca1cadcf0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8fe388b-88a1-5daf-b963-edd319f68574/d8fe388b-88a1-5daf-b963-edd319f68574_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88105,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_12b11aee657440c438c2213f394aab80.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8fe388b-88a1-5daf-b963-edd319f68574/d8fe388b-88a1-5daf-b963-edd319f68574_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74494,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_67c6cc17ffc25d34f52c759d775c538a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8fe388b-88a1-5daf-b963-edd319f68574/d8fe388b-88a1-5daf-b963-edd319f68574_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83923,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_53a4e4ace08a029f3faebe6a0a46e637.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8fe388b-88a1-5daf-b963-edd319f68574/d8fe388b-88a1-5daf-b963-edd319f68574_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87944,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_f0fb9aea423e51627228433e4096c663.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8fe388b-88a1-5daf-b963-edd319f68574/d8fe388b-88a1-5daf-b963-edd319f68574_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68996,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_5c8ab5349880c21f865c12f2299cf4f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8fe388b-88a1-5daf-b963-edd319f68574/d8fe388b-88a1-5daf-b963-edd319f68574_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88846,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_f278127e69850524e0195670301d9340.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8fe388b-88a1-5daf-b963-edd319f68574/d8fe388b-88a1-5daf-b963-edd319f68574_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87248,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_0c84f5ff967a20e9f59b537bf83df756.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8fe388b-88a1-5daf-b963-edd319f68574/d8fe388b-88a1-5daf-b963-edd319f68574_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77576,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/0e/e00e3cbfa31f28005d9bcc26a855d628/pa/AG97977_7e397db753ea0e6e9931f8e85852fdfc.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-09-27',
'seats_number': 7,
'seller_name': None,
'title': 'Toyota Prius+ 1.8 Premium',
'transmission': 'automatic',
'trim': 'Premium',
'year': 2012}
2026-03-30 11:27:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG97977%27 HTTP/1.1" 200 None
2026-03-30 11:27:22 [auto1.es] INFO: Saving data for AG97977: {'created_time': 1774870042.744856, 'last_price_update_time': 1774870042.744868, 'auction_closing_time': 1774969772.0}
2026-03-30 11:27:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AG97977') HTTP/1.1" 204 0
2026-03-30 11:27:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_7e4371b37b4170277ff6e43a08e8a2e8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_fe4d36849c90c020ed94d953e9b360d9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_2fc5d506553d8482868682564c61b53f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_8a8e007d4f32c442e12fa2c13d209273.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/78/977805a014f59979fce07fc3e28b2a6f/pa/KJ27740_5dd358fa4cba9939bb03891a56ce9d8f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YP69224> (referer: https://www.auto1.com/v1/car-details-view/YP69224/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JT99347> (referer: https://www.auto1.com/v1/car-details-view/JT99347/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a490b50>
2026-03-30 11:27:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e51624-19c1-5cb4-9789-a874bb3e41b4/e2e51624-19c1-5cb4-9789-a874bb3e41b4_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:27:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F03%252F5603d1ff05af3fe2667a2090d9863c6c%252Fpa%252FVL95678_7e4371b37b4170277ff6e43a08e8a2e8.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_7e4371b37b4170277ff6e43a08e8a2e8.jpg saved to cache
2026-03-30 11:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e2e51624-19c1-5cb4-9789-a874bb3e41b4
2026-03-30 11:27:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a2e7890>
2026-03-30 11:27:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e51624-19c1-5cb4-9789-a874bb3e41b4/e2e51624-19c1-5cb4-9789-a874bb3e41b4_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F03%252F5603d1ff05af3fe2667a2090d9863c6c%252Fpa%252FVL95678_fe4d36849c90c020ed94d953e9b360d9.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_fe4d36849c90c020ed94d953e9b360d9.jpg saved to cache
2026-03-30 11:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e2e51624-19c1-5cb4-9789-a874bb3e41b4
2026-03-30 11:27:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a33ea50>
2026-03-30 11:27:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e51624-19c1-5cb4-9789-a874bb3e41b4/e2e51624-19c1-5cb4-9789-a874bb3e41b4_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F03%252F5603d1ff05af3fe2667a2090d9863c6c%252Fpa%252FVL95678_2fc5d506553d8482868682564c61b53f.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_2fc5d506553d8482868682564c61b53f.jpg saved to cache
2026-03-30 11:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e2e51624-19c1-5cb4-9789-a874bb3e41b4
2026-03-30 11:27:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad1f190>
2026-03-30 11:27:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e51624-19c1-5cb4-9789-a874bb3e41b4/e2e51624-19c1-5cb4-9789-a874bb3e41b4_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F03%252F5603d1ff05af3fe2667a2090d9863c6c%252Fpa%252FVL95678_8a8e007d4f32c442e12fa2c13d209273.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_8a8e007d4f32c442e12fa2c13d209273.jpg saved to cache
2026-03-30 11:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e2e51624-19c1-5cb4-9789-a874bb3e41b4
2026-03-30 11:27:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a39ab10>
2026-03-30 11:27:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e63a1546-6548-5c5e-b588-ae1ebccdd90b/e63a1546-6548-5c5e-b588-ae1ebccdd90b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F78%252F977805a014f59979fce07fc3e28b2a6f%252Fpa%252FKJ27740_5dd358fa4cba9939bb03891a56ce9d8f.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/78/977805a014f59979fce07fc3e28b2a6f/pa/KJ27740_5dd358fa4cba9939bb03891a56ce9d8f.jpg saved to cache
2026-03-30 11:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e63a1546-6548-5c5e-b588-ae1ebccdd90b
2026-03-30 11:27:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e63a1546-6548-5c5e-b588-ae1ebccdd90b, skipping ID generation
2026-03-30 11:27:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e63a1546-6548-5c5e-b588-ae1ebccdd90b with scrape type 1
2026-03-30 11:27:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e63a1546-6548-5c5e-b588-ae1ebccdd90b sending to next pipeline
2026-03-30 11:27:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e63a1546-6548-5c5e-b588-ae1ebccdd90b, identifier: KJ27740
2026-03-30 11:27:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77296c80-9845-5b5a-95ca-cf0afd8edcb9 with identifier: YP69224
2026-03-30 11:27:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77296c80-9845-5b5a-95ca-cf0afd8edcb9 with scrape type 1
2026-03-30 11:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 77296c80-9845-5b5a-95ca-cf0afd8edcb9
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fc9%252Fb8c9b89eec1bbbb9e538c1aeca5a8d6d%252Fpa%252FYP69224_d798780db7417540aed7f9c84546a3e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_d798780db7417540aed7f9c84546a3e6.jpg not downloaded yet
2026-03-30 11:27:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f41c34c-8e20-5cb0-a128-811be105430c with identifier: JT99347
2026-03-30 11:27:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f41c34c-8e20-5cb0-a128-811be105430c with scrape type 1
2026-03-30 11:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4f41c34c-8e20-5cb0-a128-811be105430c
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fb5%252F7cb57a996b975b23868001d65ce519ee%252Fpa%252FJT99347_e72f561276ea527ba51366aa9bd7c9b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_e72f561276ea527ba51366aa9bd7c9b6.jpg not downloaded yet
2026-03-30 11:27:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_f45054993b101de0ea1e9e87a4fd4bb2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e63a1546-6548-5c5e-b588-ae1ebccdd90b with identifier: KJ27740
2026-03-30 11:27:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e63a1546-6548-5c5e-b588-ae1ebccdd90b with identifier: KJ27740
2026-03-30 11:27:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e63a1546-6548-5c5e-b588-ae1ebccdd90b with identifier: KJ27740 to the API
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img97/78/977805a014f59979fce07fc3e28b2a6f/pa/KJ27740_5dd358fa4cba9939bb03891a56ce9d8f.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'engine_horse_power': 175,
'expiration_date': '2026-03-31T15:39:23Z',
'fuel_type': 'diesel',
'id': 'e63a1546-6548-5c5e-b588-ae1ebccdd90b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ27740',
'listing': 'auction',
'location': 'ES, Girona',
'make': 'Ssangyong',
'model': 'Korando',
'odometer': 252784,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e63a1546-6548-5c5e-b588-ae1ebccdd90b/e63a1546-6548-5c5e-b588-ae1ebccdd90b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100530,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/78/977805a014f59979fce07fc3e28b2a6f/pa/KJ27740_94dcff43e2f495424bc781babb243ea5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e63a1546-6548-5c5e-b588-ae1ebccdd90b/e63a1546-6548-5c5e-b588-ae1ebccdd90b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90953,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/78/977805a014f59979fce07fc3e28b2a6f/pa/KJ27740_3f86b35dcea22407f533fcd51c150676.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e63a1546-6548-5c5e-b588-ae1ebccdd90b/e63a1546-6548-5c5e-b588-ae1ebccdd90b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78338,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/78/977805a014f59979fce07fc3e28b2a6f/pa/KJ27740_01ea302c2971c7651c7f8591951eae99.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e63a1546-6548-5c5e-b588-ae1ebccdd90b/e63a1546-6548-5c5e-b588-ae1ebccdd90b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64730,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/78/977805a014f59979fce07fc3e28b2a6f/pa/KJ27740_ce76f84e2efee802b558791ca01bb543.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e63a1546-6548-5c5e-b588-ae1ebccdd90b/e63a1546-6548-5c5e-b588-ae1ebccdd90b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83997,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/78/977805a014f59979fce07fc3e28b2a6f/pa/KJ27740_5dd358fa4cba9939bb03891a56ce9d8f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e63a1546-6548-5c5e-b588-ae1ebccdd90b/e63a1546-6548-5c5e-b588-ae1ebccdd90b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99408,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/78/977805a014f59979fce07fc3e28b2a6f/pa/KJ27740_949a86993278003b278da93783d63fe4.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-09-02',
'seats_number': 5,
'seller_name': None,
'title': 'Ssangyong Korando 2.0 TD Premium 4x4',
'transmission': 'manual',
'trim': 'Premium 4x4',
'year': 2014}
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KJ27740%27 HTTP/1.1" 200 None
2026-03-30 11:27:23 [auto1.es] INFO: Saving data for KJ27740: {'created_time': 1774870043.670946, 'last_price_update_time': 1774870043.670957, 'auction_closing_time': 1774971563.0}
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KJ27740') HTTP/1.1" 204 0
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fc9%252Fb8c9b89eec1bbbb9e538c1aeca5a8d6d%252Fpa%252FYP69224_ce42f37a47375d7ac48d1d6bea0b3e26.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_ce42f37a47375d7ac48d1d6bea0b3e26.jpg not downloaded yet
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fb5%252F7cb57a996b975b23868001d65ce519ee%252Fpa%252FJT99347_247fa264c829e03278ed5f7695dd1fb2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_247fa264c829e03278ed5f7695dd1fb2.jpg not downloaded yet
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fc9%252Fb8c9b89eec1bbbb9e538c1aeca5a8d6d%252Fpa%252FYP69224_0f6883e96ca2750a9b6f7196bd64dafd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_0f6883e96ca2750a9b6f7196bd64dafd.jpg not downloaded yet
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fb5%252F7cb57a996b975b23868001d65ce519ee%252Fpa%252FJT99347_40eea7d5ba3bff1b27615b011c93aeb4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_40eea7d5ba3bff1b27615b011c93aeb4.jpg not downloaded yet
2026-03-30 11:27:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060fe7d50>
2026-03-30 11:27:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e51624-19c1-5cb4-9789-a874bb3e41b4/e2e51624-19c1-5cb4-9789-a874bb3e41b4_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F03%252F5603d1ff05af3fe2667a2090d9863c6c%252Fpa%252FVL95678_f45054993b101de0ea1e9e87a4fd4bb2.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_f45054993b101de0ea1e9e87a4fd4bb2.jpg saved to cache
2026-03-30 11:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e2e51624-19c1-5cb4-9789-a874bb3e41b4
2026-03-30 11:27:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e2e51624-19c1-5cb4-9789-a874bb3e41b4, skipping ID generation
2026-03-30 11:27:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2e51624-19c1-5cb4-9789-a874bb3e41b4 with scrape type 1
2026-03-30 11:27:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e2e51624-19c1-5cb4-9789-a874bb3e41b4 sending to next pipeline
2026-03-30 11:27:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e2e51624-19c1-5cb4-9789-a874bb3e41b4, identifier: VL95678
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fc9%252Fb8c9b89eec1bbbb9e538c1aeca5a8d6d%252Fpa%252FYP69224_3f2cfda5b2dbd092c4332954ddaa4461.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_3f2cfda5b2dbd092c4332954ddaa4461.jpg not downloaded yet
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fb5%252F7cb57a996b975b23868001d65ce519ee%252Fpa%252FJT99347_d95b2ecf5d7909787e19076e4760955e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_d95b2ecf5d7909787e19076e4760955e.jpg not downloaded yet
2026-03-30 11:27:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e2e51624-19c1-5cb4-9789-a874bb3e41b4 with identifier: VL95678
2026-03-30 11:27:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e2e51624-19c1-5cb4-9789-a874bb3e41b4 with identifier: VL95678
2026-03-30 11:27:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e2e51624-19c1-5cb4-9789-a874bb3e41b4 with identifier: VL95678 to the API
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_f45054993b101de0ea1e9e87a4fd4bb2.jpg>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:38:00Z',
'fuel_type': 'petrol',
'id': 'e2e51624-19c1-5cb4-9789-a874bb3e41b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL95678',
'listing': 'auction',
'location': 'ES, Logroño',
'make': 'Opel',
'model': 'Grandland X',
'odometer': 76966,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e51624-19c1-5cb4-9789-a874bb3e41b4/e2e51624-19c1-5cb4-9789-a874bb3e41b4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69423,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_2efc46e97585034cf66fbb567bcb0de6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e51624-19c1-5cb4-9789-a874bb3e41b4/e2e51624-19c1-5cb4-9789-a874bb3e41b4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56976,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_c86e7dce15edec4fada70fb7158974b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e51624-19c1-5cb4-9789-a874bb3e41b4/e2e51624-19c1-5cb4-9789-a874bb3e41b4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67836,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_9d6666b38943c7bd71d87183521fc888.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e51624-19c1-5cb4-9789-a874bb3e41b4/e2e51624-19c1-5cb4-9789-a874bb3e41b4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53228,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_66498ee197a7fa53e2c7c68c4432d2a3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e51624-19c1-5cb4-9789-a874bb3e41b4/e2e51624-19c1-5cb4-9789-a874bb3e41b4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59617,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_38d7ad035ad8c7bc2bc6e6567eff8393.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e51624-19c1-5cb4-9789-a874bb3e41b4/e2e51624-19c1-5cb4-9789-a874bb3e41b4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64971,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_7e4371b37b4170277ff6e43a08e8a2e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e51624-19c1-5cb4-9789-a874bb3e41b4/e2e51624-19c1-5cb4-9789-a874bb3e41b4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48725,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_fe4d36849c90c020ed94d953e9b360d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e51624-19c1-5cb4-9789-a874bb3e41b4/e2e51624-19c1-5cb4-9789-a874bb3e41b4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66973,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_2fc5d506553d8482868682564c61b53f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e51624-19c1-5cb4-9789-a874bb3e41b4/e2e51624-19c1-5cb4-9789-a874bb3e41b4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68405,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_8a8e007d4f32c442e12fa2c13d209273.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e51624-19c1-5cb4-9789-a874bb3e41b4/e2e51624-19c1-5cb4-9789-a874bb3e41b4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71616,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/03/5603d1ff05af3fe2667a2090d9863c6c/pa/VL95678_f45054993b101de0ea1e9e87a4fd4bb2.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-04-08',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Grandland X 1.2 Turbo Selective',
'transmission': 'manual',
'trim': 'Selective',
'year': 2019}
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL95678%27 HTTP/1.1" 200 None
2026-03-30 11:27:24 [auto1.es] INFO: Saving data for VL95678: {'created_time': 1774870044.412719, 'last_price_update_time': 1774870044.412729, 'auction_closing_time': 1774971480.0}
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VL95678') HTTP/1.1" 204 0
2026-03-30 11:27:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_e72f561276ea527ba51366aa9bd7c9b6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_d798780db7417540aed7f9c84546a3e6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fc9%252Fb8c9b89eec1bbbb9e538c1aeca5a8d6d%252Fpa%252FYP69224_20e079871ce32d02e429c456955bc12d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_20e079871ce32d02e429c456955bc12d.jpg not downloaded yet
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fb5%252F7cb57a996b975b23868001d65ce519ee%252Fpa%252FJT99347_6fb826764c18c7576f50ceb995c48285.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_6fb826764c18c7576f50ceb995c48285.jpg not downloaded yet
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fc9%252Fb8c9b89eec1bbbb9e538c1aeca5a8d6d%252Fpa%252FYP69224_e4d7b30d1a4eb8c5f7da7a70c76d4782.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_e4d7b30d1a4eb8c5f7da7a70c76d4782.jpg not downloaded yet
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fb5%252F7cb57a996b975b23868001d65ce519ee%252Fpa%252FJT99347_4f329ebbfb1cac9e1038aba4b4cbe6be.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_4f329ebbfb1cac9e1038aba4b4cbe6be.jpg not downloaded yet
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fc9%252Fb8c9b89eec1bbbb9e538c1aeca5a8d6d%252Fpa%252FYP69224_5b1b5816194213914215ede1cad0635a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_5b1b5816194213914215ede1cad0635a.jpg not downloaded yet
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fb5%252F7cb57a996b975b23868001d65ce519ee%252Fpa%252FJT99347_c32fa95991cb5549ecb108c0398e9990.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_c32fa95991cb5549ecb108c0398e9990.jpg not downloaded yet
2026-03-30 11:27:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_247fa264c829e03278ed5f7695dd1fb2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_40eea7d5ba3bff1b27615b011c93aeb4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fc9%252Fb8c9b89eec1bbbb9e538c1aeca5a8d6d%252Fpa%252FYP69224_a37f4a6f6a52b0595049301dc789f9eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_a37f4a6f6a52b0595049301dc789f9eb.jpg not downloaded yet
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fb5%252F7cb57a996b975b23868001d65ce519ee%252Fpa%252FJT99347_0f152763dc8059ec105114b7e4fc7fb6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_0f152763dc8059ec105114b7e4fc7fb6.jpg not downloaded yet
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fc9%252Fb8c9b89eec1bbbb9e538c1aeca5a8d6d%252Fpa%252FYP69224_a4048f800f76528932325b5fce5d8ec8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_a4048f800f76528932325b5fce5d8ec8.jpg not downloaded yet
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fb5%252F7cb57a996b975b23868001d65ce519ee%252Fpa%252FJT99347_f5d117cbab688ce5a6bd6618a784b4dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_f5d117cbab688ce5a6bd6618a784b4dd.jpg not downloaded yet
2026-03-30 11:27:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a2e4750>
2026-03-30 11:27:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f41c34c-8e20-5cb0-a128-811be105430c/4f41c34c-8e20-5cb0-a128-811be105430c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fb5%252F7cb57a996b975b23868001d65ce519ee%252Fpa%252FJT99347_e72f561276ea527ba51366aa9bd7c9b6.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_e72f561276ea527ba51366aa9bd7c9b6.jpg saved to cache
2026-03-30 11:27:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4f41c34c-8e20-5cb0-a128-811be105430c
2026-03-30 11:27:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a377650>
2026-03-30 11:27:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77296c80-9845-5b5a-95ca-cf0afd8edcb9/77296c80-9845-5b5a-95ca-cf0afd8edcb9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fc9%252Fb8c9b89eec1bbbb9e538c1aeca5a8d6d%252Fpa%252FYP69224_d798780db7417540aed7f9c84546a3e6.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_d798780db7417540aed7f9c84546a3e6.jpg saved to cache
2026-03-30 11:27:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 77296c80-9845-5b5a-95ca-cf0afd8edcb9
2026-03-30 11:27:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_ce42f37a47375d7ac48d1d6bea0b3e26.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_3f2cfda5b2dbd092c4332954ddaa4461.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fc9%252Fb8c9b89eec1bbbb9e538c1aeca5a8d6d%252Fpa%252FYP69224_acd9c2a26969d81ce4b9550ca1ae9aa1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_acd9c2a26969d81ce4b9550ca1ae9aa1.jpg not downloaded yet
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fb5%252F7cb57a996b975b23868001d65ce519ee%252Fpa%252FJT99347_581882b82115060f5b740ae00588624e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_581882b82115060f5b740ae00588624e.jpg not downloaded yet
2026-03-30 11:27:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FR76848> (referer: https://www.auto1.com/v1/car-details-view/FR76848/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_4f329ebbfb1cac9e1038aba4b4cbe6be.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_d95b2ecf5d7909787e19076e4760955e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_e4d7b30d1a4eb8c5f7da7a70c76d4782.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc0603fc110>
2026-03-30 11:27:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f41c34c-8e20-5cb0-a128-811be105430c/4f41c34c-8e20-5cb0-a128-811be105430c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fb5%252F7cb57a996b975b23868001d65ce519ee%252Fpa%252FJT99347_247fa264c829e03278ed5f7695dd1fb2.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_247fa264c829e03278ed5f7695dd1fb2.jpg saved to cache
2026-03-30 11:27:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4f41c34c-8e20-5cb0-a128-811be105430c
2026-03-30 11:27:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a345810>
2026-03-30 11:27:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f41c34c-8e20-5cb0-a128-811be105430c/4f41c34c-8e20-5cb0-a128-811be105430c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fb5%252F7cb57a996b975b23868001d65ce519ee%252Fpa%252FJT99347_40eea7d5ba3bff1b27615b011c93aeb4.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_40eea7d5ba3bff1b27615b011c93aeb4.jpg saved to cache
2026-03-30 11:27:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4f41c34c-8e20-5cb0-a128-811be105430c
2026-03-30 11:27:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_0f6883e96ca2750a9b6f7196bd64dafd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_f5d117cbab688ce5a6bd6618a784b4dd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_a4048f800f76528932325b5fce5d8ec8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad1f490>
2026-03-30 11:27:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77296c80-9845-5b5a-95ca-cf0afd8edcb9/77296c80-9845-5b5a-95ca-cf0afd8edcb9_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fc9%252Fb8c9b89eec1bbbb9e538c1aeca5a8d6d%252Fpa%252FYP69224_ce42f37a47375d7ac48d1d6bea0b3e26.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_ce42f37a47375d7ac48d1d6bea0b3e26.jpg saved to cache
2026-03-30 11:27:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 77296c80-9845-5b5a-95ca-cf0afd8edcb9
2026-03-30 11:27:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a20f8d0>
2026-03-30 11:27:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77296c80-9845-5b5a-95ca-cf0afd8edcb9/77296c80-9845-5b5a-95ca-cf0afd8edcb9_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fc9%252Fb8c9b89eec1bbbb9e538c1aeca5a8d6d%252Fpa%252FYP69224_3f2cfda5b2dbd092c4332954ddaa4461.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_3f2cfda5b2dbd092c4332954ddaa4461.jpg saved to cache
2026-03-30 11:27:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 77296c80-9845-5b5a-95ca-cf0afd8edcb9
2026-03-30 11:27:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdddeb73-f0fc-596e-8fe1-cbcc5f7a8b0c with identifier: FR76848
2026-03-30 11:27:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdddeb73-f0fc-596e-8fe1-cbcc5f7a8b0c with scrape type 1
2026-03-30 11:27:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item bdddeb73-f0fc-596e-8fe1-cbcc5f7a8b0c
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F2b%252Faf2b3380ddf56f64a8a3cca9d9d57c91%252Fpa%252FFR76848_9373150f1ecf0c995225074eeb8dddfe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/2b/af2b3380ddf56f64a8a3cca9d9d57c91/pa/FR76848_9373150f1ecf0c995225074eeb8dddfe.jpg already downloaded
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F2b%252Faf2b3380ddf56f64a8a3cca9d9d57c91%252Fpa%252FFR76848_b0a0230ff17024e7fede9a5b50d01730.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/2b/af2b3380ddf56f64a8a3cca9d9d57c91/pa/FR76848_b0a0230ff17024e7fede9a5b50d01730.jpg already downloaded
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F2b%252Faf2b3380ddf56f64a8a3cca9d9d57c91%252Fpa%252FFR76848_bf4d14fdc3ba9ce4bec1c9604712cc45.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/2b/af2b3380ddf56f64a8a3cca9d9d57c91/pa/FR76848_bf4d14fdc3ba9ce4bec1c9604712cc45.jpg already downloaded
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F2b%252Faf2b3380ddf56f64a8a3cca9d9d57c91%252Fpa%252FFR76848_73781857ee2ab2299c6a398d38087fe6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/2b/af2b3380ddf56f64a8a3cca9d9d57c91/pa/FR76848_73781857ee2ab2299c6a398d38087fe6.jpg already downloaded
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F2b%252Faf2b3380ddf56f64a8a3cca9d9d57c91%252Fpa%252FFR76848_7ea7d43224fab69df870e5d1967005c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/2b/af2b3380ddf56f64a8a3cca9d9d57c91/pa/FR76848_7ea7d43224fab69df870e5d1967005c5.jpg already downloaded
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F2b%252Faf2b3380ddf56f64a8a3cca9d9d57c91%252Fpa%252FFR76848_27c03b68e42f8e8ee9f69782c86cb57b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/2b/af2b3380ddf56f64a8a3cca9d9d57c91/pa/FR76848_27c03b68e42f8e8ee9f69782c86cb57b.jpg already downloaded
2026-03-30 11:27:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bdddeb73-f0fc-596e-8fe1-cbcc5f7a8b0c, identifier: FR76848
2026-03-30 11:27:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3d8c10>
2026-03-30 11:27:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f41c34c-8e20-5cb0-a128-811be105430c/4f41c34c-8e20-5cb0-a128-811be105430c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fb5%252F7cb57a996b975b23868001d65ce519ee%252Fpa%252FJT99347_4f329ebbfb1cac9e1038aba4b4cbe6be.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_4f329ebbfb1cac9e1038aba4b4cbe6be.jpg saved to cache
2026-03-30 11:27:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4f41c34c-8e20-5cb0-a128-811be105430c
2026-03-30 11:27:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad10950>
2026-03-30 11:27:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f41c34c-8e20-5cb0-a128-811be105430c/4f41c34c-8e20-5cb0-a128-811be105430c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fb5%252F7cb57a996b975b23868001d65ce519ee%252Fpa%252FJT99347_d95b2ecf5d7909787e19076e4760955e.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_d95b2ecf5d7909787e19076e4760955e.jpg saved to cache
2026-03-30 11:27:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4f41c34c-8e20-5cb0-a128-811be105430c
2026-03-30 11:27:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060d3e550>
2026-03-30 11:27:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77296c80-9845-5b5a-95ca-cf0afd8edcb9/77296c80-9845-5b5a-95ca-cf0afd8edcb9_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fc9%252Fb8c9b89eec1bbbb9e538c1aeca5a8d6d%252Fpa%252FYP69224_e4d7b30d1a4eb8c5f7da7a70c76d4782.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_e4d7b30d1a4eb8c5f7da7a70c76d4782.jpg saved to cache
2026-03-30 11:27:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 77296c80-9845-5b5a-95ca-cf0afd8edcb9
2026-03-30 11:27:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_0f152763dc8059ec105114b7e4fc7fb6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_6fb826764c18c7576f50ceb995c48285.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bdddeb73-f0fc-596e-8fe1-cbcc5f7a8b0c with identifier: FR76848
2026-03-30 11:27:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bdddeb73-f0fc-596e-8fe1-cbcc5f7a8b0c with identifier: FR76848
2026-03-30 11:27:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bdddeb73-f0fc-596e-8fe1-cbcc5f7a8b0c with identifier: FR76848 to the API
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FR76848>
{'auction_title': '',
'c_o_2_emission_value': 107,
'category': 'Rental',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.4L',
'engine_horse_power': 70,
'expiration_date': '2026-03-31T15:59:33Z',
'fuel_type': 'diesel',
'id': 'bdddeb73-f0fc-596e-8fe1-cbcc5f7a8b0c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR76848',
'listing': 'auction',
'location': 'ES, Granyanella',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 198744,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/imgaf/2b/af2b3380ddf56f64a8a3cca9d9d57c91/pa/FR76848_9373150f1ecf0c995225074eeb8dddfe.jpg',
'https://img-pa.auto1.com/imgaf/2b/af2b3380ddf56f64a8a3cca9d9d57c91/pa/FR76848_b0a0230ff17024e7fede9a5b50d01730.jpg',
'https://img-pa.auto1.com/imgaf/2b/af2b3380ddf56f64a8a3cca9d9d57c91/pa/FR76848_bf4d14fdc3ba9ce4bec1c9604712cc45.jpg',
'https://img-pa.auto1.com/imgaf/2b/af2b3380ddf56f64a8a3cca9d9d57c91/pa/FR76848_73781857ee2ab2299c6a398d38087fe6.jpg',
'https://img-pa.auto1.com/imgaf/2b/af2b3380ddf56f64a8a3cca9d9d57c91/pa/FR76848_7ea7d43224fab69df870e5d1967005c5.jpg',
'https://img-pa.auto1.com/imgaf/2b/af2b3380ddf56f64a8a3cca9d9d57c91/pa/FR76848_27c03b68e42f8e8ee9f69782c86cb57b.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdddeb73-f0fc-596e-8fe1-cbcc5f7a8b0c/bdddeb73-f0fc-596e-8fe1-cbcc5f7a8b0c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81262,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/2b/af2b3380ddf56f64a8a3cca9d9d57c91/pa/FR76848_9373150f1ecf0c995225074eeb8dddfe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdddeb73-f0fc-596e-8fe1-cbcc5f7a8b0c/bdddeb73-f0fc-596e-8fe1-cbcc5f7a8b0c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70641,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/2b/af2b3380ddf56f64a8a3cca9d9d57c91/pa/FR76848_b0a0230ff17024e7fede9a5b50d01730.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdddeb73-f0fc-596e-8fe1-cbcc5f7a8b0c/bdddeb73-f0fc-596e-8fe1-cbcc5f7a8b0c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65621,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/2b/af2b3380ddf56f64a8a3cca9d9d57c91/pa/FR76848_bf4d14fdc3ba9ce4bec1c9604712cc45.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdddeb73-f0fc-596e-8fe1-cbcc5f7a8b0c/bdddeb73-f0fc-596e-8fe1-cbcc5f7a8b0c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69182,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/2b/af2b3380ddf56f64a8a3cca9d9d57c91/pa/FR76848_73781857ee2ab2299c6a398d38087fe6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdddeb73-f0fc-596e-8fe1-cbcc5f7a8b0c/bdddeb73-f0fc-596e-8fe1-cbcc5f7a8b0c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52296,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/2b/af2b3380ddf56f64a8a3cca9d9d57c91/pa/FR76848_7ea7d43224fab69df870e5d1967005c5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdddeb73-f0fc-596e-8fe1-cbcc5f7a8b0c/bdddeb73-f0fc-596e-8fe1-cbcc5f7a8b0c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67692,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/2b/af2b3380ddf56f64a8a3cca9d9d57c91/pa/FR76848_27c03b68e42f8e8ee9f69782c86cb57b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-02-28',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.4 TDCi Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2011}
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FR76848%27 HTTP/1.1" 200 None
2026-03-30 11:27:25 [auto1.es] INFO: Saving data for FR76848: {'created_time': 1774870045.906147, 'last_price_update_time': 1774870045.906157, 'auction_closing_time': 1774972773.0}
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FR76848') HTTP/1.1" 204 0
2026-03-30 11:27:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_20e079871ce32d02e429c456955bc12d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_a37f4a6f6a52b0595049301dc789f9eb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_c32fa95991cb5549ecb108c0398e9990.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_acd9c2a26969d81ce4b9550ca1ae9aa1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_581882b82115060f5b740ae00588624e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PM66959> (referer: https://www.auto1.com/v1/car-details-view/PM66959/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad78dd0>
2026-03-30 11:27:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77296c80-9845-5b5a-95ca-cf0afd8edcb9/77296c80-9845-5b5a-95ca-cf0afd8edcb9_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fc9%252Fb8c9b89eec1bbbb9e538c1aeca5a8d6d%252Fpa%252FYP69224_0f6883e96ca2750a9b6f7196bd64dafd.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_0f6883e96ca2750a9b6f7196bd64dafd.jpg saved to cache
2026-03-30 11:27:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 77296c80-9845-5b5a-95ca-cf0afd8edcb9
2026-03-30 11:27:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a29b9d0>
2026-03-30 11:27:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f41c34c-8e20-5cb0-a128-811be105430c/4f41c34c-8e20-5cb0-a128-811be105430c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fb5%252F7cb57a996b975b23868001d65ce519ee%252Fpa%252FJT99347_f5d117cbab688ce5a6bd6618a784b4dd.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_f5d117cbab688ce5a6bd6618a784b4dd.jpg saved to cache
2026-03-30 11:27:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4f41c34c-8e20-5cb0-a128-811be105430c
2026-03-30 11:27:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a27e810>
2026-03-30 11:27:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77296c80-9845-5b5a-95ca-cf0afd8edcb9/77296c80-9845-5b5a-95ca-cf0afd8edcb9_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fc9%252Fb8c9b89eec1bbbb9e538c1aeca5a8d6d%252Fpa%252FYP69224_a4048f800f76528932325b5fce5d8ec8.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_a4048f800f76528932325b5fce5d8ec8.jpg saved to cache
2026-03-30 11:27:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 77296c80-9845-5b5a-95ca-cf0afd8edcb9
2026-03-30 11:27:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a208b90>
2026-03-30 11:27:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f41c34c-8e20-5cb0-a128-811be105430c/4f41c34c-8e20-5cb0-a128-811be105430c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fb5%252F7cb57a996b975b23868001d65ce519ee%252Fpa%252FJT99347_0f152763dc8059ec105114b7e4fc7fb6.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_0f152763dc8059ec105114b7e4fc7fb6.jpg saved to cache
2026-03-30 11:27:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4f41c34c-8e20-5cb0-a128-811be105430c
2026-03-30 11:27:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4d7350>
2026-03-30 11:27:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f41c34c-8e20-5cb0-a128-811be105430c/4f41c34c-8e20-5cb0-a128-811be105430c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fb5%252F7cb57a996b975b23868001d65ce519ee%252Fpa%252FJT99347_6fb826764c18c7576f50ceb995c48285.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_6fb826764c18c7576f50ceb995c48285.jpg saved to cache
2026-03-30 11:27:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4f41c34c-8e20-5cb0-a128-811be105430c
2026-03-30 11:27:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a2bf690>
2026-03-30 11:27:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77296c80-9845-5b5a-95ca-cf0afd8edcb9/77296c80-9845-5b5a-95ca-cf0afd8edcb9_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fc9%252Fb8c9b89eec1bbbb9e538c1aeca5a8d6d%252Fpa%252FYP69224_20e079871ce32d02e429c456955bc12d.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_20e079871ce32d02e429c456955bc12d.jpg saved to cache
2026-03-30 11:27:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 77296c80-9845-5b5a-95ca-cf0afd8edcb9
2026-03-30 11:27:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a45bbd0>
2026-03-30 11:27:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77296c80-9845-5b5a-95ca-cf0afd8edcb9/77296c80-9845-5b5a-95ca-cf0afd8edcb9_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fc9%252Fb8c9b89eec1bbbb9e538c1aeca5a8d6d%252Fpa%252FYP69224_a37f4a6f6a52b0595049301dc789f9eb.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_a37f4a6f6a52b0595049301dc789f9eb.jpg saved to cache
2026-03-30 11:27:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 77296c80-9845-5b5a-95ca-cf0afd8edcb9
2026-03-30 11:27:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a39b850>
2026-03-30 11:27:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f41c34c-8e20-5cb0-a128-811be105430c/4f41c34c-8e20-5cb0-a128-811be105430c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fb5%252F7cb57a996b975b23868001d65ce519ee%252Fpa%252FJT99347_c32fa95991cb5549ecb108c0398e9990.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_c32fa95991cb5549ecb108c0398e9990.jpg saved to cache
2026-03-30 11:27:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4f41c34c-8e20-5cb0-a128-811be105430c
2026-03-30 11:27:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060d07c50>
2026-03-30 11:27:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77296c80-9845-5b5a-95ca-cf0afd8edcb9/77296c80-9845-5b5a-95ca-cf0afd8edcb9_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fc9%252Fb8c9b89eec1bbbb9e538c1aeca5a8d6d%252Fpa%252FYP69224_acd9c2a26969d81ce4b9550ca1ae9aa1.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_acd9c2a26969d81ce4b9550ca1ae9aa1.jpg saved to cache
2026-03-30 11:27:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 77296c80-9845-5b5a-95ca-cf0afd8edcb9
2026-03-30 11:27:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a279990>
2026-03-30 11:27:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f41c34c-8e20-5cb0-a128-811be105430c/4f41c34c-8e20-5cb0-a128-811be105430c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fb5%252F7cb57a996b975b23868001d65ce519ee%252Fpa%252FJT99347_581882b82115060f5b740ae00588624e.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_581882b82115060f5b740ae00588624e.jpg saved to cache
2026-03-30 11:27:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4f41c34c-8e20-5cb0-a128-811be105430c
2026-03-30 11:27:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4f41c34c-8e20-5cb0-a128-811be105430c, skipping ID generation
2026-03-30 11:27:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f41c34c-8e20-5cb0-a128-811be105430c with scrape type 1
2026-03-30 11:27:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4f41c34c-8e20-5cb0-a128-811be105430c sending to next pipeline
2026-03-30 11:27:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4f41c34c-8e20-5cb0-a128-811be105430c, identifier: JT99347
2026-03-30 11:27:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb41305c-9c79-59c9-8416-0489786d772c with identifier: PM66959
2026-03-30 11:27:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb41305c-9c79-59c9-8416-0489786d772c with scrape type 1
2026-03-30 11:27:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cb41305c-9c79-59c9-8416-0489786d772c
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa9%252Fc4a9b8468ce0d48118d1e1e37c7e2719%252Fpa%252FPM66959_a47dbb13ee0503a7025ab32127d20dd3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_a47dbb13ee0503a7025ab32127d20dd3.jpg not downloaded yet
2026-03-30 11:27:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4f41c34c-8e20-5cb0-a128-811be105430c with identifier: JT99347
2026-03-30 11:27:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4f41c34c-8e20-5cb0-a128-811be105430c with identifier: JT99347
2026-03-30 11:27:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4f41c34c-8e20-5cb0-a128-811be105430c with identifier: JT99347 to the API
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_581882b82115060f5b740ae00588624e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 95,
'expiration_date': '2026-03-31T15:22:41Z',
'fuel_type': 'diesel',
'id': '4f41c34c-8e20-5cb0-a128-811be105430c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT99347',
'listing': 'auction',
'location': 'ES, Tarragona',
'make': 'Ford',
'model': 'Tourneo',
'odometer': 119770,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f41c34c-8e20-5cb0-a128-811be105430c/4f41c34c-8e20-5cb0-a128-811be105430c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92881,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_e72f561276ea527ba51366aa9bd7c9b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f41c34c-8e20-5cb0-a128-811be105430c/4f41c34c-8e20-5cb0-a128-811be105430c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92448,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_247fa264c829e03278ed5f7695dd1fb2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f41c34c-8e20-5cb0-a128-811be105430c/4f41c34c-8e20-5cb0-a128-811be105430c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104782,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_40eea7d5ba3bff1b27615b011c93aeb4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f41c34c-8e20-5cb0-a128-811be105430c/4f41c34c-8e20-5cb0-a128-811be105430c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89534,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_d95b2ecf5d7909787e19076e4760955e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f41c34c-8e20-5cb0-a128-811be105430c/4f41c34c-8e20-5cb0-a128-811be105430c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93305,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_6fb826764c18c7576f50ceb995c48285.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f41c34c-8e20-5cb0-a128-811be105430c/4f41c34c-8e20-5cb0-a128-811be105430c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92484,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_4f329ebbfb1cac9e1038aba4b4cbe6be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f41c34c-8e20-5cb0-a128-811be105430c/4f41c34c-8e20-5cb0-a128-811be105430c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81451,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_c32fa95991cb5549ecb108c0398e9990.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f41c34c-8e20-5cb0-a128-811be105430c/4f41c34c-8e20-5cb0-a128-811be105430c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102079,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_0f152763dc8059ec105114b7e4fc7fb6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f41c34c-8e20-5cb0-a128-811be105430c/4f41c34c-8e20-5cb0-a128-811be105430c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86346,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_f5d117cbab688ce5a6bd6618a784b4dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f41c34c-8e20-5cb0-a128-811be105430c/4f41c34c-8e20-5cb0-a128-811be105430c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81668,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7c/b5/7cb57a996b975b23868001d65ce519ee/pa/JT99347_581882b82115060f5b740ae00588624e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-05-30',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Tourneo 1.5 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2018}
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JT99347%27 HTTP/1.1" 200 None
2026-03-30 11:27:26 [auto1.es] INFO: Saving data for JT99347: {'created_time': 1774870046.833186, 'last_price_update_time': 1774870046.833198, 'auction_closing_time': 1774970561.0}
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JT99347') HTTP/1.1" 204 0
2026-03-30 11:27:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_5b1b5816194213914215ede1cad0635a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa9%252Fc4a9b8468ce0d48118d1e1e37c7e2719%252Fpa%252FPM66959_62b108ebc90dac9a67b291cd5fa3a763.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_62b108ebc90dac9a67b291cd5fa3a763.jpg not downloaded yet
2026-03-30 11:27:26 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.709(s), this was the 1st time calling it.
2026-03-30 11:27:26 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.505148339860309 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa9%252Fc4a9b8468ce0d48118d1e1e37c7e2719%252Fpa%252FPM66959_82f4da67632f48c7da77342d896cee2f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_82f4da67632f48c7da77342d896cee2f.jpg not downloaded yet
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa9%252Fc4a9b8468ce0d48118d1e1e37c7e2719%252Fpa%252FPM66959_dc7b0a90de92a09b04e3ef140f2a49e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_dc7b0a90de92a09b04e3ef140f2a49e6.jpg not downloaded yet
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa9%252Fc4a9b8468ce0d48118d1e1e37c7e2719%252Fpa%252FPM66959_03e29ce24e7c0444361cbf769db26867.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_03e29ce24e7c0444361cbf769db26867.jpg not downloaded yet
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa9%252Fc4a9b8468ce0d48118d1e1e37c7e2719%252Fpa%252FPM66959_76d0a90664ee52a2ffc291a83607a794.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_76d0a90664ee52a2ffc291a83607a794.jpg not downloaded yet
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa9%252Fc4a9b8468ce0d48118d1e1e37c7e2719%252Fpa%252FPM66959_2be543704162ec25d5ebf9189f8cbfb8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_2be543704162ec25d5ebf9189f8cbfb8.jpg not downloaded yet
2026-03-30 11:27:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_a47dbb13ee0503a7025ab32127d20dd3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa9%252Fc4a9b8468ce0d48118d1e1e37c7e2719%252Fpa%252FPM66959_27e6a15ff712ae00f20e228dd6d23029.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_27e6a15ff712ae00f20e228dd6d23029.jpg not downloaded yet
2026-03-30 11:27:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_62b108ebc90dac9a67b291cd5fa3a763.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a275890>
2026-03-30 11:27:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77296c80-9845-5b5a-95ca-cf0afd8edcb9/77296c80-9845-5b5a-95ca-cf0afd8edcb9_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fc9%252Fb8c9b89eec1bbbb9e538c1aeca5a8d6d%252Fpa%252FYP69224_5b1b5816194213914215ede1cad0635a.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_5b1b5816194213914215ede1cad0635a.jpg saved to cache
2026-03-30 11:27:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 77296c80-9845-5b5a-95ca-cf0afd8edcb9
2026-03-30 11:27:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 77296c80-9845-5b5a-95ca-cf0afd8edcb9, skipping ID generation
2026-03-30 11:27:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77296c80-9845-5b5a-95ca-cf0afd8edcb9 with scrape type 1
2026-03-30 11:27:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 77296c80-9845-5b5a-95ca-cf0afd8edcb9 sending to next pipeline
2026-03-30 11:27:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 77296c80-9845-5b5a-95ca-cf0afd8edcb9, identifier: YP69224
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa9%252Fc4a9b8468ce0d48118d1e1e37c7e2719%252Fpa%252FPM66959_10bb795872028ae52aae01864bf1475a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_10bb795872028ae52aae01864bf1475a.jpg not downloaded yet
2026-03-30 11:27:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 77296c80-9845-5b5a-95ca-cf0afd8edcb9 with identifier: YP69224
2026-03-30 11:27:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 77296c80-9845-5b5a-95ca-cf0afd8edcb9 with identifier: YP69224
2026-03-30 11:27:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 77296c80-9845-5b5a-95ca-cf0afd8edcb9 with identifier: YP69224 to the API
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_5b1b5816194213914215ede1cad0635a.jpg>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 132,
'expiration_date': '2026-03-31T15:41:35Z',
'fuel_type': 'petrol',
'id': '77296c80-9845-5b5a-95ca-cf0afd8edcb9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP69224',
'listing': 'auction',
'location': 'ES, Colmenar Viejo',
'make': 'Renault',
'model': 'Scenic',
'odometer': 175858,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77296c80-9845-5b5a-95ca-cf0afd8edcb9/77296c80-9845-5b5a-95ca-cf0afd8edcb9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77669,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_d798780db7417540aed7f9c84546a3e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77296c80-9845-5b5a-95ca-cf0afd8edcb9/77296c80-9845-5b5a-95ca-cf0afd8edcb9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69886,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_ce42f37a47375d7ac48d1d6bea0b3e26.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77296c80-9845-5b5a-95ca-cf0afd8edcb9/77296c80-9845-5b5a-95ca-cf0afd8edcb9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65319,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_0f6883e96ca2750a9b6f7196bd64dafd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77296c80-9845-5b5a-95ca-cf0afd8edcb9/77296c80-9845-5b5a-95ca-cf0afd8edcb9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57414,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_3f2cfda5b2dbd092c4332954ddaa4461.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77296c80-9845-5b5a-95ca-cf0afd8edcb9/77296c80-9845-5b5a-95ca-cf0afd8edcb9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73303,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_20e079871ce32d02e429c456955bc12d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77296c80-9845-5b5a-95ca-cf0afd8edcb9/77296c80-9845-5b5a-95ca-cf0afd8edcb9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66501,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_e4d7b30d1a4eb8c5f7da7a70c76d4782.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77296c80-9845-5b5a-95ca-cf0afd8edcb9/77296c80-9845-5b5a-95ca-cf0afd8edcb9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64520,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_5b1b5816194213914215ede1cad0635a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77296c80-9845-5b5a-95ca-cf0afd8edcb9/77296c80-9845-5b5a-95ca-cf0afd8edcb9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74322,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_a37f4a6f6a52b0595049301dc789f9eb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77296c80-9845-5b5a-95ca-cf0afd8edcb9/77296c80-9845-5b5a-95ca-cf0afd8edcb9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83914,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_a4048f800f76528932325b5fce5d8ec8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77296c80-9845-5b5a-95ca-cf0afd8edcb9/77296c80-9845-5b5a-95ca-cf0afd8edcb9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71346,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb8/c9/b8c9b89eec1bbbb9e538c1aeca5a8d6d/pa/YP69224_acd9c2a26969d81ce4b9550ca1ae9aa1.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-11-20',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Scenic 1.2 TCe Energy Edition One',
'transmission': 'manual',
'trim': 'Edition One',
'year': 2017}
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YP69224%27 HTTP/1.1" 200 None
2026-03-30 11:27:27 [auto1.es] INFO: Saving data for YP69224: {'created_time': 1774870047.586697, 'last_price_update_time': 1774870047.586707, 'auction_closing_time': 1774971695.0}
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YP69224') HTTP/1.1" 204 0
2026-03-30 11:27:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_82f4da67632f48c7da77342d896cee2f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_dc7b0a90de92a09b04e3ef140f2a49e6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_03e29ce24e7c0444361cbf769db26867.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa9%252Fc4a9b8468ce0d48118d1e1e37c7e2719%252Fpa%252FPM66959_13842480da875bc9c3e079343dfe529a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_13842480da875bc9c3e079343dfe529a.jpg not downloaded yet
2026-03-30 11:27:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_76d0a90664ee52a2ffc291a83607a794.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a399050>
2026-03-30 11:27:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb41305c-9c79-59c9-8416-0489786d772c/cb41305c-9c79-59c9-8416-0489786d772c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa9%252Fc4a9b8468ce0d48118d1e1e37c7e2719%252Fpa%252FPM66959_a47dbb13ee0503a7025ab32127d20dd3.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_a47dbb13ee0503a7025ab32127d20dd3.jpg saved to cache
2026-03-30 11:27:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb41305c-9c79-59c9-8416-0489786d772c
2026-03-30 11:27:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc0610f4650>
2026-03-30 11:27:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb41305c-9c79-59c9-8416-0489786d772c/cb41305c-9c79-59c9-8416-0489786d772c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa9%252Fc4a9b8468ce0d48118d1e1e37c7e2719%252Fpa%252FPM66959_62b108ebc90dac9a67b291cd5fa3a763.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_62b108ebc90dac9a67b291cd5fa3a763.jpg saved to cache
2026-03-30 11:27:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cb41305c-9c79-59c9-8416-0489786d772c
2026-03-30 11:27:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_2be543704162ec25d5ebf9189f8cbfb8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a33d150>
2026-03-30 11:27:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb41305c-9c79-59c9-8416-0489786d772c/cb41305c-9c79-59c9-8416-0489786d772c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa9%252Fc4a9b8468ce0d48118d1e1e37c7e2719%252Fpa%252FPM66959_82f4da67632f48c7da77342d896cee2f.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_82f4da67632f48c7da77342d896cee2f.jpg saved to cache
2026-03-30 11:27:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cb41305c-9c79-59c9-8416-0489786d772c
2026-03-30 11:27:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad4b810>
2026-03-30 11:27:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb41305c-9c79-59c9-8416-0489786d772c/cb41305c-9c79-59c9-8416-0489786d772c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa9%252Fc4a9b8468ce0d48118d1e1e37c7e2719%252Fpa%252FPM66959_dc7b0a90de92a09b04e3ef140f2a49e6.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_dc7b0a90de92a09b04e3ef140f2a49e6.jpg saved to cache
2026-03-30 11:27:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cb41305c-9c79-59c9-8416-0489786d772c
2026-03-30 11:27:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a462190>
2026-03-30 11:27:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb41305c-9c79-59c9-8416-0489786d772c/cb41305c-9c79-59c9-8416-0489786d772c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa9%252Fc4a9b8468ce0d48118d1e1e37c7e2719%252Fpa%252FPM66959_03e29ce24e7c0444361cbf769db26867.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_03e29ce24e7c0444361cbf769db26867.jpg saved to cache
2026-03-30 11:27:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cb41305c-9c79-59c9-8416-0489786d772c
2026-03-30 11:27:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a2b3890>
2026-03-30 11:27:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb41305c-9c79-59c9-8416-0489786d772c/cb41305c-9c79-59c9-8416-0489786d772c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa9%252Fc4a9b8468ce0d48118d1e1e37c7e2719%252Fpa%252FPM66959_76d0a90664ee52a2ffc291a83607a794.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_76d0a90664ee52a2ffc291a83607a794.jpg saved to cache
2026-03-30 11:27:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cb41305c-9c79-59c9-8416-0489786d772c
2026-03-30 11:27:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_27e6a15ff712ae00f20e228dd6d23029.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_13842480da875bc9c3e079343dfe529a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_10bb795872028ae52aae01864bf1475a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a2e6610>
2026-03-30 11:27:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb41305c-9c79-59c9-8416-0489786d772c/cb41305c-9c79-59c9-8416-0489786d772c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa9%252Fc4a9b8468ce0d48118d1e1e37c7e2719%252Fpa%252FPM66959_2be543704162ec25d5ebf9189f8cbfb8.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_2be543704162ec25d5ebf9189f8cbfb8.jpg saved to cache
2026-03-30 11:27:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cb41305c-9c79-59c9-8416-0489786d772c
2026-03-30 11:27:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4effd0>
2026-03-30 11:27:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb41305c-9c79-59c9-8416-0489786d772c/cb41305c-9c79-59c9-8416-0489786d772c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa9%252Fc4a9b8468ce0d48118d1e1e37c7e2719%252Fpa%252FPM66959_27e6a15ff712ae00f20e228dd6d23029.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_27e6a15ff712ae00f20e228dd6d23029.jpg saved to cache
2026-03-30 11:27:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cb41305c-9c79-59c9-8416-0489786d772c
2026-03-30 11:27:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4b5850>
2026-03-30 11:27:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb41305c-9c79-59c9-8416-0489786d772c/cb41305c-9c79-59c9-8416-0489786d772c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa9%252Fc4a9b8468ce0d48118d1e1e37c7e2719%252Fpa%252FPM66959_13842480da875bc9c3e079343dfe529a.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_13842480da875bc9c3e079343dfe529a.jpg saved to cache
2026-03-30 11:27:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cb41305c-9c79-59c9-8416-0489786d772c
2026-03-30 11:27:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3b2b10>
2026-03-30 11:27:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb41305c-9c79-59c9-8416-0489786d772c/cb41305c-9c79-59c9-8416-0489786d772c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa9%252Fc4a9b8468ce0d48118d1e1e37c7e2719%252Fpa%252FPM66959_10bb795872028ae52aae01864bf1475a.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_10bb795872028ae52aae01864bf1475a.jpg saved to cache
2026-03-30 11:27:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cb41305c-9c79-59c9-8416-0489786d772c
2026-03-30 11:27:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb41305c-9c79-59c9-8416-0489786d772c, skipping ID generation
2026-03-30 11:27:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb41305c-9c79-59c9-8416-0489786d772c with scrape type 1
2026-03-30 11:27:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb41305c-9c79-59c9-8416-0489786d772c sending to next pipeline
2026-03-30 11:27:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cb41305c-9c79-59c9-8416-0489786d772c, identifier: PM66959
2026-03-30 11:27:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cb41305c-9c79-59c9-8416-0489786d772c with identifier: PM66959
2026-03-30 11:27:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cb41305c-9c79-59c9-8416-0489786d772c with identifier: PM66959
2026-03-30 11:27:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cb41305c-9c79-59c9-8416-0489786d772c with identifier: PM66959 to the API
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_10bb795872028ae52aae01864bf1475a.jpg>
{'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 225,
'expiration_date': '2026-03-31T15:03:42Z',
'fuel_type': 'petrol',
'id': 'cb41305c-9c79-59c9-8416-0489786d772c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM66959',
'listing': 'auction',
'location': 'ES, Leganés',
'make': 'Peugeot',
'model': '308',
'odometer': 131465,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb41305c-9c79-59c9-8416-0489786d772c/cb41305c-9c79-59c9-8416-0489786d772c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106272,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_a47dbb13ee0503a7025ab32127d20dd3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb41305c-9c79-59c9-8416-0489786d772c/cb41305c-9c79-59c9-8416-0489786d772c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101898,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_62b108ebc90dac9a67b291cd5fa3a763.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb41305c-9c79-59c9-8416-0489786d772c/cb41305c-9c79-59c9-8416-0489786d772c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85930,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_82f4da67632f48c7da77342d896cee2f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb41305c-9c79-59c9-8416-0489786d772c/cb41305c-9c79-59c9-8416-0489786d772c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77040,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_dc7b0a90de92a09b04e3ef140f2a49e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb41305c-9c79-59c9-8416-0489786d772c/cb41305c-9c79-59c9-8416-0489786d772c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66887,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_03e29ce24e7c0444361cbf769db26867.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb41305c-9c79-59c9-8416-0489786d772c/cb41305c-9c79-59c9-8416-0489786d772c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84400,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_76d0a90664ee52a2ffc291a83607a794.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb41305c-9c79-59c9-8416-0489786d772c/cb41305c-9c79-59c9-8416-0489786d772c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67292,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_2be543704162ec25d5ebf9189f8cbfb8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb41305c-9c79-59c9-8416-0489786d772c/cb41305c-9c79-59c9-8416-0489786d772c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96998,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_27e6a15ff712ae00f20e228dd6d23029.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb41305c-9c79-59c9-8416-0489786d772c/cb41305c-9c79-59c9-8416-0489786d772c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82539,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_10bb795872028ae52aae01864bf1475a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb41305c-9c79-59c9-8416-0489786d772c/cb41305c-9c79-59c9-8416-0489786d772c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64768,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/a9/c4a9b8468ce0d48118d1e1e37c7e2719/pa/PM66959_13842480da875bc9c3e079343dfe529a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-03-24',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.6 PureTech GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2019}
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PM66959%27 HTTP/1.1" 200 None
2026-03-30 11:27:28 [auto1.es] INFO: Saving data for PM66959: {'created_time': 1774870048.712065, 'last_price_update_time': 1774870048.712077, 'auction_closing_time': 1774969422.0}
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PM66959') HTTP/1.1" 204 0
2026-03-30 11:27:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XC17897> (referer: https://www.auto1.com/v1/car-details-view/XC17897/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69ee9137-d0ea-590d-937c-f653ded8d45e with identifier: XC17897
2026-03-30 11:27:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69ee9137-d0ea-590d-937c-f653ded8d45e with scrape type 1
2026-03-30 11:27:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 69ee9137-d0ea-590d-937c-f653ded8d45e
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbc%252F6cbc2250709e219a8fc6b691d0fcbf13%252Fpa%252FXC17897_0de66e302e42a05eb849a5cd020831dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bc/6cbc2250709e219a8fc6b691d0fcbf13/pa/XC17897_0de66e302e42a05eb849a5cd020831dd.jpg already downloaded
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbc%252F6cbc2250709e219a8fc6b691d0fcbf13%252Fpa%252FXC17897_2b69c25992aeed614a06702728787e82.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bc/6cbc2250709e219a8fc6b691d0fcbf13/pa/XC17897_2b69c25992aeed614a06702728787e82.jpg already downloaded
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbc%252F6cbc2250709e219a8fc6b691d0fcbf13%252Fpa%252FXC17897_2a88d6f28353414bf0d1c704d51c4069.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bc/6cbc2250709e219a8fc6b691d0fcbf13/pa/XC17897_2a88d6f28353414bf0d1c704d51c4069.jpg already downloaded
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbc%252F6cbc2250709e219a8fc6b691d0fcbf13%252Fpa%252FXC17897_bbec29db99e75ac1dd3c4ce5005ddba8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bc/6cbc2250709e219a8fc6b691d0fcbf13/pa/XC17897_bbec29db99e75ac1dd3c4ce5005ddba8.jpg already downloaded
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbc%252F6cbc2250709e219a8fc6b691d0fcbf13%252Fpa%252FXC17897_162bd69bdbf8c4ed889c9ffddacb1626.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bc/6cbc2250709e219a8fc6b691d0fcbf13/pa/XC17897_162bd69bdbf8c4ed889c9ffddacb1626.jpg already downloaded
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbc%252F6cbc2250709e219a8fc6b691d0fcbf13%252Fpa%252FXC17897_0a88b8a10ec5da8b52c4ed41ba3184c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bc/6cbc2250709e219a8fc6b691d0fcbf13/pa/XC17897_0a88b8a10ec5da8b52c4ed41ba3184c3.jpg already downloaded
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbc%252F6cbc2250709e219a8fc6b691d0fcbf13%252Fpa%252FXC17897_8a584e06c14e9e82b08b6b7d24c2f38a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bc/6cbc2250709e219a8fc6b691d0fcbf13/pa/XC17897_8a584e06c14e9e82b08b6b7d24c2f38a.jpg already downloaded
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbc%252F6cbc2250709e219a8fc6b691d0fcbf13%252Fpa%252FXC17897_dee012bf5c804be9e1901aae241975d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bc/6cbc2250709e219a8fc6b691d0fcbf13/pa/XC17897_dee012bf5c804be9e1901aae241975d5.jpg already downloaded
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbc%252F6cbc2250709e219a8fc6b691d0fcbf13%252Fpa%252FXC17897_7cd8a36cd4967874f3313738cb324686.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bc/6cbc2250709e219a8fc6b691d0fcbf13/pa/XC17897_7cd8a36cd4967874f3313738cb324686.jpg already downloaded
2026-03-30 11:27:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbc%252F6cbc2250709e219a8fc6b691d0fcbf13%252Fpa%252FXC17897_7920c58bd00c03005b0b961585a5ab5f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bc/6cbc2250709e219a8fc6b691d0fcbf13/pa/XC17897_7920c58bd00c03005b0b961585a5ab5f.jpg already downloaded
2026-03-30 11:27:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 69ee9137-d0ea-590d-937c-f653ded8d45e, identifier: XC17897
2026-03-30 11:27:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 69ee9137-d0ea-590d-937c-f653ded8d45e with identifier: XC17897
2026-03-30 11:27:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 69ee9137-d0ea-590d-937c-f653ded8d45e with identifier: XC17897
2026-03-30 11:27:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 69ee9137-d0ea-590d-937c-f653ded8d45e with identifier: XC17897 to the API
2026-03-30 11:27:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XC17897>
{'auction_title': '',
'c_o_2_emission_value': 95,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 92,
'expiration_date': '2026-03-31T15:13:42Z',
'fuel_type': 'diesel',
'id': '69ee9137-d0ea-590d-937c-f653ded8d45e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC17897',
'listing': 'auction',
'location': 'ES, La Roda de AndalucÃa',
'make': 'Peugeot',
'model': '208',
'odometer': 51141,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img6c/bc/6cbc2250709e219a8fc6b691d0fcbf13/pa/XC17897_0de66e302e42a05eb849a5cd020831dd.jpg',
'https://img-pa.auto1.com/img6c/bc/6cbc2250709e219a8fc6b691d0fcbf13/pa/XC17897_2b69c25992aeed614a06702728787e82.jpg',
'https://img-pa.auto1.com/img6c/bc/6cbc2250709e219a8fc6b691d0fcbf13/pa/XC17897_2a88d6f28353414bf0d1c704d51c4069.jpg',
'https://img-pa.auto1.com/img6c/bc/6cbc2250709e219a8fc6b691d0fcbf13/pa/XC17897_bbec29db99e75ac1dd3c4ce5005ddba8.jpg',
'https://img-pa.auto1.com/img6c/bc/6cbc2250709e219a8fc6b691d0fcbf13/pa/XC17897_162bd69bdbf8c4ed889c9ffddacb1626.jpg',
'https://img-pa.auto1.com/img6c/bc/6cbc2250709e219a8fc6b691d0fcbf13/pa/XC17897_0a88b8a10ec5da8b52c4ed41ba3184c3.jpg',
'https://img-pa.auto1.com/img6c/bc/6cbc2250709e219a8fc6b691d0fcbf13/pa/XC17897_8a584e06c14e9e82b08b6b7d24c2f38a.jpg',
'https://img-pa.auto1.com/img6c/bc/6cbc2250709e219a8fc6b691d0fcbf13/pa/XC17897_dee012bf5c804be9e1901aae241975d5.jpg',
'https://img-pa.auto1.com/img6c/bc/6cbc2250709e219a8fc6b691d0fcbf13/pa/XC17897_7cd8a36cd4967874f3313738cb324686.jpg',
'https://img-pa.auto1.com/img6c/bc/6cbc2250709e219a8fc6b691d0fcbf13/pa/XC17897_7920c58bd00c03005b0b961585a5ab5f.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69ee9137-d0ea-590d-937c-f653ded8d45e/69ee9137-d0ea-590d-937c-f653ded8d45e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58599,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/bc/6cbc2250709e219a8fc6b691d0fcbf13/pa/XC17897_0de66e302e42a05eb849a5cd020831dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69ee9137-d0ea-590d-937c-f653ded8d45e/69ee9137-d0ea-590d-937c-f653ded8d45e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58511,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/bc/6cbc2250709e219a8fc6b691d0fcbf13/pa/XC17897_2b69c25992aeed614a06702728787e82.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69ee9137-d0ea-590d-937c-f653ded8d45e/69ee9137-d0ea-590d-937c-f653ded8d45e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59134,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/bc/6cbc2250709e219a8fc6b691d0fcbf13/pa/XC17897_2a88d6f28353414bf0d1c704d51c4069.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69ee9137-d0ea-590d-937c-f653ded8d45e/69ee9137-d0ea-590d-937c-f653ded8d45e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41967,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/bc/6cbc2250709e219a8fc6b691d0fcbf13/pa/XC17897_bbec29db99e75ac1dd3c4ce5005ddba8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69ee9137-d0ea-590d-937c-f653ded8d45e/69ee9137-d0ea-590d-937c-f653ded8d45e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63857,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/bc/6cbc2250709e219a8fc6b691d0fcbf13/pa/XC17897_162bd69bdbf8c4ed889c9ffddacb1626.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69ee9137-d0ea-590d-937c-f653ded8d45e/69ee9137-d0ea-590d-937c-f653ded8d45e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60418,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/bc/6cbc2250709e219a8fc6b691d0fcbf13/pa/XC17897_0a88b8a10ec5da8b52c4ed41ba3184c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69ee9137-d0ea-590d-937c-f653ded8d45e/69ee9137-d0ea-590d-937c-f653ded8d45e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54015,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/bc/6cbc2250709e219a8fc6b691d0fcbf13/pa/XC17897_8a584e06c14e9e82b08b6b7d24c2f38a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69ee9137-d0ea-590d-937c-f653ded8d45e/69ee9137-d0ea-590d-937c-f653ded8d45e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65054,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/bc/6cbc2250709e219a8fc6b691d0fcbf13/pa/XC17897_dee012bf5c804be9e1901aae241975d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69ee9137-d0ea-590d-937c-f653ded8d45e/69ee9137-d0ea-590d-937c-f653ded8d45e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47799,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/bc/6cbc2250709e219a8fc6b691d0fcbf13/pa/XC17897_7cd8a36cd4967874f3313738cb324686.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69ee9137-d0ea-590d-937c-f653ded8d45e/69ee9137-d0ea-590d-937c-f653ded8d45e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69070,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/bc/6cbc2250709e219a8fc6b691d0fcbf13/pa/XC17897_7920c58bd00c03005b0b961585a5ab5f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-04-29',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.6 HDi Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2015}
2026-03-30 11:27:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC17897%27 HTTP/1.1" 200 None
2026-03-30 11:27:29 [auto1.es] INFO: Saving data for XC17897: {'created_time': 1774870049.475211, 'last_price_update_time': 1774870049.475226, 'auction_closing_time': 1774970022.0}
2026-03-30 11:27:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XC17897') HTTP/1.1" 204 0
2026-03-30 11:27:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KF41905> (referer: https://www.auto1.com/v1/car-details-view/KF41905/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DG01155> (referer: https://www.auto1.com/v1/car-details-view/DG01155/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AE25317> (referer: https://www.auto1.com/v1/car-details-view/AE25317/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b4f4e3c-3bd4-5505-97cf-8092cdc537cf with identifier: KF41905
2026-03-30 11:27:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b4f4e3c-3bd4-5505-97cf-8092cdc537cf with scrape type 1
2026-03-30 11:27:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6b4f4e3c-3bd4-5505-97cf-8092cdc537cf
2026-03-30 11:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F4b%252F364b78ebffee8bf2cc372dbec0e73363%252Fpa%252FKF41905_ad990c5cf3d61c0f8739641137da085d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/4b/364b78ebffee8bf2cc372dbec0e73363/pa/KF41905_ad990c5cf3d61c0f8739641137da085d.jpg already downloaded
2026-03-30 11:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F4b%252F364b78ebffee8bf2cc372dbec0e73363%252Fpa%252FKF41905_86643983d3afda4dec0e120d1d0ecd1d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/4b/364b78ebffee8bf2cc372dbec0e73363/pa/KF41905_86643983d3afda4dec0e120d1d0ecd1d.jpg already downloaded
2026-03-30 11:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F4b%252F364b78ebffee8bf2cc372dbec0e73363%252Fpa%252FKF41905_fd46a9dba71916fadb11012e791d7200.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/4b/364b78ebffee8bf2cc372dbec0e73363/pa/KF41905_fd46a9dba71916fadb11012e791d7200.jpg already downloaded
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F4b%252F364b78ebffee8bf2cc372dbec0e73363%252Fpa%252FKF41905_c040b03dee826339bfbd5d94b17f01aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/4b/364b78ebffee8bf2cc372dbec0e73363/pa/KF41905_c040b03dee826339bfbd5d94b17f01aa.jpg already downloaded
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F4b%252F364b78ebffee8bf2cc372dbec0e73363%252Fpa%252FKF41905_5014ff16b53127d628b88cfa45af5eb4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/4b/364b78ebffee8bf2cc372dbec0e73363/pa/KF41905_5014ff16b53127d628b88cfa45af5eb4.jpg already downloaded
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F4b%252F364b78ebffee8bf2cc372dbec0e73363%252Fpa%252FKF41905_edc2e2f0223b78d02f4575ef5534ed55.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/4b/364b78ebffee8bf2cc372dbec0e73363/pa/KF41905_edc2e2f0223b78d02f4575ef5534ed55.jpg already downloaded
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F4b%252F364b78ebffee8bf2cc372dbec0e73363%252Fpa%252FKF41905_23a674a07d4333df06d43c3a6aff48a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/4b/364b78ebffee8bf2cc372dbec0e73363/pa/KF41905_23a674a07d4333df06d43c3a6aff48a7.jpg already downloaded
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F4b%252F364b78ebffee8bf2cc372dbec0e73363%252Fpa%252FKF41905_cfadde6a230b701f59647dc4e26d1ef8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/4b/364b78ebffee8bf2cc372dbec0e73363/pa/KF41905_cfadde6a230b701f59647dc4e26d1ef8.jpg already downloaded
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F4b%252F364b78ebffee8bf2cc372dbec0e73363%252Fpa%252FKF41905_531ca49345709a02054a66a62afc7340.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/4b/364b78ebffee8bf2cc372dbec0e73363/pa/KF41905_531ca49345709a02054a66a62afc7340.jpg already downloaded
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F4b%252F364b78ebffee8bf2cc372dbec0e73363%252Fpa%252FKF41905_a5c725d67671deaad0c98a3c0c239c71.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/4b/364b78ebffee8bf2cc372dbec0e73363/pa/KF41905_a5c725d67671deaad0c98a3c0c239c71.jpg already downloaded
2026-03-30 11:27:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6b4f4e3c-3bd4-5505-97cf-8092cdc537cf, identifier: KF41905
2026-03-30 11:27:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6b4f4e3c-3bd4-5505-97cf-8092cdc537cf with identifier: KF41905
2026-03-30 11:27:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6b4f4e3c-3bd4-5505-97cf-8092cdc537cf with identifier: KF41905
2026-03-30 11:27:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6b4f4e3c-3bd4-5505-97cf-8092cdc537cf with identifier: KF41905 to the API
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KF41905>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:11:19Z',
'fuel_type': 'petrol',
'id': '6b4f4e3c-3bd4-5505-97cf-8092cdc537cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF41905',
'listing': 'auction',
'location': 'ES, Campo Real',
'make': 'Opel',
'model': 'Grandland X',
'odometer': 108187,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img36/4b/364b78ebffee8bf2cc372dbec0e73363/pa/KF41905_ad990c5cf3d61c0f8739641137da085d.jpg',
'https://img-pa.auto1.com/img36/4b/364b78ebffee8bf2cc372dbec0e73363/pa/KF41905_86643983d3afda4dec0e120d1d0ecd1d.jpg',
'https://img-pa.auto1.com/img36/4b/364b78ebffee8bf2cc372dbec0e73363/pa/KF41905_fd46a9dba71916fadb11012e791d7200.jpg',
'https://img-pa.auto1.com/img36/4b/364b78ebffee8bf2cc372dbec0e73363/pa/KF41905_c040b03dee826339bfbd5d94b17f01aa.jpg',
'https://img-pa.auto1.com/img36/4b/364b78ebffee8bf2cc372dbec0e73363/pa/KF41905_5014ff16b53127d628b88cfa45af5eb4.jpg',
'https://img-pa.auto1.com/img36/4b/364b78ebffee8bf2cc372dbec0e73363/pa/KF41905_edc2e2f0223b78d02f4575ef5534ed55.jpg',
'https://img-pa.auto1.com/img36/4b/364b78ebffee8bf2cc372dbec0e73363/pa/KF41905_23a674a07d4333df06d43c3a6aff48a7.jpg',
'https://img-pa.auto1.com/img36/4b/364b78ebffee8bf2cc372dbec0e73363/pa/KF41905_cfadde6a230b701f59647dc4e26d1ef8.jpg',
'https://img-pa.auto1.com/img36/4b/364b78ebffee8bf2cc372dbec0e73363/pa/KF41905_531ca49345709a02054a66a62afc7340.jpg',
'https://img-pa.auto1.com/img36/4b/364b78ebffee8bf2cc372dbec0e73363/pa/KF41905_a5c725d67671deaad0c98a3c0c239c71.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b4f4e3c-3bd4-5505-97cf-8092cdc537cf/6b4f4e3c-3bd4-5505-97cf-8092cdc537cf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94808,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/4b/364b78ebffee8bf2cc372dbec0e73363/pa/KF41905_ad990c5cf3d61c0f8739641137da085d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b4f4e3c-3bd4-5505-97cf-8092cdc537cf/6b4f4e3c-3bd4-5505-97cf-8092cdc537cf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85605,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/4b/364b78ebffee8bf2cc372dbec0e73363/pa/KF41905_86643983d3afda4dec0e120d1d0ecd1d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b4f4e3c-3bd4-5505-97cf-8092cdc537cf/6b4f4e3c-3bd4-5505-97cf-8092cdc537cf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80011,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/4b/364b78ebffee8bf2cc372dbec0e73363/pa/KF41905_fd46a9dba71916fadb11012e791d7200.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b4f4e3c-3bd4-5505-97cf-8092cdc537cf/6b4f4e3c-3bd4-5505-97cf-8092cdc537cf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72746,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/4b/364b78ebffee8bf2cc372dbec0e73363/pa/KF41905_c040b03dee826339bfbd5d94b17f01aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b4f4e3c-3bd4-5505-97cf-8092cdc537cf/6b4f4e3c-3bd4-5505-97cf-8092cdc537cf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84200,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/4b/364b78ebffee8bf2cc372dbec0e73363/pa/KF41905_5014ff16b53127d628b88cfa45af5eb4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b4f4e3c-3bd4-5505-97cf-8092cdc537cf/6b4f4e3c-3bd4-5505-97cf-8092cdc537cf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93875,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/4b/364b78ebffee8bf2cc372dbec0e73363/pa/KF41905_edc2e2f0223b78d02f4575ef5534ed55.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b4f4e3c-3bd4-5505-97cf-8092cdc537cf/6b4f4e3c-3bd4-5505-97cf-8092cdc537cf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74271,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/4b/364b78ebffee8bf2cc372dbec0e73363/pa/KF41905_23a674a07d4333df06d43c3a6aff48a7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b4f4e3c-3bd4-5505-97cf-8092cdc537cf/6b4f4e3c-3bd4-5505-97cf-8092cdc537cf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83359,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/4b/364b78ebffee8bf2cc372dbec0e73363/pa/KF41905_cfadde6a230b701f59647dc4e26d1ef8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b4f4e3c-3bd4-5505-97cf-8092cdc537cf/6b4f4e3c-3bd4-5505-97cf-8092cdc537cf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95288,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/4b/364b78ebffee8bf2cc372dbec0e73363/pa/KF41905_531ca49345709a02054a66a62afc7340.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b4f4e3c-3bd4-5505-97cf-8092cdc537cf/6b4f4e3c-3bd4-5505-97cf-8092cdc537cf_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80682,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/4b/364b78ebffee8bf2cc372dbec0e73363/pa/KF41905_a5c725d67671deaad0c98a3c0c239c71.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-09-17',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Grandland X 1.2 Turbo 120 Jahre',
'transmission': 'manual',
'trim': '120 Jahre',
'year': 2019}
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KF41905%27 HTTP/1.1" 200 None
2026-03-30 11:27:32 [auto1.es] INFO: Saving data for KF41905: {'created_time': 1774870052.55898, 'last_price_update_time': 1774870052.55899, 'auction_closing_time': 1774969879.0}
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KF41905') HTTP/1.1" 204 0
2026-03-30 11:27:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25f1c0d5-5afe-5df0-9cc5-b55af08d548d with identifier: DG01155
2026-03-30 11:27:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25f1c0d5-5afe-5df0-9cc5-b55af08d548d with scrape type 1
2026-03-30 11:27:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 25f1c0d5-5afe-5df0-9cc5-b55af08d548d
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffd%252F9ffdbd0afda0eff57e8d0f2022e4f177%252Fpa%252FDG01155_c1b92ef4e3f35495a7508af89efa36ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_c1b92ef4e3f35495a7508af89efa36ce.jpg not downloaded yet
2026-03-30 11:27:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 153955bb-844b-56c3-aaff-a89b04e01171 with identifier: AE25317
2026-03-30 11:27:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 153955bb-844b-56c3-aaff-a89b04e01171 with scrape type 1
2026-03-30 11:27:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 153955bb-844b-56c3-aaff-a89b04e01171
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F75%252Fcd750db5a61e43155143ca36b29c3e6c%252Fpa%252FAE25317_0a975a953585c349c7d804f93d4e6997.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/75/cd750db5a61e43155143ca36b29c3e6c/pa/AE25317_0a975a953585c349c7d804f93d4e6997.jpg already downloaded
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F75%252Fcd750db5a61e43155143ca36b29c3e6c%252Fpa%252FAE25317_bc7c1387491861a635741ffe3e56a234.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/75/cd750db5a61e43155143ca36b29c3e6c/pa/AE25317_bc7c1387491861a635741ffe3e56a234.jpg already downloaded
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F75%252Fcd750db5a61e43155143ca36b29c3e6c%252Fpa%252FAE25317_16c50b6351eb97bd3dc587d55e8f0cb0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/75/cd750db5a61e43155143ca36b29c3e6c/pa/AE25317_16c50b6351eb97bd3dc587d55e8f0cb0.jpg already downloaded
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F75%252Fcd750db5a61e43155143ca36b29c3e6c%252Fpa%252FAE25317_180bfebc9d9c3d1a1bb1039aa02e228f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/75/cd750db5a61e43155143ca36b29c3e6c/pa/AE25317_180bfebc9d9c3d1a1bb1039aa02e228f.jpg already downloaded
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F75%252Fcd750db5a61e43155143ca36b29c3e6c%252Fpa%252FAE25317_ff6522fff608d776e2173c7ce67284a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/75/cd750db5a61e43155143ca36b29c3e6c/pa/AE25317_ff6522fff608d776e2173c7ce67284a0.jpg already downloaded
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F75%252Fcd750db5a61e43155143ca36b29c3e6c%252Fpa%252FAE25317_a1834b8501ddae615ab830ff725a0f26.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/75/cd750db5a61e43155143ca36b29c3e6c/pa/AE25317_a1834b8501ddae615ab830ff725a0f26.jpg already downloaded
2026-03-30 11:27:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 153955bb-844b-56c3-aaff-a89b04e01171, identifier: AE25317
2026-03-30 11:27:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 153955bb-844b-56c3-aaff-a89b04e01171 with identifier: AE25317
2026-03-30 11:27:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 153955bb-844b-56c3-aaff-a89b04e01171 with identifier: AE25317
2026-03-30 11:27:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 153955bb-844b-56c3-aaff-a89b04e01171 with identifier: AE25317 to the API
2026-03-30 11:27:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AE25317>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.0L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:59:21Z',
'fuel_type': 'diesel',
'id': '153955bb-844b-56c3-aaff-a89b04e01171',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE25317',
'listing': 'auction',
'location': 'ES, Barcelona',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 213107,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/imgcd/75/cd750db5a61e43155143ca36b29c3e6c/pa/AE25317_0a975a953585c349c7d804f93d4e6997.jpg',
'https://img-pa.auto1.com/imgcd/75/cd750db5a61e43155143ca36b29c3e6c/pa/AE25317_bc7c1387491861a635741ffe3e56a234.jpg',
'https://img-pa.auto1.com/imgcd/75/cd750db5a61e43155143ca36b29c3e6c/pa/AE25317_16c50b6351eb97bd3dc587d55e8f0cb0.jpg',
'https://img-pa.auto1.com/imgcd/75/cd750db5a61e43155143ca36b29c3e6c/pa/AE25317_180bfebc9d9c3d1a1bb1039aa02e228f.jpg',
'https://img-pa.auto1.com/imgcd/75/cd750db5a61e43155143ca36b29c3e6c/pa/AE25317_ff6522fff608d776e2173c7ce67284a0.jpg',
'https://img-pa.auto1.com/imgcd/75/cd750db5a61e43155143ca36b29c3e6c/pa/AE25317_a1834b8501ddae615ab830ff725a0f26.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_153955bb-844b-56c3-aaff-a89b04e01171/153955bb-844b-56c3-aaff-a89b04e01171_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113489,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/75/cd750db5a61e43155143ca36b29c3e6c/pa/AE25317_0a975a953585c349c7d804f93d4e6997.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_153955bb-844b-56c3-aaff-a89b04e01171/153955bb-844b-56c3-aaff-a89b04e01171_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110923,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/75/cd750db5a61e43155143ca36b29c3e6c/pa/AE25317_bc7c1387491861a635741ffe3e56a234.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_153955bb-844b-56c3-aaff-a89b04e01171/153955bb-844b-56c3-aaff-a89b04e01171_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93072,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/75/cd750db5a61e43155143ca36b29c3e6c/pa/AE25317_16c50b6351eb97bd3dc587d55e8f0cb0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_153955bb-844b-56c3-aaff-a89b04e01171/153955bb-844b-56c3-aaff-a89b04e01171_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95344,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/75/cd750db5a61e43155143ca36b29c3e6c/pa/AE25317_180bfebc9d9c3d1a1bb1039aa02e228f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_153955bb-844b-56c3-aaff-a89b04e01171/153955bb-844b-56c3-aaff-a89b04e01171_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55209,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/75/cd750db5a61e43155143ca36b29c3e6c/pa/AE25317_ff6522fff608d776e2173c7ce67284a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_153955bb-844b-56c3-aaff-a89b04e01171/153955bb-844b-56c3-aaff-a89b04e01171_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90345,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/75/cd750db5a61e43155143ca36b29c3e6c/pa/AE25317_a1834b8501ddae615ab830ff725a0f26.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-04-30',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Edition Plus',
'transmission': 'manual',
'trim': 'Edition Plus',
'year': 2010}
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE25317%27 HTTP/1.1" 200 None
2026-03-30 11:27:33 [auto1.es] INFO: Saving data for AE25317: {'created_time': 1774870053.163095, 'last_price_update_time': 1774870053.163107, 'auction_closing_time': 1774972761.0}
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AE25317') HTTP/1.1" 204 0
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffd%252F9ffdbd0afda0eff57e8d0f2022e4f177%252Fpa%252FDG01155_b9d65bf60d6731758d65a51ce5ebc3d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_b9d65bf60d6731758d65a51ce5ebc3d6.jpg not downloaded yet
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffd%252F9ffdbd0afda0eff57e8d0f2022e4f177%252Fpa%252FDG01155_d2daf0ee96a508def02203f512e4e10f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_d2daf0ee96a508def02203f512e4e10f.jpg not downloaded yet
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffd%252F9ffdbd0afda0eff57e8d0f2022e4f177%252Fpa%252FDG01155_615da8e9db544a496220448ab7b22c89.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_615da8e9db544a496220448ab7b22c89.jpg not downloaded yet
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffd%252F9ffdbd0afda0eff57e8d0f2022e4f177%252Fpa%252FDG01155_27752d8dcb89c44b54640759febd5de2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_27752d8dcb89c44b54640759febd5de2.jpg not downloaded yet
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffd%252F9ffdbd0afda0eff57e8d0f2022e4f177%252Fpa%252FDG01155_348238fa233de6253422c63357ff594e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_348238fa233de6253422c63357ff594e.jpg not downloaded yet
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffd%252F9ffdbd0afda0eff57e8d0f2022e4f177%252Fpa%252FDG01155_7b4e8e9d4954c5fdefca1dc43ad7eaa1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_7b4e8e9d4954c5fdefca1dc43ad7eaa1.jpg not downloaded yet
2026-03-30 11:27:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_b9d65bf60d6731758d65a51ce5ebc3d6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffd%252F9ffdbd0afda0eff57e8d0f2022e4f177%252Fpa%252FDG01155_b57d03f87903fc78bea030e1ae8772d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_b57d03f87903fc78bea030e1ae8772d9.jpg not downloaded yet
2026-03-30 11:27:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_c1b92ef4e3f35495a7508af89efa36ce.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffd%252F9ffdbd0afda0eff57e8d0f2022e4f177%252Fpa%252FDG01155_a5f8eedb346f23275f157b769c9d64b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_a5f8eedb346f23275f157b769c9d64b1.jpg not downloaded yet
2026-03-30 11:27:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_d2daf0ee96a508def02203f512e4e10f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffd%252F9ffdbd0afda0eff57e8d0f2022e4f177%252Fpa%252FDG01155_51c67fa2f121828ac5b3066ce9061aae.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_51c67fa2f121828ac5b3066ce9061aae.jpg not downloaded yet
2026-03-30 11:27:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:27:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3b1e90>
2026-03-30 11:27:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25f1c0d5-5afe-5df0-9cc5-b55af08d548d/25f1c0d5-5afe-5df0-9cc5-b55af08d548d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffd%252F9ffdbd0afda0eff57e8d0f2022e4f177%252Fpa%252FDG01155_b9d65bf60d6731758d65a51ce5ebc3d6.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_b9d65bf60d6731758d65a51ce5ebc3d6.jpg saved to cache
2026-03-30 11:27:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 25f1c0d5-5afe-5df0-9cc5-b55af08d548d
2026-03-30 11:27:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a467d90>
2026-03-30 11:27:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25f1c0d5-5afe-5df0-9cc5-b55af08d548d/25f1c0d5-5afe-5df0-9cc5-b55af08d548d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffd%252F9ffdbd0afda0eff57e8d0f2022e4f177%252Fpa%252FDG01155_c1b92ef4e3f35495a7508af89efa36ce.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_c1b92ef4e3f35495a7508af89efa36ce.jpg saved to cache
2026-03-30 11:27:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 25f1c0d5-5afe-5df0-9cc5-b55af08d548d
2026-03-30 11:27:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc0603fc750>
2026-03-30 11:27:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25f1c0d5-5afe-5df0-9cc5-b55af08d548d/25f1c0d5-5afe-5df0-9cc5-b55af08d548d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffd%252F9ffdbd0afda0eff57e8d0f2022e4f177%252Fpa%252FDG01155_d2daf0ee96a508def02203f512e4e10f.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_d2daf0ee96a508def02203f512e4e10f.jpg saved to cache
2026-03-30 11:27:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 25f1c0d5-5afe-5df0-9cc5-b55af08d548d
2026-03-30 11:27:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_51c67fa2f121828ac5b3066ce9061aae.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_348238fa233de6253422c63357ff594e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_615da8e9db544a496220448ab7b22c89.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_27752d8dcb89c44b54640759febd5de2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_b57d03f87903fc78bea030e1ae8772d9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_a5f8eedb346f23275f157b769c9d64b1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_7b4e8e9d4954c5fdefca1dc43ad7eaa1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a276790>
2026-03-30 11:27:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25f1c0d5-5afe-5df0-9cc5-b55af08d548d/25f1c0d5-5afe-5df0-9cc5-b55af08d548d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffd%252F9ffdbd0afda0eff57e8d0f2022e4f177%252Fpa%252FDG01155_51c67fa2f121828ac5b3066ce9061aae.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_51c67fa2f121828ac5b3066ce9061aae.jpg saved to cache
2026-03-30 11:27:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 25f1c0d5-5afe-5df0-9cc5-b55af08d548d
2026-03-30 11:27:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3d5090>
2026-03-30 11:27:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25f1c0d5-5afe-5df0-9cc5-b55af08d548d/25f1c0d5-5afe-5df0-9cc5-b55af08d548d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffd%252F9ffdbd0afda0eff57e8d0f2022e4f177%252Fpa%252FDG01155_348238fa233de6253422c63357ff594e.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_348238fa233de6253422c63357ff594e.jpg saved to cache
2026-03-30 11:27:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 25f1c0d5-5afe-5df0-9cc5-b55af08d548d
2026-03-30 11:27:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a268290>
2026-03-30 11:27:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25f1c0d5-5afe-5df0-9cc5-b55af08d548d/25f1c0d5-5afe-5df0-9cc5-b55af08d548d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffd%252F9ffdbd0afda0eff57e8d0f2022e4f177%252Fpa%252FDG01155_615da8e9db544a496220448ab7b22c89.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_615da8e9db544a496220448ab7b22c89.jpg saved to cache
2026-03-30 11:27:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 25f1c0d5-5afe-5df0-9cc5-b55af08d548d
2026-03-30 11:27:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc0603f22d0>
2026-03-30 11:27:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25f1c0d5-5afe-5df0-9cc5-b55af08d548d/25f1c0d5-5afe-5df0-9cc5-b55af08d548d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffd%252F9ffdbd0afda0eff57e8d0f2022e4f177%252Fpa%252FDG01155_27752d8dcb89c44b54640759febd5de2.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_27752d8dcb89c44b54640759febd5de2.jpg saved to cache
2026-03-30 11:27:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 25f1c0d5-5afe-5df0-9cc5-b55af08d548d
2026-03-30 11:27:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a4ee0d0>
2026-03-30 11:27:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25f1c0d5-5afe-5df0-9cc5-b55af08d548d/25f1c0d5-5afe-5df0-9cc5-b55af08d548d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:27:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffd%252F9ffdbd0afda0eff57e8d0f2022e4f177%252Fpa%252FDG01155_b57d03f87903fc78bea030e1ae8772d9.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_b57d03f87903fc78bea030e1ae8772d9.jpg saved to cache
2026-03-30 11:27:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 25f1c0d5-5afe-5df0-9cc5-b55af08d548d
2026-03-30 11:27:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060feab50>
2026-03-30 11:27:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25f1c0d5-5afe-5df0-9cc5-b55af08d548d/25f1c0d5-5afe-5df0-9cc5-b55af08d548d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:27:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffd%252F9ffdbd0afda0eff57e8d0f2022e4f177%252Fpa%252FDG01155_a5f8eedb346f23275f157b769c9d64b1.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_a5f8eedb346f23275f157b769c9d64b1.jpg saved to cache
2026-03-30 11:27:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 25f1c0d5-5afe-5df0-9cc5-b55af08d548d
2026-03-30 11:27:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060d04f10>
2026-03-30 11:27:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25f1c0d5-5afe-5df0-9cc5-b55af08d548d/25f1c0d5-5afe-5df0-9cc5-b55af08d548d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:27:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Ffd%252F9ffdbd0afda0eff57e8d0f2022e4f177%252Fpa%252FDG01155_7b4e8e9d4954c5fdefca1dc43ad7eaa1.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_7b4e8e9d4954c5fdefca1dc43ad7eaa1.jpg saved to cache
2026-03-30 11:27:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 25f1c0d5-5afe-5df0-9cc5-b55af08d548d
2026-03-30 11:27:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 25f1c0d5-5afe-5df0-9cc5-b55af08d548d, skipping ID generation
2026-03-30 11:27:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25f1c0d5-5afe-5df0-9cc5-b55af08d548d with scrape type 1
2026-03-30 11:27:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 25f1c0d5-5afe-5df0-9cc5-b55af08d548d sending to next pipeline
2026-03-30 11:27:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 25f1c0d5-5afe-5df0-9cc5-b55af08d548d, identifier: DG01155
2026-03-30 11:27:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 25f1c0d5-5afe-5df0-9cc5-b55af08d548d with identifier: DG01155
2026-03-30 11:27:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 25f1c0d5-5afe-5df0-9cc5-b55af08d548d with identifier: DG01155
2026-03-30 11:27:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 25f1c0d5-5afe-5df0-9cc5-b55af08d548d with identifier: DG01155 to the API
2026-03-30 11:27:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_7b4e8e9d4954c5fdefca1dc43ad7eaa1.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.2L',
'engine_horse_power': 175,
'expiration_date': '2026-03-31T15:36:12Z',
'fuel_type': 'diesel',
'id': '25f1c0d5-5afe-5df0-9cc5-b55af08d548d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG01155',
'listing': 'auction',
'location': 'ES, San Juan de Aznalfarache, Sevilla',
'make': 'Mazda',
'model': '6',
'odometer': 357853,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25f1c0d5-5afe-5df0-9cc5-b55af08d548d/25f1c0d5-5afe-5df0-9cc5-b55af08d548d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107164,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_c1b92ef4e3f35495a7508af89efa36ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25f1c0d5-5afe-5df0-9cc5-b55af08d548d/25f1c0d5-5afe-5df0-9cc5-b55af08d548d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98395,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_b9d65bf60d6731758d65a51ce5ebc3d6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25f1c0d5-5afe-5df0-9cc5-b55af08d548d/25f1c0d5-5afe-5df0-9cc5-b55af08d548d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97168,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_d2daf0ee96a508def02203f512e4e10f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25f1c0d5-5afe-5df0-9cc5-b55af08d548d/25f1c0d5-5afe-5df0-9cc5-b55af08d548d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79085,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_615da8e9db544a496220448ab7b22c89.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25f1c0d5-5afe-5df0-9cc5-b55af08d548d/25f1c0d5-5afe-5df0-9cc5-b55af08d548d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76510,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_27752d8dcb89c44b54640759febd5de2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25f1c0d5-5afe-5df0-9cc5-b55af08d548d/25f1c0d5-5afe-5df0-9cc5-b55af08d548d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82416,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_348238fa233de6253422c63357ff594e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25f1c0d5-5afe-5df0-9cc5-b55af08d548d/25f1c0d5-5afe-5df0-9cc5-b55af08d548d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73250,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_7b4e8e9d4954c5fdefca1dc43ad7eaa1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25f1c0d5-5afe-5df0-9cc5-b55af08d548d/25f1c0d5-5afe-5df0-9cc5-b55af08d548d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92083,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_b57d03f87903fc78bea030e1ae8772d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25f1c0d5-5afe-5df0-9cc5-b55af08d548d/25f1c0d5-5afe-5df0-9cc5-b55af08d548d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97177,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_a5f8eedb346f23275f157b769c9d64b1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25f1c0d5-5afe-5df0-9cc5-b55af08d548d/25f1c0d5-5afe-5df0-9cc5-b55af08d548d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50239,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/fd/9ffdbd0afda0eff57e8d0f2022e4f177/pa/DG01155_51c67fa2f121828ac5b3066ce9061aae.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-05-29',
'seats_number': 5,
'seller_name': None,
'title': 'Mazda 6 2.2 Turbodiesel Luxury',
'transmission': 'manual',
'trim': 'Luxury',
'year': 2016}
2026-03-30 11:27:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DG01155%27 HTTP/1.1" 200 None
2026-03-30 11:27:34 [auto1.es] INFO: Saving data for DG01155: {'created_time': 1774870054.663513, 'last_price_update_time': 1774870054.663524, 'auction_closing_time': 1774971372.0}
2026-03-30 11:27:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DG01155') HTTP/1.1" 204 0
2026-03-30 11:27:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LP52549> (referer: https://www.auto1.com/v1/car-details-view/LP52549/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29d3b313-a386-579a-a400-05f840dc62cc with identifier: LP52549
2026-03-30 11:27:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29d3b313-a386-579a-a400-05f840dc62cc with scrape type 1
2026-03-30 11:27:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 29d3b313-a386-579a-a400-05f840dc62cc
2026-03-30 11:27:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc2%252F7ac20427885cfce0e8f5fa0cf74d3be7%252Fpa%252FLP52549_2be8aae5fd1a7feb84f5262c3bad43bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_2be8aae5fd1a7feb84f5262c3bad43bf.jpg not downloaded yet
2026-03-30 11:27:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc2%252F7ac20427885cfce0e8f5fa0cf74d3be7%252Fpa%252FLP52549_d3ccf5a65a671338076665a2fcb01cb8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_d3ccf5a65a671338076665a2fcb01cb8.jpg not downloaded yet
2026-03-30 11:27:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc2%252F7ac20427885cfce0e8f5fa0cf74d3be7%252Fpa%252FLP52549_c7b9ad8cee70a70cf10898055db744be.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_c7b9ad8cee70a70cf10898055db744be.jpg not downloaded yet
2026-03-30 11:27:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc2%252F7ac20427885cfce0e8f5fa0cf74d3be7%252Fpa%252FLP52549_818b09aa835f1e61afb0ae63288146da.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_818b09aa835f1e61afb0ae63288146da.jpg not downloaded yet
2026-03-30 11:27:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc2%252F7ac20427885cfce0e8f5fa0cf74d3be7%252Fpa%252FLP52549_9fcca094d223cada5f933dd3b343279b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_9fcca094d223cada5f933dd3b343279b.jpg not downloaded yet
2026-03-30 11:27:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_d3ccf5a65a671338076665a2fcb01cb8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_2be8aae5fd1a7feb84f5262c3bad43bf.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc2%252F7ac20427885cfce0e8f5fa0cf74d3be7%252Fpa%252FLP52549_0f5e211271b3ba69bb1b9f81533927ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_0f5e211271b3ba69bb1b9f81533927ec.jpg not downloaded yet
2026-03-30 11:27:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc2%252F7ac20427885cfce0e8f5fa0cf74d3be7%252Fpa%252FLP52549_f0fb6f2c56b4988d46b3f756c6b6f844.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_f0fb6f2c56b4988d46b3f756c6b6f844.jpg not downloaded yet
2026-03-30 11:27:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc2%252F7ac20427885cfce0e8f5fa0cf74d3be7%252Fpa%252FLP52549_18201f958003d310ec7011c5ffeeedcd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_18201f958003d310ec7011c5ffeeedcd.jpg not downloaded yet
2026-03-30 11:27:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc2%252F7ac20427885cfce0e8f5fa0cf74d3be7%252Fpa%252FLP52549_8deff79013b427bc66ea27f8948d1b3c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_8deff79013b427bc66ea27f8948d1b3c.jpg not downloaded yet
2026-03-30 11:27:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc2%252F7ac20427885cfce0e8f5fa0cf74d3be7%252Fpa%252FLP52549_81442dd36d859db17f13e813af7541fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_81442dd36d859db17f13e813af7541fe.jpg not downloaded yet
2026-03-30 11:27:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc060ff4110>
2026-03-30 11:27:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29d3b313-a386-579a-a400-05f840dc62cc/29d3b313-a386-579a-a400-05f840dc62cc_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:27:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc2%252F7ac20427885cfce0e8f5fa0cf74d3be7%252Fpa%252FLP52549_d3ccf5a65a671338076665a2fcb01cb8.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_d3ccf5a65a671338076665a2fcb01cb8.jpg saved to cache
2026-03-30 11:27:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 29d3b313-a386-579a-a400-05f840dc62cc
2026-03-30 11:27:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ae77290>
2026-03-30 11:27:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29d3b313-a386-579a-a400-05f840dc62cc/29d3b313-a386-579a-a400-05f840dc62cc_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:27:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc2%252F7ac20427885cfce0e8f5fa0cf74d3be7%252Fpa%252FLP52549_2be8aae5fd1a7feb84f5262c3bad43bf.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_2be8aae5fd1a7feb84f5262c3bad43bf.jpg saved to cache
2026-03-30 11:27:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 29d3b313-a386-579a-a400-05f840dc62cc
2026-03-30 11:27:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_f0fb6f2c56b4988d46b3f756c6b6f844.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_818b09aa835f1e61afb0ae63288146da.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_8deff79013b427bc66ea27f8948d1b3c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_c7b9ad8cee70a70cf10898055db744be.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_18201f958003d310ec7011c5ffeeedcd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_9fcca094d223cada5f933dd3b343279b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_81442dd36d859db17f13e813af7541fe.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_0f5e211271b3ba69bb1b9f81533927ec.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a460f50>
2026-03-30 11:27:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29d3b313-a386-579a-a400-05f840dc62cc/29d3b313-a386-579a-a400-05f840dc62cc_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc2%252F7ac20427885cfce0e8f5fa0cf74d3be7%252Fpa%252FLP52549_f0fb6f2c56b4988d46b3f756c6b6f844.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_f0fb6f2c56b4988d46b3f756c6b6f844.jpg saved to cache
2026-03-30 11:27:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 29d3b313-a386-579a-a400-05f840dc62cc
2026-03-30 11:27:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05aebbb10>
2026-03-30 11:27:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29d3b313-a386-579a-a400-05f840dc62cc/29d3b313-a386-579a-a400-05f840dc62cc_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc2%252F7ac20427885cfce0e8f5fa0cf74d3be7%252Fpa%252FLP52549_818b09aa835f1e61afb0ae63288146da.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_818b09aa835f1e61afb0ae63288146da.jpg saved to cache
2026-03-30 11:27:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 29d3b313-a386-579a-a400-05f840dc62cc
2026-03-30 11:27:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ae7ec50>
2026-03-30 11:27:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29d3b313-a386-579a-a400-05f840dc62cc/29d3b313-a386-579a-a400-05f840dc62cc_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc2%252F7ac20427885cfce0e8f5fa0cf74d3be7%252Fpa%252FLP52549_8deff79013b427bc66ea27f8948d1b3c.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_8deff79013b427bc66ea27f8948d1b3c.jpg saved to cache
2026-03-30 11:27:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 29d3b313-a386-579a-a400-05f840dc62cc
2026-03-30 11:27:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ad2cb90>
2026-03-30 11:27:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29d3b313-a386-579a-a400-05f840dc62cc/29d3b313-a386-579a-a400-05f840dc62cc_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc2%252F7ac20427885cfce0e8f5fa0cf74d3be7%252Fpa%252FLP52549_c7b9ad8cee70a70cf10898055db744be.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_c7b9ad8cee70a70cf10898055db744be.jpg saved to cache
2026-03-30 11:27:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 29d3b313-a386-579a-a400-05f840dc62cc
2026-03-30 11:27:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a49fc10>
2026-03-30 11:27:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29d3b313-a386-579a-a400-05f840dc62cc/29d3b313-a386-579a-a400-05f840dc62cc_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc2%252F7ac20427885cfce0e8f5fa0cf74d3be7%252Fpa%252FLP52549_18201f958003d310ec7011c5ffeeedcd.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_18201f958003d310ec7011c5ffeeedcd.jpg saved to cache
2026-03-30 11:27:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 29d3b313-a386-579a-a400-05f840dc62cc
2026-03-30 11:27:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3b06d0>
2026-03-30 11:27:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29d3b313-a386-579a-a400-05f840dc62cc/29d3b313-a386-579a-a400-05f840dc62cc_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc2%252F7ac20427885cfce0e8f5fa0cf74d3be7%252Fpa%252FLP52549_9fcca094d223cada5f933dd3b343279b.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_9fcca094d223cada5f933dd3b343279b.jpg saved to cache
2026-03-30 11:27:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 29d3b313-a386-579a-a400-05f840dc62cc
2026-03-30 11:27:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a264450>
2026-03-30 11:27:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29d3b313-a386-579a-a400-05f840dc62cc/29d3b313-a386-579a-a400-05f840dc62cc_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc2%252F7ac20427885cfce0e8f5fa0cf74d3be7%252Fpa%252FLP52549_81442dd36d859db17f13e813af7541fe.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_81442dd36d859db17f13e813af7541fe.jpg saved to cache
2026-03-30 11:27:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 29d3b313-a386-579a-a400-05f840dc62cc
2026-03-30 11:27:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3b1e90>
2026-03-30 11:27:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29d3b313-a386-579a-a400-05f840dc62cc/29d3b313-a386-579a-a400-05f840dc62cc_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fc2%252F7ac20427885cfce0e8f5fa0cf74d3be7%252Fpa%252FLP52549_0f5e211271b3ba69bb1b9f81533927ec.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_0f5e211271b3ba69bb1b9f81533927ec.jpg saved to cache
2026-03-30 11:27:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 29d3b313-a386-579a-a400-05f840dc62cc
2026-03-30 11:27:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 29d3b313-a386-579a-a400-05f840dc62cc, skipping ID generation
2026-03-30 11:27:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29d3b313-a386-579a-a400-05f840dc62cc with scrape type 1
2026-03-30 11:27:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 29d3b313-a386-579a-a400-05f840dc62cc sending to next pipeline
2026-03-30 11:27:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 29d3b313-a386-579a-a400-05f840dc62cc, identifier: LP52549
2026-03-30 11:27:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 29d3b313-a386-579a-a400-05f840dc62cc with identifier: LP52549
2026-03-30 11:27:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 29d3b313-a386-579a-a400-05f840dc62cc with identifier: LP52549
2026-03-30 11:27:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 29d3b313-a386-579a-a400-05f840dc62cc with identifier: LP52549 to the API
2026-03-30 11:27:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_0f5e211271b3ba69bb1b9f81533927ec.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:00:36Z',
'fuel_type': 'diesel',
'id': '29d3b313-a386-579a-a400-05f840dc62cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP52549',
'listing': 'auction',
'location': 'ES, Tarragona',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 247012,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d3b313-a386-579a-a400-05f840dc62cc/29d3b313-a386-579a-a400-05f840dc62cc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78992,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_2be8aae5fd1a7feb84f5262c3bad43bf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d3b313-a386-579a-a400-05f840dc62cc/29d3b313-a386-579a-a400-05f840dc62cc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63218,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_d3ccf5a65a671338076665a2fcb01cb8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d3b313-a386-579a-a400-05f840dc62cc/29d3b313-a386-579a-a400-05f840dc62cc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85013,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_c7b9ad8cee70a70cf10898055db744be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d3b313-a386-579a-a400-05f840dc62cc/29d3b313-a386-579a-a400-05f840dc62cc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64356,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_818b09aa835f1e61afb0ae63288146da.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d3b313-a386-579a-a400-05f840dc62cc/29d3b313-a386-579a-a400-05f840dc62cc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74472,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_9fcca094d223cada5f933dd3b343279b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d3b313-a386-579a-a400-05f840dc62cc/29d3b313-a386-579a-a400-05f840dc62cc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82979,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_0f5e211271b3ba69bb1b9f81533927ec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d3b313-a386-579a-a400-05f840dc62cc/29d3b313-a386-579a-a400-05f840dc62cc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63238,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_f0fb6f2c56b4988d46b3f756c6b6f844.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d3b313-a386-579a-a400-05f840dc62cc/29d3b313-a386-579a-a400-05f840dc62cc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79305,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_18201f958003d310ec7011c5ffeeedcd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d3b313-a386-579a-a400-05f840dc62cc/29d3b313-a386-579a-a400-05f840dc62cc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72079,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_8deff79013b427bc66ea27f8948d1b3c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d3b313-a386-579a-a400-05f840dc62cc/29d3b313-a386-579a-a400-05f840dc62cc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77761,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/c2/7ac20427885cfce0e8f5fa0cf74d3be7/pa/LP52549_81442dd36d859db17f13e813af7541fe.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-01-17',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI 4Motion',
'transmission': 'automatic',
'trim': '4Motion',
'year': 2010}
2026-03-30 11:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LP52549%27 HTTP/1.1" 200 None
2026-03-30 11:27:36 [auto1.es] INFO: Saving data for LP52549: {'created_time': 1774870056.825895, 'last_price_update_time': 1774870056.825907, 'auction_closing_time': 1774969236.0}
2026-03-30 11:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LP52549') HTTP/1.1" 204 0
2026-03-30 11:27:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:42 [auto1.es] INFO: Channel: 24h | Page: 14 | totalHits: 2237 | hits on page: 40
2026-03-30 11:27:42 [auto1.es] INFO: Found listing with ID: XX78085
2026-03-30 11:27:42 [auto1.es] INFO: Found listing with ID: AP25949
2026-03-30 11:27:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AP25949%27 HTTP/1.1" 200 None
2026-03-30 11:27:42 [auto1.es] INFO: Scrape type for AP25949: 0
2026-03-30 11:27:42 [auto1.es] INFO: Found listing with ID: WV86168
2026-03-30 11:27:42 [auto1.es] INFO: Found listing with ID: BF01756
2026-03-30 11:27:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF01756%27 HTTP/1.1" 200 None
2026-03-30 11:27:42 [auto1.es] INFO: Scrape type for BF01756: 0
2026-03-30 11:27:42 [auto1.es] INFO: Found listing with ID: MY64125
2026-03-30 11:27:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MY64125%27 HTTP/1.1" 200 None
2026-03-30 11:27:42 [auto1.es] INFO: Scrape type for MY64125: 0
2026-03-30 11:27:42 [auto1.es] INFO: Found listing with ID: KP50640
2026-03-30 11:27:42 [auto1.es] INFO: Found listing with ID: WR94987
2026-03-30 11:27:42 [auto1.es] INFO: Found listing with ID: AV80298
2026-03-30 11:27:42 [auto1.es] INFO: Found listing with ID: HW71789
2026-03-30 11:27:42 [auto1.es] INFO: Found listing with ID: SC66247
2026-03-30 11:27:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SC66247%27 HTTP/1.1" 200 None
2026-03-30 11:27:42 [auto1.es] INFO: Scrape type for SC66247: 0
2026-03-30 11:27:42 [auto1.es] INFO: Found listing with ID: FG51952
2026-03-30 11:27:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG51952%27 HTTP/1.1" 200 None
2026-03-30 11:27:42 [auto1.es] INFO: Scrape type for FG51952: 0
2026-03-30 11:27:42 [auto1.es] INFO: Found listing with ID: AY69334
2026-03-30 11:27:42 [auto1.es] INFO: Found listing with ID: VX31855
2026-03-30 11:27:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VX31855%27 HTTP/1.1" 200 None
2026-03-30 11:27:42 [auto1.es] INFO: Scrape type for VX31855: 0
2026-03-30 11:27:42 [auto1.es] INFO: Found listing with ID: HW63971
2026-03-30 11:27:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HW63971%27 HTTP/1.1" 200 None
2026-03-30 11:27:42 [auto1.es] INFO: Scrape type for HW63971: 0
2026-03-30 11:27:42 [auto1.es] INFO: Found listing with ID: CB77885
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CB77885%27 HTTP/1.1" 200 None
2026-03-30 11:27:43 [auto1.es] INFO: Scrape type for CB77885: 0
2026-03-30 11:27:43 [auto1.es] INFO: Found listing with ID: DT19492
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DT19492%27 HTTP/1.1" 200 None
2026-03-30 11:27:43 [auto1.es] INFO: Scrape type for DT19492: 0
2026-03-30 11:27:43 [auto1.es] INFO: Found listing with ID: FB21971
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FB21971%27 HTTP/1.1" 200 None
2026-03-30 11:27:43 [auto1.es] INFO: Scrape type for FB21971: 0
2026-03-30 11:27:43 [auto1.es] INFO: Found listing with ID: SW49334
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW49334%27 HTTP/1.1" 200 None
2026-03-30 11:27:43 [auto1.es] INFO: Scrape type for SW49334: 0
2026-03-30 11:27:43 [auto1.es] INFO: Found listing with ID: EZ15319
2026-03-30 11:27:43 [auto1.es] INFO: Found listing with ID: JF96117
2026-03-30 11:27:43 [auto1.es] INFO: Found listing with ID: LH19294
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LH19294%27 HTTP/1.1" 200 None
2026-03-30 11:27:43 [auto1.es] INFO: Scrape type for LH19294: 0
2026-03-30 11:27:43 [auto1.es] INFO: Found listing with ID: TR96554
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TR96554%27 HTTP/1.1" 200 None
2026-03-30 11:27:43 [auto1.es] INFO: Scrape type for TR96554: 0
2026-03-30 11:27:43 [auto1.es] INFO: Found listing with ID: TB43728
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB43728%27 HTTP/1.1" 200 None
2026-03-30 11:27:43 [auto1.es] INFO: Scrape type for TB43728: 0
2026-03-30 11:27:43 [auto1.es] INFO: Found listing with ID: GY72881
2026-03-30 11:27:43 [auto1.es] INFO: Found listing with ID: WZ04978
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ04978%27 HTTP/1.1" 200 None
2026-03-30 11:27:43 [auto1.es] INFO: Scrape type for WZ04978: 0
2026-03-30 11:27:43 [auto1.es] INFO: Found listing with ID: JP85888
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JP85888%27 HTTP/1.1" 200 None
2026-03-30 11:27:43 [auto1.es] INFO: Scrape type for JP85888: 0
2026-03-30 11:27:43 [auto1.es] INFO: Found listing with ID: VS82741
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VS82741%27 HTTP/1.1" 200 None
2026-03-30 11:27:43 [auto1.es] INFO: Scrape type for VS82741: 0
2026-03-30 11:27:43 [auto1.es] INFO: Found listing with ID: DZ12321
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DZ12321%27 HTTP/1.1" 200 None
2026-03-30 11:27:43 [auto1.es] INFO: Scrape type for DZ12321: 0
2026-03-30 11:27:43 [auto1.es] INFO: Found listing with ID: GT09019
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT09019%27 HTTP/1.1" 200 None
2026-03-30 11:27:43 [auto1.es] INFO: Scrape type for GT09019: 0
2026-03-30 11:27:43 [auto1.es] INFO: Found listing with ID: JH64240
2026-03-30 11:27:43 [auto1.es] INFO: Found listing with ID: XP46795
2026-03-30 11:27:43 [auto1.es] INFO: Found listing with ID: RL76875
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RL76875%27 HTTP/1.1" 200 None
2026-03-30 11:27:43 [auto1.es] INFO: Scrape type for RL76875: 0
2026-03-30 11:27:43 [auto1.es] INFO: Found listing with ID: DL26730
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL26730%27 HTTP/1.1" 200 None
2026-03-30 11:27:43 [auto1.es] INFO: Scrape type for DL26730: 0
2026-03-30 11:27:43 [auto1.es] INFO: Found listing with ID: EZ05250
2026-03-30 11:27:43 [auto1.es] INFO: Found listing with ID: KV39877
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KV39877%27 HTTP/1.1" 200 None
2026-03-30 11:27:43 [auto1.es] INFO: Scrape type for KV39877: 0
2026-03-30 11:27:43 [auto1.es] INFO: Found listing with ID: LZ54087
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LZ54087%27 HTTP/1.1" 200 None
2026-03-30 11:27:43 [auto1.es] INFO: Scrape type for LZ54087: 0
2026-03-30 11:27:43 [auto1.es] INFO: Found listing with ID: KJ86287
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KJ86287%27 HTTP/1.1" 200 None
2026-03-30 11:27:43 [auto1.es] INFO: Scrape type for KJ86287: 0
2026-03-30 11:27:43 [auto1.es] INFO: Found listing with ID: RR39906
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RR39906%27 HTTP/1.1" 200 None
2026-03-30 11:27:43 [auto1.es] INFO: Scrape type for RR39906: 0
2026-03-30 11:27:43 [auto1.es] INFO: Found listing with ID: PA95147
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PA95147%27 HTTP/1.1" 200 None
2026-03-30 11:27:43 [auto1.es] INFO: Scrape type for PA95147: 0
2026-03-30 11:27:43 [auto1.es] INFO: Found listing with ID: LJ17075
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LJ17075%27 HTTP/1.1" 200 None
2026-03-30 11:27:43 [auto1.es] INFO: Scrape type for LJ17075: 0
2026-03-30 11:27:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:47 [auto1.es] INFO: Channel: 24h | Page: 15 | totalHits: 2237 | hits on page: 40
2026-03-30 11:27:47 [auto1.es] INFO: Found listing with ID: KY65056
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KY65056%27 HTTP/1.1" 200 None
2026-03-30 11:27:47 [auto1.es] INFO: Scrape type for KY65056: 0
2026-03-30 11:27:47 [auto1.es] INFO: Found listing with ID: AX32587
2026-03-30 11:27:47 [auto1.es] INFO: Found listing with ID: XB50501
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XB50501%27 HTTP/1.1" 200 None
2026-03-30 11:27:47 [auto1.es] INFO: Scrape type for XB50501: 0
2026-03-30 11:27:47 [auto1.es] INFO: Found listing with ID: PP33108
2026-03-30 11:27:47 [auto1.es] INFO: Found listing with ID: KK89963
2026-03-30 11:27:47 [auto1.es] INFO: Found listing with ID: KA39853
2026-03-30 11:27:47 [auto1.es] INFO: Found listing with ID: GJ09914
2026-03-30 11:27:47 [auto1.es] INFO: Found listing with ID: XU70286
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XU70286%27 HTTP/1.1" 200 None
2026-03-30 11:27:47 [auto1.es] INFO: Scrape type for XU70286: 0
2026-03-30 11:27:47 [auto1.es] INFO: Found listing with ID: JK50290
2026-03-30 11:27:47 [auto1.es] INFO: Found listing with ID: PU11377
2026-03-30 11:27:47 [auto1.es] INFO: Found listing with ID: BL04336
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BL04336%27 HTTP/1.1" 200 None
2026-03-30 11:27:47 [auto1.es] INFO: Scrape type for BL04336: 0
2026-03-30 11:27:47 [auto1.es] INFO: Found listing with ID: AK94783
2026-03-30 11:27:47 [auto1.es] INFO: Found listing with ID: JE94628
2026-03-30 11:27:47 [auto1.es] INFO: Found listing with ID: AA87480
2026-03-30 11:27:47 [auto1.es] INFO: Found listing with ID: WX28872
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WX28872%27 HTTP/1.1" 200 None
2026-03-30 11:27:47 [auto1.es] INFO: Scrape type for WX28872: 0
2026-03-30 11:27:47 [auto1.es] INFO: Found listing with ID: XY28790
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XY28790%27 HTTP/1.1" 200 None
2026-03-30 11:27:47 [auto1.es] INFO: Scrape type for XY28790: 0
2026-03-30 11:27:47 [auto1.es] INFO: Found listing with ID: AM26013
2026-03-30 11:27:47 [auto1.es] INFO: Found listing with ID: KZ85451
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KZ85451%27 HTTP/1.1" 200 None
2026-03-30 11:27:47 [auto1.es] INFO: Scrape type for KZ85451: 0
2026-03-30 11:27:47 [auto1.es] INFO: Found listing with ID: GS56941
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GS56941%27 HTTP/1.1" 200 None
2026-03-30 11:27:47 [auto1.es] INFO: Scrape type for GS56941: 0
2026-03-30 11:27:47 [auto1.es] INFO: Found listing with ID: PY75360
2026-03-30 11:27:47 [auto1.es] INFO: Found listing with ID: JG42425
2026-03-30 11:27:47 [auto1.es] INFO: Found listing with ID: GG87670
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GG87670%27 HTTP/1.1" 200 None
2026-03-30 11:27:47 [auto1.es] INFO: Scrape type for GG87670: 0
2026-03-30 11:27:47 [auto1.es] INFO: Found listing with ID: GV33472
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GV33472%27 HTTP/1.1" 200 None
2026-03-30 11:27:47 [auto1.es] INFO: Scrape type for GV33472: 0
2026-03-30 11:27:47 [auto1.es] INFO: Found listing with ID: PZ69063
2026-03-30 11:27:47 [auto1.es] INFO: Found listing with ID: JR66808
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JR66808%27 HTTP/1.1" 200 None
2026-03-30 11:27:47 [auto1.es] INFO: Scrape type for JR66808: 0
2026-03-30 11:27:47 [auto1.es] INFO: Found listing with ID: ZZ58056
2026-03-30 11:27:47 [auto1.es] INFO: Found listing with ID: GB45080
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GB45080%27 HTTP/1.1" 200 None
2026-03-30 11:27:47 [auto1.es] INFO: Scrape type for GB45080: 0
2026-03-30 11:27:47 [auto1.es] INFO: Found listing with ID: DB65151
2026-03-30 11:27:47 [auto1.es] INFO: Found listing with ID: TV66398
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV66398%27 HTTP/1.1" 200 None
2026-03-30 11:27:47 [auto1.es] INFO: Scrape type for TV66398: 0
2026-03-30 11:27:47 [auto1.es] INFO: Found listing with ID: PS72870
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS72870%27 HTTP/1.1" 200 None
2026-03-30 11:27:47 [auto1.es] INFO: Scrape type for PS72870: 0
2026-03-30 11:27:47 [auto1.es] INFO: Found listing with ID: KD33160
2026-03-30 11:27:47 [auto1.es] INFO: Found listing with ID: CT93709
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CT93709%27 HTTP/1.1" 200 None
2026-03-30 11:27:47 [auto1.es] INFO: Scrape type for CT93709: 0
2026-03-30 11:27:47 [auto1.es] INFO: Found listing with ID: WZ18115
2026-03-30 11:27:47 [auto1.es] INFO: Found listing with ID: YT69856
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YT69856%27 HTTP/1.1" 200 None
2026-03-30 11:27:47 [auto1.es] INFO: Scrape type for YT69856: 0
2026-03-30 11:27:47 [auto1.es] INFO: Found listing with ID: AJ10793
2026-03-30 11:27:47 [auto1.es] INFO: Found listing with ID: TR51915
2026-03-30 11:27:47 [auto1.es] INFO: Found listing with ID: UP08407
2026-03-30 11:27:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UP08407%27 HTTP/1.1" 200 None
2026-03-30 11:27:48 [auto1.es] INFO: Scrape type for UP08407: 0
2026-03-30 11:27:48 [auto1.es] INFO: Found listing with ID: XD33524
2026-03-30 11:27:48 [auto1.es] INFO: Found listing with ID: ZT32060
2026-03-30 11:27:48 [auto1.es] INFO: Found listing with ID: US86710
2026-03-30 11:27:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:55 [auto1.es] INFO: Channel: 24h | Page: 16 | totalHits: 2238 | hits on page: 40
2026-03-30 11:27:55 [auto1.es] INFO: Found listing with ID: US86710
2026-03-30 11:27:55 [auto1.es] INFO: Found listing with ID: ZC64439
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC64439%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.es] INFO: Scrape type for ZC64439: 0
2026-03-30 11:27:55 [auto1.es] INFO: Found listing with ID: XS01276
2026-03-30 11:27:55 [auto1.es] INFO: Found listing with ID: KX39687
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KX39687%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.es] INFO: Scrape type for KX39687: 0
2026-03-30 11:27:55 [auto1.es] INFO: Found listing with ID: ZD82589
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD82589%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.es] INFO: Scrape type for ZD82589: 0
2026-03-30 11:27:55 [auto1.es] INFO: Found listing with ID: GU11449
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU11449%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.es] INFO: Scrape type for GU11449: 0
2026-03-30 11:27:55 [auto1.es] INFO: Found listing with ID: ET53098
2026-03-30 11:27:55 [auto1.es] INFO: Found listing with ID: AE81876
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE81876%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.es] INFO: Scrape type for AE81876: 0
2026-03-30 11:27:55 [auto1.es] INFO: Found listing with ID: XN19340
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XN19340%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.es] INFO: Scrape type for XN19340: 0
2026-03-30 11:27:55 [auto1.es] INFO: Found listing with ID: YM13898
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YM13898%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.es] INFO: Scrape type for YM13898: 0
2026-03-30 11:27:55 [auto1.es] INFO: Found listing with ID: NR52566
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NR52566%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.es] INFO: Scrape type for NR52566: 0
2026-03-30 11:27:55 [auto1.es] INFO: Found listing with ID: BE54244
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE54244%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.es] INFO: Scrape type for BE54244: 0
2026-03-30 11:27:55 [auto1.es] INFO: Found listing with ID: XC34643
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC34643%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.es] INFO: Scrape type for XC34643: 0
2026-03-30 11:27:55 [auto1.es] INFO: Found listing with ID: TC87542
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TC87542%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.es] INFO: Scrape type for TC87542: 0
2026-03-30 11:27:55 [auto1.es] INFO: Found listing with ID: WU38219
2026-03-30 11:27:55 [auto1.es] INFO: Found listing with ID: XB87201
2026-03-30 11:27:55 [auto1.es] INFO: Found listing with ID: HV65502
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HV65502%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.es] INFO: Scrape type for HV65502: 0
2026-03-30 11:27:55 [auto1.es] INFO: Found listing with ID: LE33983
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LE33983%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.es] INFO: Scrape type for LE33983: 0
2026-03-30 11:27:55 [auto1.es] INFO: Found listing with ID: UU02684
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UU02684%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.es] INFO: Scrape type for UU02684: 0
2026-03-30 11:27:55 [auto1.es] INFO: Found listing with ID: FG09703
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG09703%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.es] INFO: Scrape type for FG09703: 0
2026-03-30 11:27:55 [auto1.es] INFO: Found listing with ID: FX85730
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX85730%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.es] INFO: Scrape type for FX85730: 0
2026-03-30 11:27:55 [auto1.es] INFO: Found listing with ID: MK12831
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MK12831%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.es] INFO: Scrape type for MK12831: 0
2026-03-30 11:27:55 [auto1.es] INFO: Found listing with ID: XH30785
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH30785%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.es] INFO: Scrape type for XH30785: 0
2026-03-30 11:27:55 [auto1.es] INFO: Found listing with ID: ZM48966
2026-03-30 11:27:55 [auto1.es] INFO: Found listing with ID: TA62942
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TA62942%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.es] INFO: Scrape type for TA62942: 0
2026-03-30 11:27:55 [auto1.es] INFO: Found listing with ID: VY65813
2026-03-30 11:27:55 [auto1.es] INFO: Found listing with ID: SK09082
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SK09082%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.es] INFO: Scrape type for SK09082: 0
2026-03-30 11:27:55 [auto1.es] INFO: Found listing with ID: MJ10048
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MJ10048%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.es] INFO: Scrape type for MJ10048: 0
2026-03-30 11:27:55 [auto1.es] INFO: Found listing with ID: MC76243
2026-03-30 11:27:55 [auto1.es] INFO: Found listing with ID: FJ90358
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FJ90358%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.es] INFO: Scrape type for FJ90358: 0
2026-03-30 11:27:55 [auto1.es] INFO: Found listing with ID: DN61356
2026-03-30 11:27:55 [auto1.es] INFO: Found listing with ID: GF58352
2026-03-30 11:27:55 [auto1.es] INFO: Found listing with ID: RS73329
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RS73329%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.es] INFO: Scrape type for RS73329: 0
2026-03-30 11:27:55 [auto1.es] INFO: Found listing with ID: JL56851
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JL56851%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.es] INFO: Scrape type for JL56851: 0
2026-03-30 11:27:55 [auto1.es] INFO: Found listing with ID: DW89580
2026-03-30 11:27:55 [auto1.es] INFO: Found listing with ID: VL94048
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL94048%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.es] INFO: Scrape type for VL94048: 0
2026-03-30 11:27:55 [auto1.es] INFO: Found listing with ID: LU76914
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LU76914%27 HTTP/1.1" 200 None
2026-03-30 11:27:55 [auto1.es] INFO: Scrape type for LU76914: 0
2026-03-30 11:27:55 [auto1.es] INFO: Found listing with ID: AA17148
2026-03-30 11:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AA17148%27 HTTP/1.1" 200 None
2026-03-30 11:27:56 [auto1.es] INFO: Scrape type for AA17148: 0
2026-03-30 11:27:56 [auto1.es] INFO: Found listing with ID: YH68644
2026-03-30 11:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH68644%27 HTTP/1.1" 200 None
2026-03-30 11:27:56 [auto1.es] INFO: Scrape type for YH68644: 0
2026-03-30 11:27:56 [auto1.es] INFO: Found listing with ID: UR10895
2026-03-30 11:27:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:57 [auto1.es] INFO: Channel: 24h | Page: 17 | totalHits: 2238 | hits on page: 40
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: XZ34869
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: ZL13799
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: PR87201
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PR87201%27 HTTP/1.1" 200 None
2026-03-30 11:27:57 [auto1.es] INFO: Scrape type for PR87201: 0
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: MJ09800
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MJ09800%27 HTTP/1.1" 200 None
2026-03-30 11:27:57 [auto1.es] INFO: Scrape type for MJ09800: 0
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: JL97970
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JL97970%27 HTTP/1.1" 200 None
2026-03-30 11:27:57 [auto1.es] INFO: Scrape type for JL97970: 0
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: TM82806
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: NE32180
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NE32180%27 HTTP/1.1" 200 None
2026-03-30 11:27:57 [auto1.es] INFO: Scrape type for NE32180: 0
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: PX21457
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: NC38071
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: KB34619
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KB34619%27 HTTP/1.1" 200 None
2026-03-30 11:27:57 [auto1.es] INFO: Scrape type for KB34619: 0
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: MY97846
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MY97846%27 HTTP/1.1" 200 None
2026-03-30 11:27:57 [auto1.es] INFO: Scrape type for MY97846: 0
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: EV84602
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EV84602%27 HTTP/1.1" 200 None
2026-03-30 11:27:57 [auto1.es] INFO: Scrape type for EV84602: 0
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: HG89264
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: NV08430
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: CG22215
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CG22215%27 HTTP/1.1" 200 None
2026-03-30 11:27:57 [auto1.es] INFO: Scrape type for CG22215: 0
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: EF44253
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EF44253%27 HTTP/1.1" 200 None
2026-03-30 11:27:57 [auto1.es] INFO: Scrape type for EF44253: 0
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: AE58330
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE58330%27 HTTP/1.1" 200 None
2026-03-30 11:27:57 [auto1.es] INFO: Scrape type for AE58330: 0
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: CA16323
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CA16323%27 HTTP/1.1" 200 None
2026-03-30 11:27:57 [auto1.es] INFO: Scrape type for CA16323: 0
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: PY76001
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PY76001%27 HTTP/1.1" 200 None
2026-03-30 11:27:57 [auto1.es] INFO: Scrape type for PY76001: 0
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: YS16436
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YS16436%27 HTTP/1.1" 200 None
2026-03-30 11:27:57 [auto1.es] INFO: Scrape type for YS16436: 0
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: GD38057
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GD38057%27 HTTP/1.1" 200 None
2026-03-30 11:27:57 [auto1.es] INFO: Scrape type for GD38057: 0
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: XM10177
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: JW81079
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: KT28761
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KT28761%27 HTTP/1.1" 200 None
2026-03-30 11:27:57 [auto1.es] INFO: Scrape type for KT28761: 0
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: EJ87348
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: MG81187
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: BB78010
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BB78010%27 HTTP/1.1" 200 None
2026-03-30 11:27:57 [auto1.es] INFO: Scrape type for BB78010: 0
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: ZL69555
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL69555%27 HTTP/1.1" 200 None
2026-03-30 11:27:57 [auto1.es] INFO: Scrape type for ZL69555: 0
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: JY39879
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JY39879%27 HTTP/1.1" 200 None
2026-03-30 11:27:57 [auto1.es] INFO: Scrape type for JY39879: 0
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: HX96572
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: SS95298
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: CK47947
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: DS79816
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DS79816%27 HTTP/1.1" 200 None
2026-03-30 11:27:57 [auto1.es] INFO: Scrape type for DS79816: 0
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: TU44986
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: CG34681
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: RC36042
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: VC11143
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: YZ39389
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YZ39389%27 HTTP/1.1" 200 None
2026-03-30 11:27:57 [auto1.es] INFO: Scrape type for YZ39389: 0
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: YH22245
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH22245%27 HTTP/1.1" 200 None
2026-03-30 11:27:57 [auto1.es] INFO: Scrape type for YH22245: 0
2026-03-30 11:27:57 [auto1.es] INFO: Found listing with ID: YH03872
2026-03-30 11:27:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PU52673> (referer: https://www.auto1.com/v1/car-details-view/PU52673/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31b2d8b2-6636-5fef-b723-ef475d2f383b with identifier: PU52673
2026-03-30 11:27:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31b2d8b2-6636-5fef-b723-ef475d2f383b with scrape type 1
2026-03-30 11:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 31b2d8b2-6636-5fef-b723-ef475d2f383b
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e386da614d64708332bfb520e00317%252Fpa%252FPU52673_ac3286308ffdcfa3015dc782b678104d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_ac3286308ffdcfa3015dc782b678104d.jpg not downloaded yet
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e386da614d64708332bfb520e00317%252Fpa%252FPU52673_4fd5c8dec0cb5e8f69fa03effbdee796.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_4fd5c8dec0cb5e8f69fa03effbdee796.jpg not downloaded yet
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e386da614d64708332bfb520e00317%252Fpa%252FPU52673_07d7b65ca10176315a59bab4555f9a7c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_07d7b65ca10176315a59bab4555f9a7c.jpg not downloaded yet
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e386da614d64708332bfb520e00317%252Fpa%252FPU52673_fb6b677dbee17addf8dceac5453d7e48.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_fb6b677dbee17addf8dceac5453d7e48.jpg not downloaded yet
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e386da614d64708332bfb520e00317%252Fpa%252FPU52673_881b2eb960505bfd869f03a8a790610d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_881b2eb960505bfd869f03a8a790610d.jpg not downloaded yet
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e386da614d64708332bfb520e00317%252Fpa%252FPU52673_0436dfa8be2cca83ebca59318d483cd6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_0436dfa8be2cca83ebca59318d483cd6.jpg not downloaded yet
2026-03-30 11:27:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_ac3286308ffdcfa3015dc782b678104d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e386da614d64708332bfb520e00317%252Fpa%252FPU52673_418b4b19b20b992c48d4fa4b3ea8ef84.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_418b4b19b20b992c48d4fa4b3ea8ef84.jpg not downloaded yet
2026-03-30 11:27:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_07d7b65ca10176315a59bab4555f9a7c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e386da614d64708332bfb520e00317%252Fpa%252FPU52673_3869706e15ab5378fe61379deb41440e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_3869706e15ab5378fe61379deb41440e.jpg not downloaded yet
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e386da614d64708332bfb520e00317%252Fpa%252FPU52673_9e6c70ddbfdadc195fa25f292099b652.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_9e6c70ddbfdadc195fa25f292099b652.jpg not downloaded yet
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e386da614d64708332bfb520e00317%252Fpa%252FPU52673_0f392617af8326f8464fc14ca7f7cce7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_0f392617af8326f8464fc14ca7f7cce7.jpg not downloaded yet
2026-03-30 11:27:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_0436dfa8be2cca83ebca59318d483cd6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a224ed0>
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b2d8b2-6636-5fef-b723-ef475d2f383b/31b2d8b2-6636-5fef-b723-ef475d2f383b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e386da614d64708332bfb520e00317%252Fpa%252FPU52673_ac3286308ffdcfa3015dc782b678104d.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_ac3286308ffdcfa3015dc782b678104d.jpg saved to cache
2026-03-30 11:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 31b2d8b2-6636-5fef-b723-ef475d2f383b
2026-03-30 11:27:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_4fd5c8dec0cb5e8f69fa03effbdee796.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_418b4b19b20b992c48d4fa4b3ea8ef84.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_9e6c70ddbfdadc195fa25f292099b652.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_fb6b677dbee17addf8dceac5453d7e48.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a47d510>
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b2d8b2-6636-5fef-b723-ef475d2f383b/31b2d8b2-6636-5fef-b723-ef475d2f383b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e386da614d64708332bfb520e00317%252Fpa%252FPU52673_07d7b65ca10176315a59bab4555f9a7c.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_07d7b65ca10176315a59bab4555f9a7c.jpg saved to cache
2026-03-30 11:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 31b2d8b2-6636-5fef-b723-ef475d2f383b
2026-03-30 11:27:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_0f392617af8326f8464fc14ca7f7cce7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_881b2eb960505bfd869f03a8a790610d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a285cd0>
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b2d8b2-6636-5fef-b723-ef475d2f383b/31b2d8b2-6636-5fef-b723-ef475d2f383b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e386da614d64708332bfb520e00317%252Fpa%252FPU52673_0436dfa8be2cca83ebca59318d483cd6.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_0436dfa8be2cca83ebca59318d483cd6.jpg saved to cache
2026-03-30 11:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 31b2d8b2-6636-5fef-b723-ef475d2f383b
2026-03-30 11:27:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_3869706e15ab5378fe61379deb41440e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a286c10>
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b2d8b2-6636-5fef-b723-ef475d2f383b/31b2d8b2-6636-5fef-b723-ef475d2f383b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e386da614d64708332bfb520e00317%252Fpa%252FPU52673_4fd5c8dec0cb5e8f69fa03effbdee796.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_4fd5c8dec0cb5e8f69fa03effbdee796.jpg saved to cache
2026-03-30 11:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 31b2d8b2-6636-5fef-b723-ef475d2f383b
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc0603fcb10>
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b2d8b2-6636-5fef-b723-ef475d2f383b/31b2d8b2-6636-5fef-b723-ef475d2f383b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e386da614d64708332bfb520e00317%252Fpa%252FPU52673_418b4b19b20b992c48d4fa4b3ea8ef84.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_418b4b19b20b992c48d4fa4b3ea8ef84.jpg saved to cache
2026-03-30 11:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 31b2d8b2-6636-5fef-b723-ef475d2f383b
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a265d90>
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b2d8b2-6636-5fef-b723-ef475d2f383b/31b2d8b2-6636-5fef-b723-ef475d2f383b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e386da614d64708332bfb520e00317%252Fpa%252FPU52673_9e6c70ddbfdadc195fa25f292099b652.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_9e6c70ddbfdadc195fa25f292099b652.jpg saved to cache
2026-03-30 11:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 31b2d8b2-6636-5fef-b723-ef475d2f383b
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05ae7e450>
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b2d8b2-6636-5fef-b723-ef475d2f383b/31b2d8b2-6636-5fef-b723-ef475d2f383b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e386da614d64708332bfb520e00317%252Fpa%252FPU52673_fb6b677dbee17addf8dceac5453d7e48.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_fb6b677dbee17addf8dceac5453d7e48.jpg saved to cache
2026-03-30 11:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 31b2d8b2-6636-5fef-b723-ef475d2f383b
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05aef8bd0>
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b2d8b2-6636-5fef-b723-ef475d2f383b/31b2d8b2-6636-5fef-b723-ef475d2f383b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e386da614d64708332bfb520e00317%252Fpa%252FPU52673_0f392617af8326f8464fc14ca7f7cce7.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_0f392617af8326f8464fc14ca7f7cce7.jpg saved to cache
2026-03-30 11:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 31b2d8b2-6636-5fef-b723-ef475d2f383b
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a3c4e50>
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b2d8b2-6636-5fef-b723-ef475d2f383b/31b2d8b2-6636-5fef-b723-ef475d2f383b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e386da614d64708332bfb520e00317%252Fpa%252FPU52673_881b2eb960505bfd869f03a8a790610d.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_881b2eb960505bfd869f03a8a790610d.jpg saved to cache
2026-03-30 11:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 31b2d8b2-6636-5fef-b723-ef475d2f383b
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc05a42ee90>
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:27:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b2d8b2-6636-5fef-b723-ef475d2f383b/31b2d8b2-6636-5fef-b723-ef475d2f383b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fe3%252F39e386da614d64708332bfb520e00317%252Fpa%252FPU52673_3869706e15ab5378fe61379deb41440e.jpg') HTTP/1.1" 204 0
2026-03-30 11:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_3869706e15ab5378fe61379deb41440e.jpg saved to cache
2026-03-30 11:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 31b2d8b2-6636-5fef-b723-ef475d2f383b
2026-03-30 11:27:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 31b2d8b2-6636-5fef-b723-ef475d2f383b, skipping ID generation
2026-03-30 11:27:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31b2d8b2-6636-5fef-b723-ef475d2f383b with scrape type 1
2026-03-30 11:27:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 31b2d8b2-6636-5fef-b723-ef475d2f383b sending to next pipeline
2026-03-30 11:27:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 31b2d8b2-6636-5fef-b723-ef475d2f383b, identifier: PU52673
2026-03-30 11:27:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 31b2d8b2-6636-5fef-b723-ef475d2f383b with identifier: PU52673
2026-03-30 11:27:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 31b2d8b2-6636-5fef-b723-ef475d2f383b with identifier: PU52673
2026-03-30 11:27:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 31b2d8b2-6636-5fef-b723-ef475d2f383b with identifier: PU52673 to the API
2026-03-30 11:27:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_3869706e15ab5378fe61379deb41440e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:09:45Z',
'fuel_type': 'diesel',
'id': '31b2d8b2-6636-5fef-b723-ef475d2f383b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU52673',
'listing': 'auction',
'location': 'ES, Elche',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 388698,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b2d8b2-6636-5fef-b723-ef475d2f383b/31b2d8b2-6636-5fef-b723-ef475d2f383b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85945,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_ac3286308ffdcfa3015dc782b678104d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b2d8b2-6636-5fef-b723-ef475d2f383b/31b2d8b2-6636-5fef-b723-ef475d2f383b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80447,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_4fd5c8dec0cb5e8f69fa03effbdee796.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b2d8b2-6636-5fef-b723-ef475d2f383b/31b2d8b2-6636-5fef-b723-ef475d2f383b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82250,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_07d7b65ca10176315a59bab4555f9a7c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b2d8b2-6636-5fef-b723-ef475d2f383b/31b2d8b2-6636-5fef-b723-ef475d2f383b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76589,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_fb6b677dbee17addf8dceac5453d7e48.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b2d8b2-6636-5fef-b723-ef475d2f383b/31b2d8b2-6636-5fef-b723-ef475d2f383b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81666,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_881b2eb960505bfd869f03a8a790610d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b2d8b2-6636-5fef-b723-ef475d2f383b/31b2d8b2-6636-5fef-b723-ef475d2f383b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91336,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_0436dfa8be2cca83ebca59318d483cd6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b2d8b2-6636-5fef-b723-ef475d2f383b/31b2d8b2-6636-5fef-b723-ef475d2f383b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78040,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_418b4b19b20b992c48d4fa4b3ea8ef84.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b2d8b2-6636-5fef-b723-ef475d2f383b/31b2d8b2-6636-5fef-b723-ef475d2f383b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100658,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_3869706e15ab5378fe61379deb41440e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b2d8b2-6636-5fef-b723-ef475d2f383b/31b2d8b2-6636-5fef-b723-ef475d2f383b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88125,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_9e6c70ddbfdadc195fa25f292099b652.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b2d8b2-6636-5fef-b723-ef475d2f383b/31b2d8b2-6636-5fef-b723-ef475d2f383b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87821,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/e3/39e386da614d64708332bfb520e00317/pa/PU52673_0f392617af8326f8464fc14ca7f7cce7.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-07-08',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI Sport BlueMotion',
'transmission': 'automatic',
'trim': 'Sport BlueMotion',
'year': 2014}
2026-03-30 11:27:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PU52673%27 HTTP/1.1" 200 None
2026-03-30 11:27:59 [auto1.es] INFO: Saving data for PU52673: {'created_time': 1774870079.807334, 'last_price_update_time': 1774870079.807345, 'auction_closing_time': 1774969785.0}
2026-03-30 11:27:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PU52673') HTTP/1.1" 204 0
2026-03-30 11:28:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:28:00 [auto1.es] INFO: Channel: 24h | Page: 18 | totalHits: 2238 | hits on page: 40
2026-03-30 11:28:00 [auto1.es] INFO: Found listing with ID: CE52648
2026-03-30 11:28:00 [auto1.es] INFO: Found listing with ID: YZ96653
2026-03-30 11:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YZ96653%27 HTTP/1.1" 200 None
2026-03-30 11:28:00 [auto1.es] INFO: Scrape type for YZ96653: 0
2026-03-30 11:28:00 [auto1.es] INFO: Found listing with ID: KG08685
2026-03-30 11:28:00 [auto1.es] INFO: Found listing with ID: GT40833
2026-03-30 11:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT40833%27 HTTP/1.1" 200 None
2026-03-30 11:28:00 [auto1.es] INFO: Scrape type for GT40833: 0
2026-03-30 11:28:00 [auto1.es] INFO: Found listing with ID: LF82591
2026-03-30 11:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LF82591%27 HTTP/1.1" 200 None
2026-03-30 11:28:00 [auto1.es] INFO: Scrape type for LF82591: 0
2026-03-30 11:28:00 [auto1.es] INFO: Found listing with ID: XE21936
2026-03-30 11:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XE21936%27 HTTP/1.1" 200 None
2026-03-30 11:28:00 [auto1.es] INFO: Scrape type for XE21936: 0
2026-03-30 11:28:00 [auto1.es] INFO: Found listing with ID: YT21640
2026-03-30 11:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YT21640%27 HTTP/1.1" 200 None
2026-03-30 11:28:00 [auto1.es] INFO: Scrape type for YT21640: 0
2026-03-30 11:28:00 [auto1.es] INFO: Found listing with ID: XS13258
2026-03-30 11:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XS13258%27 HTTP/1.1" 200 None
2026-03-30 11:28:00 [auto1.es] INFO: Scrape type for XS13258: 0
2026-03-30 11:28:00 [auto1.es] INFO: Found listing with ID: WT17927
2026-03-30 11:28:00 [auto1.es] INFO: Found listing with ID: NR71685
2026-03-30 11:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NR71685%27 HTTP/1.1" 200 None
2026-03-30 11:28:00 [auto1.es] INFO: Scrape type for NR71685: 0
2026-03-30 11:28:00 [auto1.es] INFO: Found listing with ID: KW01886
2026-03-30 11:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KW01886%27 HTTP/1.1" 200 None
2026-03-30 11:28:01 [auto1.es] INFO: Scrape type for KW01886: 0
2026-03-30 11:28:01 [auto1.es] INFO: Found listing with ID: HY48394
2026-03-30 11:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HY48394%27 HTTP/1.1" 200 None
2026-03-30 11:28:01 [auto1.es] INFO: Scrape type for HY48394: 0
2026-03-30 11:28:01 [auto1.es] INFO: Found listing with ID: LG14006
2026-03-30 11:28:01 [auto1.es] INFO: Found listing with ID: CF95684
2026-03-30 11:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CF95684%27 HTTP/1.1" 200 None
2026-03-30 11:28:01 [auto1.es] INFO: Scrape type for CF95684: 0
2026-03-30 11:28:01 [auto1.es] INFO: Found listing with ID: CT36127
2026-03-30 11:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CT36127%27 HTTP/1.1" 200 None
2026-03-30 11:28:01 [auto1.es] INFO: Scrape type for CT36127: 0
2026-03-30 11:28:01 [auto1.es] INFO: Found listing with ID: DE32472
2026-03-30 11:28:01 [auto1.es] INFO: Found listing with ID: HP66589
2026-03-30 11:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HP66589%27 HTTP/1.1" 200 None
2026-03-30 11:28:01 [auto1.es] INFO: Scrape type for HP66589: 0
2026-03-30 11:28:01 [auto1.es] INFO: Found listing with ID: CZ03495
2026-03-30 11:28:01 [auto1.es] INFO: Found listing with ID: BV63051
2026-03-30 11:28:01 [auto1.es] INFO: Found listing with ID: WG88272
2026-03-30 11:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WG88272%27 HTTP/1.1" 200 None
2026-03-30 11:28:01 [auto1.es] INFO: Scrape type for WG88272: 0
2026-03-30 11:28:01 [auto1.es] INFO: Found listing with ID: SA85956
2026-03-30 11:28:01 [auto1.es] INFO: Found listing with ID: BX69808
2026-03-30 11:28:01 [auto1.es] INFO: Found listing with ID: UT85695
2026-03-30 11:28:01 [auto1.es] INFO: Found listing with ID: YR51933
2026-03-30 11:28:01 [auto1.es] INFO: Found listing with ID: JP02584
2026-03-30 11:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JP02584%27 HTTP/1.1" 200 None
2026-03-30 11:28:01 [auto1.es] INFO: Scrape type for JP02584: 0
2026-03-30 11:28:01 [auto1.es] INFO: Found listing with ID: VC56562
2026-03-30 11:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC56562%27 HTTP/1.1" 200 None
2026-03-30 11:28:01 [auto1.es] INFO: Scrape type for VC56562: 0
2026-03-30 11:28:01 [auto1.es] INFO: Found listing with ID: HF45963
2026-03-30 11:28:01 [auto1.es] INFO: Found listing with ID: AC83489
2026-03-30 11:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AC83489%27 HTTP/1.1" 200 None
2026-03-30 11:28:01 [auto1.es] INFO: Scrape type for AC83489: 0
2026-03-30 11:28:01 [auto1.es] INFO: Found listing with ID: MC39832
2026-03-30 11:28:01 [auto1.es] INFO: Found listing with ID: KL41152
2026-03-30 11:28:01 [auto1.es] INFO: Found listing with ID: BB01662
2026-03-30 11:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BB01662%27 HTTP/1.1" 200 None
2026-03-30 11:28:01 [auto1.es] INFO: Scrape type for BB01662: 0
2026-03-30 11:28:01 [auto1.es] INFO: Found listing with ID: AP37450
2026-03-30 11:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AP37450%27 HTTP/1.1" 200 None
2026-03-30 11:28:01 [auto1.es] INFO: Scrape type for AP37450: 0
2026-03-30 11:28:01 [auto1.es] INFO: Found listing with ID: CX56846
2026-03-30 11:28:01 [auto1.es] INFO: Found listing with ID: YC93687
2026-03-30 11:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC93687%27 HTTP/1.1" 200 None
2026-03-30 11:28:01 [auto1.es] INFO: Scrape type for YC93687: 0
2026-03-30 11:28:01 [auto1.es] INFO: Found listing with ID: JR98843
2026-03-30 11:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JR98843%27 HTTP/1.1" 200 None
2026-03-30 11:28:01 [auto1.es] INFO: Scrape type for JR98843: 0
2026-03-30 11:28:01 [auto1.es] INFO: Found listing with ID: HR03779
2026-03-30 11:28:01 [auto1.es] INFO: Found listing with ID: XB03866
2026-03-30 11:28:01 [auto1.es] INFO: Found listing with ID: BA38537
2026-03-30 11:28:01 [auto1.es] INFO: Found listing with ID: CK45240
2026-03-30 11:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CK45240%27 HTTP/1.1" 200 None
2026-03-30 11:28:01 [auto1.es] INFO: Scrape type for CK45240: 0
2026-03-30 11:28:01 [auto1.es] INFO: Found listing with ID: VZ76792
2026-03-30 11:28:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:28:04 [scrapy.extensions.logstats] INFO: Crawled 196 pages (at 33 pages/min), scraped 216 items (at 24 items/min)
2026-03-30 11:28:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-30 11:28:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:28:05 [auto1.es] INFO: Channel: 24h | Page: 19 | totalHits: 2238 | hits on page: 40
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: PA54206
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: SD12171
2026-03-30 11:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SD12171%27 HTTP/1.1" 200 None
2026-03-30 11:28:05 [auto1.es] INFO: Scrape type for SD12171: 0
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: LD06220
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: GU84067
2026-03-30 11:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU84067%27 HTTP/1.1" 200 None
2026-03-30 11:28:05 [auto1.es] INFO: Scrape type for GU84067: 0
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: MD67818
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: SR27128
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: MD90485
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: NA59815
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: SH24939
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: AV50831
2026-03-30 11:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AV50831%27 HTTP/1.1" 200 None
2026-03-30 11:28:05 [auto1.es] INFO: Scrape type for AV50831: 0
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: WM54096
2026-03-30 11:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WM54096%27 HTTP/1.1" 200 None
2026-03-30 11:28:05 [auto1.es] INFO: Scrape type for WM54096: 0
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: JW31558
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: JD23550
2026-03-30 11:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JD23550%27 HTTP/1.1" 200 None
2026-03-30 11:28:05 [auto1.es] INFO: Scrape type for JD23550: 0
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: HX74648
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: GJ05293
2026-03-30 11:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GJ05293%27 HTTP/1.1" 200 None
2026-03-30 11:28:05 [auto1.es] INFO: Scrape type for GJ05293: 0
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: GM40947
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: LN73643
2026-03-30 11:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LN73643%27 HTTP/1.1" 200 None
2026-03-30 11:28:05 [auto1.es] INFO: Scrape type for LN73643: 0
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: FH96205
2026-03-30 11:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FH96205%27 HTTP/1.1" 200 None
2026-03-30 11:28:05 [auto1.es] INFO: Scrape type for FH96205: 0
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: XT23333
2026-03-30 11:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XT23333%27 HTTP/1.1" 200 None
2026-03-30 11:28:05 [auto1.es] INFO: Scrape type for XT23333: 0
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: PY60818
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: FS16711
2026-03-30 11:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FS16711%27 HTTP/1.1" 200 None
2026-03-30 11:28:05 [auto1.es] INFO: Scrape type for FS16711: 0
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: PE83631
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: HB69486
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: GL45539
2026-03-30 11:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GL45539%27 HTTP/1.1" 200 None
2026-03-30 11:28:05 [auto1.es] INFO: Scrape type for GL45539: 0
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: TS74128
2026-03-30 11:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS74128%27 HTTP/1.1" 200 None
2026-03-30 11:28:05 [auto1.es] INFO: Scrape type for TS74128: 0
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: DF81839
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: AB03508
2026-03-30 11:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AB03508%27 HTTP/1.1" 200 None
2026-03-30 11:28:05 [auto1.es] INFO: Scrape type for AB03508: 0
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: LJ76960
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: XN68994
2026-03-30 11:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XN68994%27 HTTP/1.1" 200 None
2026-03-30 11:28:05 [auto1.es] INFO: Scrape type for XN68994: 0
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: AY38423
2026-03-30 11:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AY38423%27 HTTP/1.1" 200 None
2026-03-30 11:28:05 [auto1.es] INFO: Scrape type for AY38423: 0
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: LE58276
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: TV56423
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: NH02350
2026-03-30 11:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NH02350%27 HTTP/1.1" 200 None
2026-03-30 11:28:05 [auto1.es] INFO: Scrape type for NH02350: 0
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: HY00110
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: BK02277
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: HU62060
2026-03-30 11:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HU62060%27 HTTP/1.1" 200 None
2026-03-30 11:28:05 [auto1.es] INFO: Scrape type for HU62060: 0
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: ZH31692
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: FC86593
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: KV49695
2026-03-30 11:28:05 [auto1.es] INFO: Found listing with ID: AG88258
2026-03-30 11:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG88258%27 HTTP/1.1" 200 None
2026-03-30 11:28:05 [auto1.es] INFO: Scrape type for AG88258: 0
2026-03-30 11:28:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:28:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:28:10 [auto1.es] INFO: Channel: 24h | Page: 20 | totalHits: 2238 | hits on page: 40
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: TE03576
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TE03576%27 HTTP/1.1" 200 None
2026-03-30 11:28:10 [auto1.es] INFO: Scrape type for TE03576: 0
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: LP64738
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LP64738%27 HTTP/1.1" 200 None
2026-03-30 11:28:10 [auto1.es] INFO: Scrape type for LP64738: 0
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: HX04467
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HX04467%27 HTTP/1.1" 200 None
2026-03-30 11:28:10 [auto1.es] INFO: Scrape type for HX04467: 0
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: NG91820
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NG91820%27 HTTP/1.1" 200 None
2026-03-30 11:28:10 [auto1.es] INFO: Scrape type for NG91820: 0
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: CH18424
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH18424%27 HTTP/1.1" 200 None
2026-03-30 11:28:10 [auto1.es] INFO: Scrape type for CH18424: 0
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: BP46708
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: GW46978
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: ZA22926
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZA22926%27 HTTP/1.1" 200 None
2026-03-30 11:28:10 [auto1.es] INFO: Scrape type for ZA22926: 0
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: DH89256
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH89256%27 HTTP/1.1" 200 None
2026-03-30 11:28:10 [auto1.es] INFO: Scrape type for DH89256: 0
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: HT29464
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: AR83818
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: EB95108
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB95108%27 HTTP/1.1" 200 None
2026-03-30 11:28:10 [auto1.es] INFO: Scrape type for EB95108: 0
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: PR72166
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PR72166%27 HTTP/1.1" 200 None
2026-03-30 11:28:10 [auto1.es] INFO: Scrape type for PR72166: 0
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: AZ96253
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: WK92895
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: DN29660
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DN29660%27 HTTP/1.1" 200 None
2026-03-30 11:28:10 [auto1.es] INFO: Scrape type for DN29660: 0
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: MW98976
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: EH00837
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: MZ63101
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: NA64654
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: SF48857
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SF48857%27 HTTP/1.1" 200 None
2026-03-30 11:28:10 [auto1.es] INFO: Scrape type for SF48857: 0
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: NK96984
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: CS79839
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: NA59982
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA59982%27 HTTP/1.1" 200 None
2026-03-30 11:28:10 [auto1.es] INFO: Scrape type for NA59982: 0
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: SA96918
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SA96918%27 HTTP/1.1" 200 None
2026-03-30 11:28:10 [auto1.es] INFO: Scrape type for SA96918: 0
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: AV99168
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AV99168%27 HTTP/1.1" 200 None
2026-03-30 11:28:10 [auto1.es] INFO: Scrape type for AV99168: 0
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: NX58407
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: EA93149
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EA93149%27 HTTP/1.1" 200 None
2026-03-30 11:28:10 [auto1.es] INFO: Scrape type for EA93149: 0
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: BF07220
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF07220%27 HTTP/1.1" 200 None
2026-03-30 11:28:10 [auto1.es] INFO: Scrape type for BF07220: 0
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: UA87015
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UA87015%27 HTTP/1.1" 200 None
2026-03-30 11:28:10 [auto1.es] INFO: Scrape type for UA87015: 0
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: EA60639
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: LS25075
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: UX02026
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UX02026%27 HTTP/1.1" 200 None
2026-03-30 11:28:10 [auto1.es] INFO: Scrape type for UX02026: 0
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: AU64639
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: ZV35449
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: KS53937
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KS53937%27 HTTP/1.1" 200 None
2026-03-30 11:28:10 [auto1.es] INFO: Scrape type for KS53937: 0
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: VW16333
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: CV42273
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: NZ35550
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NZ35550%27 HTTP/1.1" 200 None
2026-03-30 11:28:10 [auto1.es] INFO: Scrape type for NZ35550: 0
2026-03-30 11:28:10 [auto1.es] INFO: Found listing with ID: XA46112
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XA46112%27 HTTP/1.1" 200 None
2026-03-30 11:28:10 [auto1.es] INFO: Scrape type for XA46112: 0
2026-03-30 11:28:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:28:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:28:16 [auto1.es] INFO: Channel: 24h | Page: 21 | totalHits: 2238 | hits on page: 40
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: SP63286
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SP63286%27 HTTP/1.1" 200 None
2026-03-30 11:28:16 [auto1.es] INFO: Scrape type for SP63286: 0
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: NN81936
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NN81936%27 HTTP/1.1" 200 None
2026-03-30 11:28:16 [auto1.es] INFO: Scrape type for NN81936: 0
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: HY05176
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HY05176%27 HTTP/1.1" 200 None
2026-03-30 11:28:16 [auto1.es] INFO: Scrape type for HY05176: 0
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: YZ74298
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YZ74298%27 HTTP/1.1" 200 None
2026-03-30 11:28:16 [auto1.es] INFO: Scrape type for YZ74298: 0
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: AZ69629
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: VJ45850
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: WZ01367
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ01367%27 HTTP/1.1" 200 None
2026-03-30 11:28:16 [auto1.es] INFO: Scrape type for WZ01367: 0
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: PU93239
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: PL32115
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PL32115%27 HTTP/1.1" 200 None
2026-03-30 11:28:16 [auto1.es] INFO: Scrape type for PL32115: 0
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: PN79224
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PN79224%27 HTTP/1.1" 200 None
2026-03-30 11:28:16 [auto1.es] INFO: Scrape type for PN79224: 0
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: WY32728
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WY32728%27 HTTP/1.1" 200 None
2026-03-30 11:28:16 [auto1.es] INFO: Scrape type for WY32728: 0
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: BZ61067
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: WG12182
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: CY99272
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: MD02288
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD02288%27 HTTP/1.1" 200 None
2026-03-30 11:28:16 [auto1.es] INFO: Scrape type for MD02288: 0
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: FF03006
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FF03006%27 HTTP/1.1" 200 None
2026-03-30 11:28:16 [auto1.es] INFO: Scrape type for FF03006: 0
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: YK64988
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YK64988%27 HTTP/1.1" 200 None
2026-03-30 11:28:16 [auto1.es] INFO: Scrape type for YK64988: 0
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: XN99288
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XN99288%27 HTTP/1.1" 200 None
2026-03-30 11:28:16 [auto1.es] INFO: Scrape type for XN99288: 0
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: YC05678
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: TG79405
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TG79405%27 HTTP/1.1" 200 None
2026-03-30 11:28:16 [auto1.es] INFO: Scrape type for TG79405: 0
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: VV17373
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: FD45689
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: CJ82848
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: GG14242
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: RY07165
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RY07165%27 HTTP/1.1" 200 None
2026-03-30 11:28:16 [auto1.es] INFO: Scrape type for RY07165: 0
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: ST22726
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ST22726%27 HTTP/1.1" 200 None
2026-03-30 11:28:16 [auto1.es] INFO: Scrape type for ST22726: 0
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: KH66285
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: JG48293
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG48293%27 HTTP/1.1" 200 None
2026-03-30 11:28:16 [auto1.es] INFO: Scrape type for JG48293: 0
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: TE76337
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TE76337%27 HTTP/1.1" 200 None
2026-03-30 11:28:16 [auto1.es] INFO: Scrape type for TE76337: 0
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: NV56765
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NV56765%27 HTTP/1.1" 200 None
2026-03-30 11:28:16 [auto1.es] INFO: Scrape type for NV56765: 0
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: EB04007
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: MN37580
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: SZ88467
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: VE30170
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: YK84517
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: RC23930
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RC23930%27 HTTP/1.1" 200 None
2026-03-30 11:28:16 [auto1.es] INFO: Scrape type for RC23930: 0
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: FE10852
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: US42967
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US42967%27 HTTP/1.1" 200 None
2026-03-30 11:28:16 [auto1.es] INFO: Scrape type for US42967: 0
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: BE81339
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE81339%27 HTTP/1.1" 200 None
2026-03-30 11:28:16 [auto1.es] INFO: Scrape type for BE81339: 0
2026-03-30 11:28:16 [auto1.es] INFO: Found listing with ID: LY48125
2026-03-30 11:28:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:28:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:28:22 [auto1.es] INFO: Channel: 24h | Page: 22 | totalHits: 2238 | hits on page: 40
2026-03-30 11:28:22 [auto1.es] INFO: Found listing with ID: WB05226
2026-03-30 11:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WB05226%27 HTTP/1.1" 200 None
2026-03-30 11:28:22 [auto1.es] INFO: Scrape type for WB05226: 0
2026-03-30 11:28:22 [auto1.es] INFO: Found listing with ID: UB14006
2026-03-30 11:28:22 [auto1.es] INFO: Found listing with ID: GU63395
2026-03-30 11:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU63395%27 HTTP/1.1" 200 None
2026-03-30 11:28:22 [auto1.es] INFO: Scrape type for GU63395: 0
2026-03-30 11:28:22 [auto1.es] INFO: Found listing with ID: BJ99702
2026-03-30 11:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BJ99702%27 HTTP/1.1" 200 None
2026-03-30 11:28:22 [auto1.es] INFO: Scrape type for BJ99702: 0
2026-03-30 11:28:22 [auto1.es] INFO: Found listing with ID: EB56604
2026-03-30 11:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB56604%27 HTTP/1.1" 200 None
2026-03-30 11:28:22 [auto1.es] INFO: Scrape type for EB56604: 0
2026-03-30 11:28:22 [auto1.es] INFO: Found listing with ID: DH28057
2026-03-30 11:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH28057%27 HTTP/1.1" 200 None
2026-03-30 11:28:22 [auto1.es] INFO: Scrape type for DH28057: 0
2026-03-30 11:28:22 [auto1.es] INFO: Found listing with ID: GD98283
2026-03-30 11:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GD98283%27 HTTP/1.1" 200 None
2026-03-30 11:28:22 [auto1.es] INFO: Scrape type for GD98283: 0
2026-03-30 11:28:22 [auto1.es] INFO: Found listing with ID: TC80522
2026-03-30 11:28:22 [auto1.es] INFO: Found listing with ID: LZ88302
2026-03-30 11:28:22 [auto1.es] INFO: Found listing with ID: DY37922
2026-03-30 11:28:22 [auto1.es] INFO: Found listing with ID: EN63751
2026-03-30 11:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN63751%27 HTTP/1.1" 200 None
2026-03-30 11:28:22 [auto1.es] INFO: Scrape type for EN63751: 0
2026-03-30 11:28:22 [auto1.es] INFO: Found listing with ID: HU51946
2026-03-30 11:28:22 [auto1.es] INFO: Found listing with ID: MY21675
2026-03-30 11:28:22 [auto1.es] INFO: Found listing with ID: DM30321
2026-03-30 11:28:22 [auto1.es] INFO: Found listing with ID: MF88912
2026-03-30 11:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MF88912%27 HTTP/1.1" 200 None
2026-03-30 11:28:22 [auto1.es] INFO: Scrape type for MF88912: 0
2026-03-30 11:28:22 [auto1.es] INFO: Found listing with ID: VD62527
2026-03-30 11:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VD62527%27 HTTP/1.1" 200 None
2026-03-30 11:28:22 [auto1.es] INFO: Scrape type for VD62527: 0
2026-03-30 11:28:22 [auto1.es] INFO: Found listing with ID: KT14312
2026-03-30 11:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KT14312%27 HTTP/1.1" 200 None
2026-03-30 11:28:22 [auto1.es] INFO: Scrape type for KT14312: 0
2026-03-30 11:28:22 [auto1.es] INFO: Found listing with ID: XY66822
2026-03-30 11:28:22 [auto1.es] INFO: Found listing with ID: HX94185
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HX94185%27 HTTP/1.1" 200 None
2026-03-30 11:28:23 [auto1.es] INFO: Scrape type for HX94185: 0
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: BU39967
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BU39967%27 HTTP/1.1" 200 None
2026-03-30 11:28:23 [auto1.es] INFO: Scrape type for BU39967: 0
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: JR90206
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JR90206%27 HTTP/1.1" 200 None
2026-03-30 11:28:23 [auto1.es] INFO: Scrape type for JR90206: 0
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: ZV85818
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: TU86062
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TU86062%27 HTTP/1.1" 200 None
2026-03-30 11:28:23 [auto1.es] INFO: Scrape type for TU86062: 0
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: UB19878
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB19878%27 HTTP/1.1" 200 None
2026-03-30 11:28:23 [auto1.es] INFO: Scrape type for UB19878: 0
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: PM58195
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: AC51222
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AC51222%27 HTTP/1.1" 200 None
2026-03-30 11:28:23 [auto1.es] INFO: Scrape type for AC51222: 0
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: SH51429
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: YC02097
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC02097%27 HTTP/1.1" 200 None
2026-03-30 11:28:23 [auto1.es] INFO: Scrape type for YC02097: 0
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: WL81576
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: GA87794
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: BK88638
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: ZG69122
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZG69122%27 HTTP/1.1" 200 None
2026-03-30 11:28:23 [auto1.es] INFO: Scrape type for ZG69122: 0
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: SD38157
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: AA76120
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: TZ07439
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TZ07439%27 HTTP/1.1" 200 None
2026-03-30 11:28:23 [auto1.es] INFO: Scrape type for TZ07439: 0
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: KW46470
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: ZN44479
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: NH78008
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NH78008%27 HTTP/1.1" 200 None
2026-03-30 11:28:23 [auto1.es] INFO: Scrape type for NH78008: 0
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: TD74034
2026-03-30 11:28:23 [auto1.es] INFO: Found listing with ID: PV00531
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PV00531%27 HTTP/1.1" 200 None
2026-03-30 11:28:23 [auto1.es] INFO: Scrape type for PV00531: 0
2026-03-30 11:28:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:28:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:28:25 [auto1.es] INFO: Channel: 24h | Page: 23 | totalHits: 2239 | hits on page: 40
2026-03-30 11:28:25 [auto1.es] INFO: Found listing with ID: PV00531
2026-03-30 11:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PV00531%27 HTTP/1.1" 200 None
2026-03-30 11:28:25 [auto1.es] INFO: Scrape type for PV00531: 0
2026-03-30 11:28:25 [auto1.es] INFO: Found listing with ID: GC96055
2026-03-30 11:28:25 [auto1.es] INFO: Found listing with ID: ND56377
2026-03-30 11:28:25 [auto1.es] INFO: Found listing with ID: GZ15438
2026-03-30 11:28:25 [auto1.es] INFO: Found listing with ID: LC47472
2026-03-30 11:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC47472%27 HTTP/1.1" 200 None
2026-03-30 11:28:26 [auto1.es] INFO: Scrape type for LC47472: 0
2026-03-30 11:28:26 [auto1.es] INFO: Found listing with ID: WA43088
2026-03-30 11:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA43088%27 HTTP/1.1" 200 None
2026-03-30 11:28:26 [auto1.es] INFO: Scrape type for WA43088: 0
2026-03-30 11:28:26 [auto1.es] INFO: Found listing with ID: VH20399
2026-03-30 11:28:26 [auto1.es] INFO: Found listing with ID: LA93651
2026-03-30 11:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LA93651%27 HTTP/1.1" 200 None
2026-03-30 11:28:26 [auto1.es] INFO: Scrape type for LA93651: 0
2026-03-30 11:28:26 [auto1.es] INFO: Found listing with ID: VC14240
2026-03-30 11:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC14240%27 HTTP/1.1" 200 None
2026-03-30 11:28:26 [auto1.es] INFO: Scrape type for VC14240: 0
2026-03-30 11:28:26 [auto1.es] INFO: Found listing with ID: AT48913
2026-03-30 11:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AT48913%27 HTTP/1.1" 200 None
2026-03-30 11:28:26 [auto1.es] INFO: Scrape type for AT48913: 0
2026-03-30 11:28:26 [auto1.es] INFO: Found listing with ID: DF05847
2026-03-30 11:28:26 [auto1.es] INFO: Found listing with ID: CG28095
2026-03-30 11:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CG28095%27 HTTP/1.1" 200 None
2026-03-30 11:28:26 [auto1.es] INFO: Scrape type for CG28095: 0
2026-03-30 11:28:26 [auto1.es] INFO: Found listing with ID: LX79959
2026-03-30 11:28:26 [auto1.es] INFO: Found listing with ID: HP65934
2026-03-30 11:28:26 [auto1.es] INFO: Found listing with ID: DZ57590
2026-03-30 11:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DZ57590%27 HTTP/1.1" 200 None
2026-03-30 11:28:26 [auto1.es] INFO: Scrape type for DZ57590: 0
2026-03-30 11:28:26 [auto1.es] INFO: Found listing with ID: AH06396
2026-03-30 11:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AH06396%27 HTTP/1.1" 200 None
2026-03-30 11:28:26 [auto1.es] INFO: Scrape type for AH06396: 0
2026-03-30 11:28:26 [auto1.es] INFO: Found listing with ID: AE39465
2026-03-30 11:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE39465%27 HTTP/1.1" 200 None
2026-03-30 11:28:26 [auto1.es] INFO: Scrape type for AE39465: 0
2026-03-30 11:28:26 [auto1.es] INFO: Found listing with ID: CS85139
2026-03-30 11:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CS85139%27 HTTP/1.1" 200 None
2026-03-30 11:28:26 [auto1.es] INFO: Scrape type for CS85139: 0
2026-03-30 11:28:26 [auto1.es] INFO: Found listing with ID: RK09278
2026-03-30 11:28:26 [auto1.es] INFO: Found listing with ID: FU02845
2026-03-30 11:28:26 [auto1.es] INFO: Found listing with ID: EV44292
2026-03-30 11:28:26 [auto1.es] INFO: Found listing with ID: RD73162
2026-03-30 11:28:26 [auto1.es] INFO: Found listing with ID: BE99512
2026-03-30 11:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE99512%27 HTTP/1.1" 200 None
2026-03-30 11:28:26 [auto1.es] INFO: Scrape type for BE99512: 0
2026-03-30 11:28:26 [auto1.es] INFO: Found listing with ID: BB81076
2026-03-30 11:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BB81076%27 HTTP/1.1" 200 None
2026-03-30 11:28:26 [auto1.es] INFO: Scrape type for BB81076: 0
2026-03-30 11:28:26 [auto1.es] INFO: Found listing with ID: NA90839
2026-03-30 11:28:26 [auto1.es] INFO: Found listing with ID: WC01421
2026-03-30 11:28:26 [auto1.es] INFO: Found listing with ID: HU09823
2026-03-30 11:28:26 [auto1.es] INFO: Found listing with ID: WJ13616
2026-03-30 11:28:26 [auto1.es] INFO: Found listing with ID: ET29682
2026-03-30 11:28:26 [auto1.es] INFO: Found listing with ID: KY66855
2026-03-30 11:28:26 [auto1.es] INFO: Found listing with ID: WU13655
2026-03-30 11:28:26 [auto1.es] INFO: Found listing with ID: XX88726
2026-03-30 11:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XX88726%27 HTTP/1.1" 200 None
2026-03-30 11:28:26 [auto1.es] INFO: Scrape type for XX88726: 0
2026-03-30 11:28:26 [auto1.es] INFO: Found listing with ID: AL56115
2026-03-30 11:28:26 [auto1.es] INFO: Found listing with ID: EB91308
2026-03-30 11:28:26 [auto1.es] INFO: Found listing with ID: ZN38628
2026-03-30 11:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZN38628%27 HTTP/1.1" 200 None
2026-03-30 11:28:26 [auto1.es] INFO: Scrape type for ZN38628: 0
2026-03-30 11:28:26 [auto1.es] INFO: Found listing with ID: LD31555
2026-03-30 11:28:26 [auto1.es] INFO: Found listing with ID: VC21709
2026-03-30 11:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC21709%27 HTTP/1.1" 200 None
2026-03-30 11:28:26 [auto1.es] INFO: Scrape type for VC21709: 0
2026-03-30 11:28:26 [auto1.es] INFO: Found listing with ID: UB23509
2026-03-30 11:28:26 [auto1.es] INFO: Found listing with ID: PY68884
2026-03-30 11:28:26 [auto1.es] INFO: Found listing with ID: UZ31378
2026-03-30 11:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UZ31378%27 HTTP/1.1" 200 None
2026-03-30 11:28:26 [auto1.es] INFO: Scrape type for UZ31378: 0
2026-03-30 11:28:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:28:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:28:35 [auto1.es] INFO: Channel: 24h | Page: 24 | totalHits: 2239 | hits on page: 40
2026-03-30 11:28:35 [auto1.es] INFO: Found listing with ID: FM17704
2026-03-30 11:28:35 [auto1.es] INFO: Found listing with ID: EK01872
2026-03-30 11:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EK01872%27 HTTP/1.1" 200 None
2026-03-30 11:28:35 [auto1.es] INFO: Scrape type for EK01872: 0
2026-03-30 11:28:35 [auto1.es] INFO: Found listing with ID: YK67948
2026-03-30 11:28:35 [auto1.es] INFO: Found listing with ID: XS72165
2026-03-30 11:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XS72165%27 HTTP/1.1" 200 None
2026-03-30 11:28:35 [auto1.es] INFO: Scrape type for XS72165: 0
2026-03-30 11:28:35 [auto1.es] INFO: Found listing with ID: AR38034
2026-03-30 11:28:35 [auto1.es] INFO: Found listing with ID: DE05142
2026-03-30 11:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DE05142%27 HTTP/1.1" 200 None
2026-03-30 11:28:35 [auto1.es] INFO: Scrape type for DE05142: 0
2026-03-30 11:28:35 [auto1.es] INFO: Found listing with ID: DS85202
2026-03-30 11:28:35 [auto1.es] INFO: Found listing with ID: CM29886
2026-03-30 11:28:35 [auto1.es] INFO: Found listing with ID: LC59414
2026-03-30 11:28:35 [auto1.es] INFO: Found listing with ID: ZR92434
2026-03-30 11:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZR92434%27 HTTP/1.1" 200 None
2026-03-30 11:28:35 [auto1.es] INFO: Scrape type for ZR92434: 0
2026-03-30 11:28:35 [auto1.es] INFO: Found listing with ID: XM72121
2026-03-30 11:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XM72121%27 HTTP/1.1" 200 None
2026-03-30 11:28:35 [auto1.es] INFO: Scrape type for XM72121: 0
2026-03-30 11:28:35 [auto1.es] INFO: Found listing with ID: KH78289
2026-03-30 11:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KH78289%27 HTTP/1.1" 200 None
2026-03-30 11:28:35 [auto1.es] INFO: Scrape type for KH78289: 0
2026-03-30 11:28:35 [auto1.es] INFO: Found listing with ID: HT97347
2026-03-30 11:28:35 [auto1.es] INFO: Found listing with ID: NK89716
2026-03-30 11:28:35 [auto1.es] INFO: Found listing with ID: TG59620
2026-03-30 11:28:35 [auto1.es] INFO: Found listing with ID: XP83718
2026-03-30 11:28:35 [auto1.es] INFO: Found listing with ID: VR19230
2026-03-30 11:28:35 [auto1.es] INFO: Found listing with ID: YN09707
2026-03-30 11:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YN09707%27 HTTP/1.1" 200 None
2026-03-30 11:28:35 [auto1.es] INFO: Scrape type for YN09707: 0
2026-03-30 11:28:35 [auto1.es] INFO: Found listing with ID: EM25182
2026-03-30 11:28:35 [auto1.es] INFO: Found listing with ID: UX56252
2026-03-30 11:28:35 [auto1.es] INFO: Found listing with ID: NF01026
2026-03-30 11:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NF01026%27 HTTP/1.1" 200 None
2026-03-30 11:28:35 [auto1.es] INFO: Scrape type for NF01026: 0
2026-03-30 11:28:35 [auto1.es] INFO: Found listing with ID: CP47935
2026-03-30 11:28:35 [auto1.es] INFO: Found listing with ID: AJ17622
2026-03-30 11:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ17622%27 HTTP/1.1" 200 None
2026-03-30 11:28:35 [auto1.es] INFO: Scrape type for AJ17622: 0
2026-03-30 11:28:35 [auto1.es] INFO: Found listing with ID: ZW84948
2026-03-30 11:28:35 [auto1.es] INFO: Found listing with ID: WP34960
2026-03-30 11:28:35 [auto1.es] INFO: Found listing with ID: YE69993
2026-03-30 11:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YE69993%27 HTTP/1.1" 200 None
2026-03-30 11:28:35 [auto1.es] INFO: Scrape type for YE69993: 0
2026-03-30 11:28:35 [auto1.es] INFO: Found listing with ID: ZU63673
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZU63673%27 HTTP/1.1" 200 None
2026-03-30 11:28:36 [auto1.es] INFO: Scrape type for ZU63673: 0
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: UX61881
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: PK27651
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK27651%27 HTTP/1.1" 200 None
2026-03-30 11:28:36 [auto1.es] INFO: Scrape type for PK27651: 0
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: PD89077
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD89077%27 HTTP/1.1" 200 None
2026-03-30 11:28:36 [auto1.es] INFO: Scrape type for PD89077: 0
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: LF16630
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LF16630%27 HTTP/1.1" 200 None
2026-03-30 11:28:36 [auto1.es] INFO: Scrape type for LF16630: 0
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: XG19134
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XG19134%27 HTTP/1.1" 200 None
2026-03-30 11:28:36 [auto1.es] INFO: Scrape type for XG19134: 0
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: RZ25182
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: PP58388
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: YF58100
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: EY27652
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: LV66931
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: GN42445
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GN42445%27 HTTP/1.1" 200 None
2026-03-30 11:28:36 [auto1.es] INFO: Scrape type for GN42445: 0
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: SE46424
2026-03-30 11:28:36 [auto1.es] INFO: Found listing with ID: TY04306
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TY04306%27 HTTP/1.1" 200 None
2026-03-30 11:28:36 [auto1.es] INFO: Scrape type for TY04306: 0
2026-03-30 11:28:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:28:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:28:37 [auto1.es] INFO: Channel: 24h | Page: 25 | totalHits: 2239 | hits on page: 40
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: ZP90682
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZP90682%27 HTTP/1.1" 200 None
2026-03-30 11:28:37 [auto1.es] INFO: Scrape type for ZP90682: 0
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: RA15604
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RA15604%27 HTTP/1.1" 200 None
2026-03-30 11:28:37 [auto1.es] INFO: Scrape type for RA15604: 0
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: WA04361
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA04361%27 HTTP/1.1" 200 None
2026-03-30 11:28:37 [auto1.es] INFO: Scrape type for WA04361: 0
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: MP20353
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MP20353%27 HTTP/1.1" 200 None
2026-03-30 11:28:37 [auto1.es] INFO: Scrape type for MP20353: 0
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: WZ80502
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: DT92878
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DT92878%27 HTTP/1.1" 200 None
2026-03-30 11:28:37 [auto1.es] INFO: Scrape type for DT92878: 0
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: GU07092
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU07092%27 HTTP/1.1" 200 None
2026-03-30 11:28:37 [auto1.es] INFO: Scrape type for GU07092: 0
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: EN30281
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: LD85215
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LD85215%27 HTTP/1.1" 200 None
2026-03-30 11:28:37 [auto1.es] INFO: Scrape type for LD85215: 0
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: DF95857
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DF95857%27 HTTP/1.1" 200 None
2026-03-30 11:28:37 [auto1.es] INFO: Scrape type for DF95857: 0
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: AR99640
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: FW12550
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: YC26234
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC26234%27 HTTP/1.1" 200 None
2026-03-30 11:28:37 [auto1.es] INFO: Scrape type for YC26234: 0
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: WU95928
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: EZ00387
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EZ00387%27 HTTP/1.1" 200 None
2026-03-30 11:28:37 [auto1.es] INFO: Scrape type for EZ00387: 0
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: PA70803
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PA70803%27 HTTP/1.1" 200 None
2026-03-30 11:28:37 [auto1.es] INFO: Scrape type for PA70803: 0
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: ZL27489
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL27489%27 HTTP/1.1" 200 None
2026-03-30 11:28:37 [auto1.es] INFO: Scrape type for ZL27489: 0
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: CL01909
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: RM87129
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: JF80642
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JF80642%27 HTTP/1.1" 200 None
2026-03-30 11:28:37 [auto1.es] INFO: Scrape type for JF80642: 0
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: AN61719
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: RW86694
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: YH76219
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: ET49532
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: PH24007
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PH24007%27 HTTP/1.1" 200 None
2026-03-30 11:28:37 [auto1.es] INFO: Scrape type for PH24007: 0
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: BA72384
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: XL49074
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: NV97141
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NV97141%27 HTTP/1.1" 200 None
2026-03-30 11:28:37 [auto1.es] INFO: Scrape type for NV97141: 0
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: RC69280
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: JP06939
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JP06939%27 HTTP/1.1" 200 None
2026-03-30 11:28:37 [auto1.es] INFO: Scrape type for JP06939: 0
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: KC55308
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KC55308%27 HTTP/1.1" 200 None
2026-03-30 11:28:37 [auto1.es] INFO: Scrape type for KC55308: 0
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: RU72076
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RU72076%27 HTTP/1.1" 200 None
2026-03-30 11:28:37 [auto1.es] INFO: Scrape type for RU72076: 0
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: HS23075
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HS23075%27 HTTP/1.1" 200 None
2026-03-30 11:28:37 [auto1.es] INFO: Scrape type for HS23075: 0
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: LS24467
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: SL05666
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: UJ75834
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: NL18277
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: WC31685
2026-03-30 11:28:37 [auto1.es] INFO: Found listing with ID: YJ31594
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ31594%27 HTTP/1.1" 200 None
2026-03-30 11:28:37 [auto1.es] INFO: Scrape type for YJ31594: 2
2026-03-30 11:28:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 130f0a28-49db-5483-9be8-0e1e45445fbf with identifier: YJ31594
2026-03-30 11:28:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 130f0a28-49db-5483-9be8-0e1e45445fbf with scrape type 2
2026-03-30 11:28:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 130f0a28-49db-5483-9be8-0e1e45445fbf with scrape type 2
2026-03-30 11:28:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 130f0a28-49db-5483-9be8-0e1e45445fbf, identifier: YJ31594
2026-03-30 11:28:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 130f0a28-49db-5483-9be8-0e1e45445fbf with identifier: YJ31594
2026-03-30 11:28:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 130f0a28-49db-5483-9be8-0e1e45445fbf with identifier: YJ31594
2026-03-30 11:28:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 130f0a28-49db-5483-9be8-0e1e45445fbf with identifier: YJ31594 to the API
2026-03-30 11:28:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:28:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:28:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:35:33Z',
'fuel_type': 'diesel',
'id': '130f0a28-49db-5483-9be8-0e1e45445fbf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ31594',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit Custom',
'odometer': 125792,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-14',
'seller_name': None,
'title': 'Ford Transit Custom 2.0 TDCi Mild-Hybrid 280 L1 Trend',
'transmission': 'manual',
'trim': '280 L1 Trend',
'year': 2023}
2026-03-30 11:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ31594%27 HTTP/1.1" 200 None
2026-03-30 11:28:38 [auto1.es] INFO: Saving data for YJ31594: {'auction_closing_time': 1774884933.0, 'created_time': 1773147908.053476, 'last_price_update_time': 1774870118.164097}
2026-03-30 11:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YJ31594') HTTP/1.1" 204 0
2026-03-30 11:28:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:28:38 [auto1.es] INFO: Found listing with ID: AL95022
2026-03-30 11:28:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:28:39 [auto1.es] INFO: Channel: 24h | Page: 26 | totalHits: 2240 | hits on page: 40
2026-03-30 11:28:39 [auto1.es] INFO: Found listing with ID: AL95022
2026-03-30 11:28:39 [auto1.es] INFO: Found listing with ID: YH50380
2026-03-30 11:28:39 [auto1.es] INFO: Found listing with ID: DR80408
2026-03-30 11:28:39 [auto1.es] INFO: Found listing with ID: KN20480
2026-03-30 11:28:39 [auto1.es] INFO: Found listing with ID: AZ32576
2026-03-30 11:28:39 [auto1.es] INFO: Found listing with ID: EL87448
2026-03-30 11:28:39 [auto1.es] INFO: Found listing with ID: RM32032
2026-03-30 11:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RM32032%27 HTTP/1.1" 200 None
2026-03-30 11:28:39 [auto1.es] INFO: Scrape type for RM32032: 2
2026-03-30 11:28:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9baf91bb-b07b-5ad9-8e98-9815983f2a73 with identifier: RM32032
2026-03-30 11:28:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9baf91bb-b07b-5ad9-8e98-9815983f2a73 with scrape type 2
2026-03-30 11:28:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9baf91bb-b07b-5ad9-8e98-9815983f2a73 with scrape type 2
2026-03-30 11:28:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9baf91bb-b07b-5ad9-8e98-9815983f2a73, identifier: RM32032
2026-03-30 11:28:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9baf91bb-b07b-5ad9-8e98-9815983f2a73 with identifier: RM32032
2026-03-30 11:28:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9baf91bb-b07b-5ad9-8e98-9815983f2a73 with identifier: RM32032
2026-03-30 11:28:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9baf91bb-b07b-5ad9-8e98-9815983f2a73 with identifier: RM32032 to the API
2026-03-30 11:28:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:28:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:28:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:04:08Z',
'fuel_type': 'diesel',
'id': '9baf91bb-b07b-5ad9-8e98-9815983f2a73',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM32032',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit Custom',
'odometer': 110302,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-14',
'seller_name': None,
'title': 'Ford Transit Custom 2.0 TDCi Mild-Hybrid 280 L1 Trend',
'transmission': 'manual',
'trim': '280 L1 Trend',
'year': 2023}
2026-03-30 11:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RM32032%27 HTTP/1.1" 200 None
2026-03-30 11:28:39 [auto1.es] INFO: Saving data for RM32032: {'auction_closing_time': 1774883048.0, 'created_time': 1773147826.02481, 'last_price_update_time': 1774870119.552608}
2026-03-30 11:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RM32032') HTTP/1.1" 204 0
2026-03-30 11:28:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:28:39 [auto1.es] INFO: Found listing with ID: NW70780
2026-03-30 11:28:39 [auto1.es] INFO: Found listing with ID: AE38479
2026-03-30 11:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE38479%27 HTTP/1.1" 200 None
2026-03-30 11:28:39 [auto1.es] INFO: Scrape type for AE38479: 2
2026-03-30 11:28:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be6f4070-83cd-541f-82da-204d7e8ba910 with identifier: AE38479
2026-03-30 11:28:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be6f4070-83cd-541f-82da-204d7e8ba910 with scrape type 2
2026-03-30 11:28:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be6f4070-83cd-541f-82da-204d7e8ba910 with scrape type 2
2026-03-30 11:28:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: be6f4070-83cd-541f-82da-204d7e8ba910, identifier: AE38479
2026-03-30 11:28:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: be6f4070-83cd-541f-82da-204d7e8ba910 with identifier: AE38479
2026-03-30 11:28:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: be6f4070-83cd-541f-82da-204d7e8ba910 with identifier: AE38479
2026-03-30 11:28:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: be6f4070-83cd-541f-82da-204d7e8ba910 with identifier: AE38479 to the API
2026-03-30 11:28:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:28:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:28:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:24:56Z',
'fuel_type': 'diesel',
'id': 'be6f4070-83cd-541f-82da-204d7e8ba910',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE38479',
'listing': 'auction',
'make': 'Renault',
'model': 'Kangoo',
'odometer': 64401,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-29',
'seller_name': None,
'title': 'Renault Kangoo 1.5 BLUE dCi Basis L1',
'transmission': 'manual',
'trim': 'Basis L1',
'year': 2023}
2026-03-30 11:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE38479%27 HTTP/1.1" 200 None
2026-03-30 11:28:39 [auto1.es] INFO: Saving data for AE38479: {'auction_closing_time': 1774884296.0, 'created_time': 1774361481.717805, 'last_price_update_time': 1774870119.971182}
2026-03-30 11:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AE38479') HTTP/1.1" 204 0
2026-03-30 11:28:39 [auto1.es] INFO: Found listing with ID: RX75701
2026-03-30 11:28:39 [auto1.es] INFO: Found listing with ID: AM40954
2026-03-30 11:28:39 [auto1.es] INFO: Found listing with ID: NY63856
2026-03-30 11:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NY63856%27 HTTP/1.1" 200 None
2026-03-30 11:28:40 [auto1.es] INFO: Scrape type for NY63856: 2
2026-03-30 11:28:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 956ac0a4-7158-52be-b7a2-90c56142b60c with identifier: NY63856
2026-03-30 11:28:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 956ac0a4-7158-52be-b7a2-90c56142b60c with scrape type 2
2026-03-30 11:28:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 956ac0a4-7158-52be-b7a2-90c56142b60c with scrape type 2
2026-03-30 11:28:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 956ac0a4-7158-52be-b7a2-90c56142b60c, identifier: NY63856
2026-03-30 11:28:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 956ac0a4-7158-52be-b7a2-90c56142b60c with identifier: NY63856
2026-03-30 11:28:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 956ac0a4-7158-52be-b7a2-90c56142b60c with identifier: NY63856
2026-03-30 11:28:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 956ac0a4-7158-52be-b7a2-90c56142b60c with identifier: NY63856 to the API
2026-03-30 11:28:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:28:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:28:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:37:40Z',
'fuel_type': 'diesel',
'id': '956ac0a4-7158-52be-b7a2-90c56142b60c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY63856',
'listing': 'auction',
'make': 'Fiat',
'model': 'Fiorino',
'odometer': 160879,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-27',
'seller_name': None,
'title': 'Fiat Fiorino 1.3 M-Jet SX Kasten',
'transmission': 'manual',
'trim': 'SX Kasten',
'year': 2020}
2026-03-30 11:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NY63856%27 HTTP/1.1" 200 None
2026-03-30 11:28:40 [auto1.es] INFO: Saving data for NY63856: {'auction_closing_time': 1774885060.0, 'created_time': 1773147504.469335, 'last_price_update_time': 1774870120.361623}
2026-03-30 11:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NY63856') HTTP/1.1" 204 0
2026-03-30 11:28:40 [auto1.es] INFO: Found listing with ID: FE95499
2026-03-30 11:28:40 [auto1.es] INFO: Found listing with ID: NZ75467
2026-03-30 11:28:40 [auto1.es] INFO: Found listing with ID: UA78056
2026-03-30 11:28:40 [auto1.es] INFO: Found listing with ID: ZJ91904
2026-03-30 11:28:40 [auto1.es] INFO: Found listing with ID: AS89718
2026-03-30 11:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AS89718%27 HTTP/1.1" 200 None
2026-03-30 11:28:40 [auto1.es] INFO: Scrape type for AS89718: 0
2026-03-30 11:28:40 [auto1.es] INFO: Found listing with ID: LP19075
2026-03-30 11:28:40 [auto1.es] INFO: Found listing with ID: NX10542
2026-03-30 11:28:40 [auto1.es] INFO: Found listing with ID: UJ63738
2026-03-30 11:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UJ63738%27 HTTP/1.1" 200 None
2026-03-30 11:28:40 [auto1.es] INFO: Scrape type for UJ63738: 0
2026-03-30 11:28:40 [auto1.es] INFO: Found listing with ID: MR44374
2026-03-30 11:28:40 [auto1.es] INFO: Found listing with ID: TF01145
2026-03-30 11:28:40 [auto1.es] INFO: Found listing with ID: FD92504
2026-03-30 11:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FD92504%27 HTTP/1.1" 200 None
2026-03-30 11:28:40 [auto1.es] INFO: Scrape type for FD92504: 0
2026-03-30 11:28:40 [auto1.es] INFO: Found listing with ID: VK23822
2026-03-30 11:28:40 [auto1.es] INFO: Found listing with ID: TW05387
2026-03-30 11:28:40 [auto1.es] INFO: Found listing with ID: KY97566
2026-03-30 11:28:40 [auto1.es] INFO: Found listing with ID: SW56668
2026-03-30 11:28:40 [auto1.es] INFO: Found listing with ID: SA01398
2026-03-30 11:28:40 [auto1.es] INFO: Found listing with ID: WE89333
2026-03-30 11:28:40 [auto1.es] INFO: Found listing with ID: HD33844
2026-03-30 11:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HD33844%27 HTTP/1.1" 200 None
2026-03-30 11:28:40 [auto1.es] INFO: Scrape type for HD33844: 0
2026-03-30 11:28:40 [auto1.es] INFO: Found listing with ID: VG19877
2026-03-30 11:28:40 [auto1.es] INFO: Found listing with ID: UX63556
2026-03-30 11:28:40 [auto1.es] INFO: Found listing with ID: SS93372
2026-03-30 11:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SS93372%27 HTTP/1.1" 200 None
2026-03-30 11:28:40 [auto1.es] INFO: Scrape type for SS93372: 0
2026-03-30 11:28:40 [auto1.es] INFO: Found listing with ID: FV55100
2026-03-30 11:28:40 [auto1.es] INFO: Found listing with ID: HN69450
2026-03-30 11:28:40 [auto1.es] INFO: Found listing with ID: VZ14573
2026-03-30 11:28:40 [auto1.es] INFO: Found listing with ID: DZ68037
2026-03-30 11:28:40 [auto1.es] INFO: Found listing with ID: WD91964
2026-03-30 11:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WD91964%27 HTTP/1.1" 200 None
2026-03-30 11:28:40 [auto1.es] INFO: Scrape type for WD91964: 0
2026-03-30 11:28:40 [auto1.es] INFO: Found listing with ID: HU91100
2026-03-30 11:28:40 [auto1.es] INFO: Found listing with ID: GK24659
2026-03-30 11:28:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:28:41 [auto1.es] INFO: Channel: 24h | Page: 27 | totalHits: 2240 | hits on page: 40
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: RV68054
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: EZ62755
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EZ62755%27 HTTP/1.1" 200 None
2026-03-30 11:28:41 [auto1.es] INFO: Scrape type for EZ62755: 0
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: PS51318
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: RA40828
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: MX89388
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MX89388%27 HTTP/1.1" 200 None
2026-03-30 11:28:41 [auto1.es] INFO: Scrape type for MX89388: 0
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: DG60223
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: KV08902
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KV08902%27 HTTP/1.1" 200 None
2026-03-30 11:28:41 [auto1.es] INFO: Scrape type for KV08902: 0
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: UN46915
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UN46915%27 HTTP/1.1" 200 None
2026-03-30 11:28:41 [auto1.es] INFO: Scrape type for UN46915: 0
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: ZJ66849
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZJ66849%27 HTTP/1.1" 200 None
2026-03-30 11:28:41 [auto1.es] INFO: Scrape type for ZJ66849: 0
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: BY62424
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: ZP40388
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: UU12950
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: JC57024
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: NK53544
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NK53544%27 HTTP/1.1" 200 None
2026-03-30 11:28:41 [auto1.es] INFO: Scrape type for NK53544: 0
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: MS50562
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: TP39679
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TP39679%27 HTTP/1.1" 200 None
2026-03-30 11:28:41 [auto1.es] INFO: Scrape type for TP39679: 0
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: FL58713
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FL58713%27 HTTP/1.1" 200 None
2026-03-30 11:28:41 [auto1.es] INFO: Scrape type for FL58713: 0
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: FE45976
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FE45976%27 HTTP/1.1" 200 None
2026-03-30 11:28:41 [auto1.es] INFO: Scrape type for FE45976: 0
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: FD06451
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FD06451%27 HTTP/1.1" 200 None
2026-03-30 11:28:41 [auto1.es] INFO: Scrape type for FD06451: 0
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: SY03135
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SY03135%27 HTTP/1.1" 200 None
2026-03-30 11:28:41 [auto1.es] INFO: Scrape type for SY03135: 0
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: BZ30426
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: VG29597
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VG29597%27 HTTP/1.1" 200 None
2026-03-30 11:28:41 [auto1.es] INFO: Scrape type for VG29597: 0
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: JM67207
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: JG31489
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG31489%27 HTTP/1.1" 200 None
2026-03-30 11:28:41 [auto1.es] INFO: Scrape type for JG31489: 0
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: LL39817
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: BG65437
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: PC57749
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PC57749%27 HTTP/1.1" 200 None
2026-03-30 11:28:41 [auto1.es] INFO: Scrape type for PC57749: 0
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: SW39850
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: UT42800
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: XT05924
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XT05924%27 HTTP/1.1" 200 None
2026-03-30 11:28:41 [auto1.es] INFO: Scrape type for XT05924: 0
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: UF24863
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: TR37642
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: ZP69611
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZP69611%27 HTTP/1.1" 200 None
2026-03-30 11:28:41 [auto1.es] INFO: Scrape type for ZP69611: 0
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: PY01338
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: FZ59891
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FZ59891%27 HTTP/1.1" 200 None
2026-03-30 11:28:41 [auto1.es] INFO: Scrape type for FZ59891: 0
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: GM36563
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: ET47712
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: CM69790
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CM69790%27 HTTP/1.1" 200 None
2026-03-30 11:28:41 [auto1.es] INFO: Scrape type for CM69790: 0
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: NH22970
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NH22970%27 HTTP/1.1" 200 None
2026-03-30 11:28:41 [auto1.es] INFO: Scrape type for NH22970: 0
2026-03-30 11:28:41 [auto1.es] INFO: Found listing with ID: CR05055
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CR05055%27 HTTP/1.1" 200 None
2026-03-30 11:28:41 [auto1.es] INFO: Scrape type for CR05055: 0
2026-03-30 11:28:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:28:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:28:52 [auto1.es] INFO: Channel: 24h | Page: 28 | totalHits: 2240 | hits on page: 40
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: DD59936
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: EC26628
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: UF51281
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF51281%27 HTTP/1.1" 200 None
2026-03-30 11:28:52 [auto1.es] INFO: Scrape type for UF51281: 0
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: DD26500
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: DB30998
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DB30998%27 HTTP/1.1" 200 None
2026-03-30 11:28:52 [auto1.es] INFO: Scrape type for DB30998: 0
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: BF77799
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: FY93718
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FY93718%27 HTTP/1.1" 200 None
2026-03-30 11:28:52 [auto1.es] INFO: Scrape type for FY93718: 0
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: DW27115
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: ED81509
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: RZ43075
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: RK31949
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK31949%27 HTTP/1.1" 200 None
2026-03-30 11:28:52 [auto1.es] INFO: Scrape type for RK31949: 0
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: JJ21664
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: BA69170
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BA69170%27 HTTP/1.1" 200 None
2026-03-30 11:28:52 [auto1.es] INFO: Scrape type for BA69170: 0
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: DA42101
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: MV61216
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MV61216%27 HTTP/1.1" 200 None
2026-03-30 11:28:52 [auto1.es] INFO: Scrape type for MV61216: 0
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: GK85431
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: EX41974
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: AV79521
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: LR65108
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: XL90476
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: CF79242
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CF79242%27 HTTP/1.1" 200 None
2026-03-30 11:28:52 [auto1.es] INFO: Scrape type for CF79242: 0
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: ZZ15598
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZZ15598%27 HTTP/1.1" 200 None
2026-03-30 11:28:52 [auto1.es] INFO: Scrape type for ZZ15598: 0
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: TF16142
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF16142%27 HTTP/1.1" 200 None
2026-03-30 11:28:52 [auto1.es] INFO: Scrape type for TF16142: 0
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: CW38943
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CW38943%27 HTTP/1.1" 200 None
2026-03-30 11:28:52 [auto1.es] INFO: Scrape type for CW38943: 0
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: CY26712
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: MT83895
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: EA09271
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EA09271%27 HTTP/1.1" 200 None
2026-03-30 11:28:52 [auto1.es] INFO: Scrape type for EA09271: 0
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: EW06270
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: TW27527
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW27527%27 HTTP/1.1" 200 None
2026-03-30 11:28:52 [auto1.es] INFO: Scrape type for TW27527: 0
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: GU79254
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU79254%27 HTTP/1.1" 200 None
2026-03-30 11:28:52 [auto1.es] INFO: Scrape type for GU79254: 0
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: EY19176
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: FV38056
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FV38056%27 HTTP/1.1" 200 None
2026-03-30 11:28:52 [auto1.es] INFO: Scrape type for FV38056: 0
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: DA52344
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DA52344%27 HTTP/1.1" 200 None
2026-03-30 11:28:52 [auto1.es] INFO: Scrape type for DA52344: 0
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: DG19356
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DG19356%27 HTTP/1.1" 200 None
2026-03-30 11:28:52 [auto1.es] INFO: Scrape type for DG19356: 0
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: WA77291
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA77291%27 HTTP/1.1" 200 None
2026-03-30 11:28:52 [auto1.es] INFO: Scrape type for WA77291: 0
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: HP73598
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HP73598%27 HTTP/1.1" 200 None
2026-03-30 11:28:52 [auto1.es] INFO: Scrape type for HP73598: 0
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: TY10266
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TY10266%27 HTTP/1.1" 200 None
2026-03-30 11:28:52 [auto1.es] INFO: Scrape type for TY10266: 0
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: SE47115
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SE47115%27 HTTP/1.1" 200 None
2026-03-30 11:28:52 [auto1.es] INFO: Scrape type for SE47115: 0
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: FX89085
2026-03-30 11:28:52 [auto1.es] INFO: Found listing with ID: DR86630
2026-03-30 11:28:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:28:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:28:53 [auto1.es] INFO: Channel: 24h | Page: 29 | totalHits: 2240 | hits on page: 40
2026-03-30 11:28:53 [auto1.es] INFO: Found listing with ID: ZR58264
2026-03-30 11:28:53 [auto1.es] INFO: Found listing with ID: CU50273
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CU50273%27 HTTP/1.1" 200 None
2026-03-30 11:28:53 [auto1.es] INFO: Scrape type for CU50273: 0
2026-03-30 11:28:53 [auto1.es] INFO: Found listing with ID: YG41867
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YG41867%27 HTTP/1.1" 200 None
2026-03-30 11:28:53 [auto1.es] INFO: Scrape type for YG41867: 0
2026-03-30 11:28:53 [auto1.es] INFO: Found listing with ID: JN05964
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JN05964%27 HTTP/1.1" 200 None
2026-03-30 11:28:53 [auto1.es] INFO: Scrape type for JN05964: 0
2026-03-30 11:28:53 [auto1.es] INFO: Found listing with ID: FM76074
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FM76074%27 HTTP/1.1" 200 None
2026-03-30 11:28:54 [auto1.es] INFO: Scrape type for FM76074: 0
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: ZN83644
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZN83644%27 HTTP/1.1" 200 None
2026-03-30 11:28:54 [auto1.es] INFO: Scrape type for ZN83644: 0
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: RR71682
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: KT37897
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KT37897%27 HTTP/1.1" 200 None
2026-03-30 11:28:54 [auto1.es] INFO: Scrape type for KT37897: 0
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: UH51284
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: BR06094
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BR06094%27 HTTP/1.1" 200 None
2026-03-30 11:28:54 [auto1.es] INFO: Scrape type for BR06094: 0
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: XV67448
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XV67448%27 HTTP/1.1" 200 None
2026-03-30 11:28:54 [auto1.es] INFO: Scrape type for XV67448: 0
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: DM90018
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DM90018%27 HTTP/1.1" 200 None
2026-03-30 11:28:54 [auto1.es] INFO: Scrape type for DM90018: 0
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: JS89296
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: FK22292
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK22292%27 HTTP/1.1" 200 None
2026-03-30 11:28:54 [auto1.es] INFO: Scrape type for FK22292: 0
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: XH26332
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH26332%27 HTTP/1.1" 200 None
2026-03-30 11:28:54 [auto1.es] INFO: Scrape type for XH26332: 0
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: HG08189
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HG08189%27 HTTP/1.1" 200 None
2026-03-30 11:28:54 [auto1.es] INFO: Scrape type for HG08189: 0
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: BU83574
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BU83574%27 HTTP/1.1" 200 None
2026-03-30 11:28:54 [auto1.es] INFO: Scrape type for BU83574: 0
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: JH71842
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JH71842%27 HTTP/1.1" 200 None
2026-03-30 11:28:54 [auto1.es] INFO: Scrape type for JH71842: 0
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: WV17945
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: DT10330
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DT10330%27 HTTP/1.1" 200 None
2026-03-30 11:28:54 [auto1.es] INFO: Scrape type for DT10330: 0
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: SH03418
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: BS83179
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BS83179%27 HTTP/1.1" 200 None
2026-03-30 11:28:54 [auto1.es] INFO: Scrape type for BS83179: 0
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: UP80890
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: DG65204
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: WN13849
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: GD28297
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GD28297%27 HTTP/1.1" 200 None
2026-03-30 11:28:54 [auto1.es] INFO: Scrape type for GD28297: 0
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: PK59036
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK59036%27 HTTP/1.1" 200 None
2026-03-30 11:28:54 [auto1.es] INFO: Scrape type for PK59036: 0
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: SL79064
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL79064%27 HTTP/1.1" 200 None
2026-03-30 11:28:54 [auto1.es] INFO: Scrape type for SL79064: 0
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: UB76587
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: XD48344
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XD48344%27 HTTP/1.1" 200 None
2026-03-30 11:28:54 [auto1.es] INFO: Scrape type for XD48344: 0
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: UV16090
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UV16090%27 HTTP/1.1" 200 None
2026-03-30 11:28:54 [auto1.es] INFO: Scrape type for UV16090: 0
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: WL36526
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: AU46465
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AU46465%27 HTTP/1.1" 200 None
2026-03-30 11:28:54 [auto1.es] INFO: Scrape type for AU46465: 0
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: XK54532
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: PZ76479
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: LD13903
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: HR86968
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: FG99809
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: VN33770
2026-03-30 11:28:54 [auto1.es] INFO: Found listing with ID: LC68552
2026-03-30 11:28:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:29:04 [scrapy.extensions.logstats] INFO: Crawled 207 pages (at 11 pages/min), scraped 220 items (at 4 items/min)
2026-03-30 11:29:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-30 11:29:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:29:06 [auto1.es] INFO: Channel: 24h | Page: 30 | totalHits: 2240 | hits on page: 40
2026-03-30 11:29:06 [auto1.es] INFO: Found listing with ID: RG83636
2026-03-30 11:29:06 [auto1.es] INFO: Found listing with ID: XT97336
2026-03-30 11:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XT97336%27 HTTP/1.1" 200 None
2026-03-30 11:29:06 [auto1.es] INFO: Scrape type for XT97336: 0
2026-03-30 11:29:06 [auto1.es] INFO: Found listing with ID: CM19424
2026-03-30 11:29:06 [auto1.es] INFO: Found listing with ID: CP78264
2026-03-30 11:29:06 [auto1.es] INFO: Found listing with ID: NR18889
2026-03-30 11:29:06 [auto1.es] INFO: Found listing with ID: BD30925
2026-03-30 11:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BD30925%27 HTTP/1.1" 200 None
2026-03-30 11:29:06 [auto1.es] INFO: Scrape type for BD30925: 0
2026-03-30 11:29:06 [auto1.es] INFO: Found listing with ID: JR87984
2026-03-30 11:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JR87984%27 HTTP/1.1" 200 None
2026-03-30 11:29:06 [auto1.es] INFO: Scrape type for JR87984: 0
2026-03-30 11:29:06 [auto1.es] INFO: Found listing with ID: YE53281
2026-03-30 11:29:06 [auto1.es] INFO: Found listing with ID: XL11781
2026-03-30 11:29:06 [auto1.es] INFO: Found listing with ID: TU71868
2026-03-30 11:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TU71868%27 HTTP/1.1" 200 None
2026-03-30 11:29:06 [auto1.es] INFO: Scrape type for TU71868: 0
2026-03-30 11:29:06 [auto1.es] INFO: Found listing with ID: KE29048
2026-03-30 11:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KE29048%27 HTTP/1.1" 200 None
2026-03-30 11:29:06 [auto1.es] INFO: Scrape type for KE29048: 0
2026-03-30 11:29:06 [auto1.es] INFO: Found listing with ID: SZ79556
2026-03-30 11:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SZ79556%27 HTTP/1.1" 200 None
2026-03-30 11:29:06 [auto1.es] INFO: Scrape type for SZ79556: 0
2026-03-30 11:29:06 [auto1.es] INFO: Found listing with ID: ZV95361
2026-03-30 11:29:06 [auto1.es] INFO: Found listing with ID: TT67656
2026-03-30 11:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TT67656%27 HTTP/1.1" 200 None
2026-03-30 11:29:06 [auto1.es] INFO: Scrape type for TT67656: 0
2026-03-30 11:29:06 [auto1.es] INFO: Found listing with ID: WA75456
2026-03-30 11:29:06 [auto1.es] INFO: Found listing with ID: ME86804
2026-03-30 11:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ME86804%27 HTTP/1.1" 200 None
2026-03-30 11:29:06 [auto1.es] INFO: Scrape type for ME86804: 0
2026-03-30 11:29:06 [auto1.es] INFO: Found listing with ID: WM80180
2026-03-30 11:29:06 [auto1.es] INFO: Found listing with ID: DY56989
2026-03-30 11:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DY56989%27 HTTP/1.1" 200 None
2026-03-30 11:29:06 [auto1.es] INFO: Scrape type for DY56989: 0
2026-03-30 11:29:06 [auto1.es] INFO: Found listing with ID: XS16270
2026-03-30 11:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XS16270%27 HTTP/1.1" 200 None
2026-03-30 11:29:06 [auto1.es] INFO: Scrape type for XS16270: 0
2026-03-30 11:29:06 [auto1.es] INFO: Found listing with ID: NE82558
2026-03-30 11:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NE82558%27 HTTP/1.1" 200 None
2026-03-30 11:29:06 [auto1.es] INFO: Scrape type for NE82558: 0
2026-03-30 11:29:06 [auto1.es] INFO: Found listing with ID: WA73273
2026-03-30 11:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA73273%27 HTTP/1.1" 200 None
2026-03-30 11:29:06 [auto1.es] INFO: Scrape type for WA73273: 0
2026-03-30 11:29:06 [auto1.es] INFO: Found listing with ID: TP06770
2026-03-30 11:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TP06770%27 HTTP/1.1" 200 None
2026-03-30 11:29:06 [auto1.es] INFO: Scrape type for TP06770: 0
2026-03-30 11:29:06 [auto1.es] INFO: Found listing with ID: JG96257
2026-03-30 11:29:06 [auto1.es] INFO: Found listing with ID: XX73025
2026-03-30 11:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XX73025%27 HTTP/1.1" 200 None
2026-03-30 11:29:06 [auto1.es] INFO: Scrape type for XX73025: 0
2026-03-30 11:29:06 [auto1.es] INFO: Found listing with ID: KL57529
2026-03-30 11:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL57529%27 HTTP/1.1" 200 None
2026-03-30 11:29:06 [auto1.es] INFO: Scrape type for KL57529: 0
2026-03-30 11:29:06 [auto1.es] INFO: Found listing with ID: CH60945
2026-03-30 11:29:06 [auto1.es] INFO: Found listing with ID: UV28052
2026-03-30 11:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UV28052%27 HTTP/1.1" 200 None
2026-03-30 11:29:06 [auto1.es] INFO: Scrape type for UV28052: 0
2026-03-30 11:29:06 [auto1.es] INFO: Found listing with ID: WK61099
2026-03-30 11:29:06 [auto1.es] INFO: Found listing with ID: ER43390
2026-03-30 11:29:06 [auto1.es] INFO: Found listing with ID: ZG91019
2026-03-30 11:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZG91019%27 HTTP/1.1" 200 None
2026-03-30 11:29:06 [auto1.es] INFO: Scrape type for ZG91019: 0
2026-03-30 11:29:06 [auto1.es] INFO: Found listing with ID: YA56979
2026-03-30 11:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YA56979%27 HTTP/1.1" 200 None
2026-03-30 11:29:07 [auto1.es] INFO: Scrape type for YA56979: 0
2026-03-30 11:29:07 [auto1.es] INFO: Found listing with ID: MM94561
2026-03-30 11:29:07 [auto1.es] INFO: Found listing with ID: CP55474
2026-03-30 11:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CP55474%27 HTTP/1.1" 200 None
2026-03-30 11:29:07 [auto1.es] INFO: Scrape type for CP55474: 0
2026-03-30 11:29:07 [auto1.es] INFO: Found listing with ID: EK02363
2026-03-30 11:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EK02363%27 HTTP/1.1" 200 None
2026-03-30 11:29:07 [auto1.es] INFO: Scrape type for EK02363: 0
2026-03-30 11:29:07 [auto1.es] INFO: Found listing with ID: RR37429
2026-03-30 11:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RR37429%27 HTTP/1.1" 200 None
2026-03-30 11:29:07 [auto1.es] INFO: Scrape type for RR37429: 0
2026-03-30 11:29:07 [auto1.es] INFO: Found listing with ID: FT14290
2026-03-30 11:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FT14290%27 HTTP/1.1" 200 None
2026-03-30 11:29:07 [auto1.es] INFO: Scrape type for FT14290: 0
2026-03-30 11:29:07 [auto1.es] INFO: Found listing with ID: MV51278
2026-03-30 11:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MV51278%27 HTTP/1.1" 200 None
2026-03-30 11:29:07 [auto1.es] INFO: Scrape type for MV51278: 0
2026-03-30 11:29:07 [auto1.es] INFO: Found listing with ID: TZ15382
2026-03-30 11:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TZ15382%27 HTTP/1.1" 200 None
2026-03-30 11:29:07 [auto1.es] INFO: Scrape type for TZ15382: 0
2026-03-30 11:29:07 [auto1.es] INFO: Found listing with ID: CH35723
2026-03-30 11:29:07 [auto1.es] INFO: Found listing with ID: BK94618
2026-03-30 11:29:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:29:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:29:15 [auto1.es] INFO: Channel: 24h | Page: 31 | totalHits: 2240 | hits on page: 40
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: XT80551
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: SL83785
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: RH48139
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RH48139%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.es] INFO: Scrape type for RH48139: 0
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: XU11405
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: VR07932
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VR07932%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.es] INFO: Scrape type for VR07932: 0
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: TZ59623
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TZ59623%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.es] INFO: Scrape type for TZ59623: 0
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: UZ58756
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: DK97910
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DK97910%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.es] INFO: Scrape type for DK97910: 0
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: TY54994
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TY54994%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.es] INFO: Scrape type for TY54994: 0
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: KJ62845
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KJ62845%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.es] INFO: Scrape type for KJ62845: 0
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: UU93913
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UU93913%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.es] INFO: Scrape type for UU93913: 0
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: RD73419
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: ZE78921
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: ZH97805
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZH97805%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.es] INFO: Scrape type for ZH97805: 0
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: GB64088
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GB64088%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.es] INFO: Scrape type for GB64088: 0
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: EC92168
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: DU03691
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DU03691%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.es] INFO: Scrape type for DU03691: 0
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: FY67843
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: LA22899
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: BK29060
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK29060%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.es] INFO: Scrape type for BK29060: 0
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: FE11610
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: MD24315
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD24315%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.es] INFO: Scrape type for MD24315: 0
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: DF11976
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DF11976%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.es] INFO: Scrape type for DF11976: 0
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: HL11989
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: EE18578
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EE18578%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.es] INFO: Scrape type for EE18578: 0
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: HV58793
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HV58793%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.es] INFO: Scrape type for HV58793: 0
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: AU82484
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: CL32416
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: JT03070
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: NE16283
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: CZ44348
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CZ44348%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.es] INFO: Scrape type for CZ44348: 0
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: ZA37078
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZA37078%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.es] INFO: Scrape type for ZA37078: 0
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: UE66949
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UE66949%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.es] INFO: Scrape type for UE66949: 0
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: UZ91236
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: CU24817
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: RR40846
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RR40846%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.es] INFO: Scrape type for RR40846: 0
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: UG21171
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG21171%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.es] INFO: Scrape type for UG21171: 0
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: GZ25501
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: AS83743
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AS83743%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.es] INFO: Scrape type for AS83743: 0
2026-03-30 11:29:15 [auto1.es] INFO: Found listing with ID: LS55149
2026-03-30 11:29:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:29:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:29:16 [auto1.es] INFO: Channel: 24h | Page: 32 | totalHits: 2240 | hits on page: 40
2026-03-30 11:29:16 [auto1.es] INFO: Found listing with ID: GT92698
2026-03-30 11:29:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT92698%27 HTTP/1.1" 200 None
2026-03-30 11:29:16 [auto1.es] INFO: Scrape type for GT92698: 2
2026-03-30 11:29:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4e00e5d-708c-54e2-96f5-1333b290b7df with identifier: GT92698
2026-03-30 11:29:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4e00e5d-708c-54e2-96f5-1333b290b7df with scrape type 2
2026-03-30 11:29:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4e00e5d-708c-54e2-96f5-1333b290b7df with scrape type 2
2026-03-30 11:29:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f4e00e5d-708c-54e2-96f5-1333b290b7df, identifier: GT92698
2026-03-30 11:29:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f4e00e5d-708c-54e2-96f5-1333b290b7df with identifier: GT92698
2026-03-30 11:29:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f4e00e5d-708c-54e2-96f5-1333b290b7df with identifier: GT92698
2026-03-30 11:29:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f4e00e5d-708c-54e2-96f5-1333b290b7df with identifier: GT92698 to the API
2026-03-30 11:29:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:29:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:29:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:39:25Z',
'fuel_type': 'diesel',
'id': 'f4e00e5d-708c-54e2-96f5-1333b290b7df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT92698',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 162100,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-18',
'seller_name': None,
'title': 'Seat Leon 2.0 TDI FR',
'transmission': 'manual',
'trim': 'FR',
'year': 2015}
2026-03-30 11:29:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT92698%27 HTTP/1.1" 200 None
2026-03-30 11:29:17 [auto1.es] INFO: Saving data for GT92698: {'auction_closing_time': 1774885165.0, 'created_time': 1773129145.288232, 'last_price_update_time': 1774870157.632522}
2026-03-30 11:29:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GT92698') HTTP/1.1" 204 0
2026-03-30 11:29:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:29:17 [auto1.es] INFO: Found listing with ID: PD21728
2026-03-30 11:29:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD21728%27 HTTP/1.1" 200 None
2026-03-30 11:29:17 [auto1.es] INFO: Scrape type for PD21728: 0
2026-03-30 11:29:17 [auto1.es] INFO: Found listing with ID: VD81677
2026-03-30 11:29:17 [auto1.es] INFO: Found listing with ID: YT10361
2026-03-30 11:29:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YT10361%27 HTTP/1.1" 200 None
2026-03-30 11:29:17 [auto1.es] INFO: Scrape type for YT10361: 0
2026-03-30 11:29:17 [auto1.es] INFO: Found listing with ID: ZD67493
2026-03-30 11:29:17 [auto1.es] INFO: Found listing with ID: XB61397
2026-03-30 11:29:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XB61397%27 HTTP/1.1" 200 None
2026-03-30 11:29:17 [auto1.es] INFO: Scrape type for XB61397: 2
2026-03-30 11:29:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49bb0525-113b-5646-ba80-2d5b396847cf with identifier: XB61397
2026-03-30 11:29:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49bb0525-113b-5646-ba80-2d5b396847cf with scrape type 2
2026-03-30 11:29:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49bb0525-113b-5646-ba80-2d5b396847cf with scrape type 2
2026-03-30 11:29:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 49bb0525-113b-5646-ba80-2d5b396847cf, identifier: XB61397
2026-03-30 11:29:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 49bb0525-113b-5646-ba80-2d5b396847cf with identifier: XB61397
2026-03-30 11:29:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 49bb0525-113b-5646-ba80-2d5b396847cf with identifier: XB61397
2026-03-30 11:29:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 49bb0525-113b-5646-ba80-2d5b396847cf with identifier: XB61397 to the API
2026-03-30 11:29:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:29:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:29:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:04:31Z',
'fuel_type': 'diesel',
'id': '49bb0525-113b-5646-ba80-2d5b396847cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB61397',
'listing': 'auction',
'make': 'Seat',
'model': 'Arona',
'odometer': 197742,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-26',
'seller_name': None,
'title': 'Seat Arona 1.6 TDI Reference',
'transmission': 'manual',
'trim': 'Reference',
'year': 2020}
2026-03-30 11:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XB61397%27 HTTP/1.1" 200 None
2026-03-30 11:29:18 [auto1.es] INFO: Saving data for XB61397: {'auction_closing_time': 1774883071.0, 'created_time': 1773401121.953824, 'last_price_update_time': 1774870158.162072}
2026-03-30 11:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XB61397') HTTP/1.1" 204 0
2026-03-30 11:29:18 [auto1.es] INFO: Found listing with ID: MX84470
2026-03-30 11:29:18 [auto1.es] INFO: Found listing with ID: FC07978
2026-03-30 11:29:18 [auto1.es] INFO: Found listing with ID: WW69130
2026-03-30 11:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WW69130%27 HTTP/1.1" 200 None
2026-03-30 11:29:18 [auto1.es] INFO: Scrape type for WW69130: 0
2026-03-30 11:29:18 [auto1.es] INFO: Found listing with ID: YX82549
2026-03-30 11:29:18 [auto1.es] INFO: Found listing with ID: TX02408
2026-03-30 11:29:18 [auto1.es] INFO: Found listing with ID: MT58185
2026-03-30 11:29:18 [auto1.es] INFO: Found listing with ID: JP19484
2026-03-30 11:29:18 [auto1.es] INFO: Found listing with ID: BM81559
2026-03-30 11:29:18 [auto1.es] INFO: Found listing with ID: CK76032
2026-03-30 11:29:18 [auto1.es] INFO: Found listing with ID: WV75018
2026-03-30 11:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WV75018%27 HTTP/1.1" 200 None
2026-03-30 11:29:18 [auto1.es] INFO: Scrape type for WV75018: 0
2026-03-30 11:29:18 [auto1.es] INFO: Found listing with ID: PG51774
2026-03-30 11:29:18 [auto1.es] INFO: Found listing with ID: PA43540
2026-03-30 11:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PA43540%27 HTTP/1.1" 200 None
2026-03-30 11:29:18 [auto1.es] INFO: Scrape type for PA43540: 0
2026-03-30 11:29:18 [auto1.es] INFO: Found listing with ID: CB03666
2026-03-30 11:29:18 [auto1.es] INFO: Found listing with ID: ZJ67299
2026-03-30 11:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZJ67299%27 HTTP/1.1" 200 None
2026-03-30 11:29:18 [auto1.es] INFO: Scrape type for ZJ67299: 0
2026-03-30 11:29:18 [auto1.es] INFO: Found listing with ID: ZN02005
2026-03-30 11:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZN02005%27 HTTP/1.1" 200 None
2026-03-30 11:29:18 [auto1.es] INFO: Scrape type for ZN02005: 0
2026-03-30 11:29:18 [auto1.es] INFO: Found listing with ID: MD81888
2026-03-30 11:29:18 [auto1.es] INFO: Found listing with ID: ZW95177
2026-03-30 11:29:18 [auto1.es] INFO: Found listing with ID: LC37713
2026-03-30 11:29:18 [auto1.es] INFO: Found listing with ID: BD22709
2026-03-30 11:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BD22709%27 HTTP/1.1" 200 None
2026-03-30 11:29:18 [auto1.es] INFO: Scrape type for BD22709: 0
2026-03-30 11:29:18 [auto1.es] INFO: Found listing with ID: VB81501
2026-03-30 11:29:18 [auto1.es] INFO: Found listing with ID: ZZ62546
2026-03-30 11:29:18 [auto1.es] INFO: Found listing with ID: FA71297
2026-03-30 11:29:18 [auto1.es] INFO: Found listing with ID: UV08458
2026-03-30 11:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UV08458%27 HTTP/1.1" 200 None
2026-03-30 11:29:18 [auto1.es] INFO: Scrape type for UV08458: 0
2026-03-30 11:29:18 [auto1.es] INFO: Found listing with ID: NL01395
2026-03-30 11:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NL01395%27 HTTP/1.1" 200 None
2026-03-30 11:29:18 [auto1.es] INFO: Scrape type for NL01395: 0
2026-03-30 11:29:18 [auto1.es] INFO: Found listing with ID: WA88394
2026-03-30 11:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA88394%27 HTTP/1.1" 200 None
2026-03-30 11:29:18 [auto1.es] INFO: Scrape type for WA88394: 0
2026-03-30 11:29:18 [auto1.es] INFO: Found listing with ID: VR45740
2026-03-30 11:29:18 [auto1.es] INFO: Found listing with ID: EZ05662
2026-03-30 11:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EZ05662%27 HTTP/1.1" 200 None
2026-03-30 11:29:18 [auto1.es] INFO: Scrape type for EZ05662: 0
2026-03-30 11:29:18 [auto1.es] INFO: Found listing with ID: UJ64573
2026-03-30 11:29:18 [auto1.es] INFO: Found listing with ID: TT52004
2026-03-30 11:29:18 [auto1.es] INFO: Found listing with ID: YW59434
2026-03-30 11:29:18 [auto1.es] INFO: Found listing with ID: DW22650
2026-03-30 11:29:18 [auto1.es] INFO: Found listing with ID: NL32920
2026-03-30 11:29:18 [auto1.es] INFO: Found listing with ID: XF10257
2026-03-30 11:29:18 [auto1.es] INFO: Found listing with ID: YT02265
2026-03-30 11:29:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:29:24 [auto1.es] INFO: Channel: 24h | Page: 33 | totalHits: 2241 | hits on page: 40
2026-03-30 11:29:24 [auto1.es] INFO: Found listing with ID: YT02265
2026-03-30 11:29:24 [auto1.es] INFO: Found listing with ID: TG66753
2026-03-30 11:29:24 [auto1.es] INFO: Found listing with ID: TH38754
2026-03-30 11:29:24 [auto1.es] INFO: Found listing with ID: CM92438
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CM92438%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.es] INFO: Scrape type for CM92438: 0
2026-03-30 11:29:24 [auto1.es] INFO: Found listing with ID: BX60688
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BX60688%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.es] INFO: Scrape type for BX60688: 0
2026-03-30 11:29:24 [auto1.es] INFO: Found listing with ID: ER91055
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ER91055%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.es] INFO: Scrape type for ER91055: 0
2026-03-30 11:29:24 [auto1.es] INFO: Found listing with ID: ES48862
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ES48862%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.es] INFO: Scrape type for ES48862: 0
2026-03-30 11:29:24 [auto1.es] INFO: Found listing with ID: TV58646
2026-03-30 11:29:24 [auto1.es] INFO: Found listing with ID: PK58195
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK58195%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.es] INFO: Scrape type for PK58195: 0
2026-03-30 11:29:24 [auto1.es] INFO: Found listing with ID: BC07750
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BC07750%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.es] INFO: Scrape type for BC07750: 0
2026-03-30 11:29:24 [auto1.es] INFO: Found listing with ID: TV36726
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV36726%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.es] INFO: Scrape type for TV36726: 0
2026-03-30 11:29:24 [auto1.es] INFO: Found listing with ID: RU11910
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RU11910%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.es] INFO: Scrape type for RU11910: 0
2026-03-30 11:29:24 [auto1.es] INFO: Found listing with ID: KL17939
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL17939%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.es] INFO: Scrape type for KL17939: 0
2026-03-30 11:29:24 [auto1.es] INFO: Found listing with ID: XH50909
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH50909%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.es] INFO: Scrape type for XH50909: 0
2026-03-30 11:29:24 [auto1.es] INFO: Found listing with ID: XE30764
2026-03-30 11:29:24 [auto1.es] INFO: Found listing with ID: UZ86093
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UZ86093%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.es] INFO: Scrape type for UZ86093: 0
2026-03-30 11:29:24 [auto1.es] INFO: Found listing with ID: KE66826
2026-03-30 11:29:24 [auto1.es] INFO: Found listing with ID: GT72542
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT72542%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.es] INFO: Scrape type for GT72542: 0
2026-03-30 11:29:24 [auto1.es] INFO: Found listing with ID: TW93253
2026-03-30 11:29:24 [auto1.es] INFO: Found listing with ID: ZZ72823
2026-03-30 11:29:24 [auto1.es] INFO: Found listing with ID: ZE41555
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZE41555%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.es] INFO: Scrape type for ZE41555: 0
2026-03-30 11:29:24 [auto1.es] INFO: Found listing with ID: SB32545
2026-03-30 11:29:24 [auto1.es] INFO: Found listing with ID: UG14230
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG14230%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.es] INFO: Scrape type for UG14230: 0
2026-03-30 11:29:24 [auto1.es] INFO: Found listing with ID: US15459
2026-03-30 11:29:24 [auto1.es] INFO: Found listing with ID: VC98401
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC98401%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.es] INFO: Scrape type for VC98401: 0
2026-03-30 11:29:24 [auto1.es] INFO: Found listing with ID: VJ61689
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VJ61689%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.es] INFO: Scrape type for VJ61689: 0
2026-03-30 11:29:24 [auto1.es] INFO: Found listing with ID: MA92923
2026-03-30 11:29:24 [auto1.es] INFO: Found listing with ID: TZ36663
2026-03-30 11:29:24 [auto1.es] INFO: Found listing with ID: RK72644
2026-03-30 11:29:24 [auto1.es] INFO: Found listing with ID: GT49964
2026-03-30 11:29:24 [auto1.es] INFO: Found listing with ID: XW07664
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XW07664%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.es] INFO: Scrape type for XW07664: 0
2026-03-30 11:29:24 [auto1.es] INFO: Found listing with ID: UR00464
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UR00464%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.es] INFO: Scrape type for UR00464: 0
2026-03-30 11:29:24 [auto1.es] INFO: Found listing with ID: FA05952
2026-03-30 11:29:24 [auto1.es] INFO: Found listing with ID: HA22815
2026-03-30 11:29:24 [auto1.es] INFO: Found listing with ID: KT28524
2026-03-30 11:29:24 [auto1.es] INFO: Found listing with ID: BZ29136
2026-03-30 11:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BZ29136%27 HTTP/1.1" 200 None
2026-03-30 11:29:25 [auto1.es] INFO: Scrape type for BZ29136: 0
2026-03-30 11:29:25 [auto1.es] INFO: Found listing with ID: US76988
2026-03-30 11:29:25 [auto1.es] INFO: Found listing with ID: ZA28450
2026-03-30 11:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZA28450%27 HTTP/1.1" 200 None
2026-03-30 11:29:25 [auto1.es] INFO: Scrape type for ZA28450: 0
2026-03-30 11:29:25 [auto1.es] INFO: Found listing with ID: XY35870
2026-03-30 11:29:25 [auto1.es] INFO: Found listing with ID: MB16167
2026-03-30 11:29:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:29:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:29:27 [auto1.es] INFO: Channel: 24h | Page: 34 | totalHits: 2241 | hits on page: 40
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: SD86160
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SD86160%27 HTTP/1.1" 200 None
2026-03-30 11:29:27 [auto1.es] INFO: Scrape type for SD86160: 0
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: UT04175
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: KK78857
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: GP92404
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: NJ25414
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NJ25414%27 HTTP/1.1" 200 None
2026-03-30 11:29:27 [auto1.es] INFO: Scrape type for NJ25414: 0
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: MZ66022
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: ZD85047
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD85047%27 HTTP/1.1" 200 None
2026-03-30 11:29:27 [auto1.es] INFO: Scrape type for ZD85047: 0
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: TV99660
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: LE09183
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: MK04112
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: GF91510
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: DH50359
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH50359%27 HTTP/1.1" 200 None
2026-03-30 11:29:27 [auto1.es] INFO: Scrape type for DH50359: 0
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: CY33639
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CY33639%27 HTTP/1.1" 200 None
2026-03-30 11:29:27 [auto1.es] INFO: Scrape type for CY33639: 0
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: MV66149
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: TH42321
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: YN87603
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: VY79156
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY79156%27 HTTP/1.1" 200 None
2026-03-30 11:29:27 [auto1.es] INFO: Scrape type for VY79156: 0
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: ZD98631
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: WF38269
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: ZP63371
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZP63371%27 HTTP/1.1" 200 None
2026-03-30 11:29:27 [auto1.es] INFO: Scrape type for ZP63371: 0
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: LN79000
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: AR66930
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: UY91237
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: NF50225
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NF50225%27 HTTP/1.1" 200 None
2026-03-30 11:29:27 [auto1.es] INFO: Scrape type for NF50225: 0
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: BW95892
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: WJ41546
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: EV24986
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EV24986%27 HTTP/1.1" 200 None
2026-03-30 11:29:27 [auto1.es] INFO: Scrape type for EV24986: 0
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: AK39366
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AK39366%27 HTTP/1.1" 200 None
2026-03-30 11:29:27 [auto1.es] INFO: Scrape type for AK39366: 0
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: CV55647
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: MP42129
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MP42129%27 HTTP/1.1" 200 None
2026-03-30 11:29:27 [auto1.es] INFO: Scrape type for MP42129: 0
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: US62841
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: ZF52825
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: ZT28887
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZT28887%27 HTTP/1.1" 200 None
2026-03-30 11:29:27 [auto1.es] INFO: Scrape type for ZT28887: 0
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: RU33051
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RU33051%27 HTTP/1.1" 200 None
2026-03-30 11:29:27 [auto1.es] INFO: Scrape type for RU33051: 0
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: RE88096
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: AB11386
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AB11386%27 HTTP/1.1" 200 None
2026-03-30 11:29:27 [auto1.es] INFO: Scrape type for AB11386: 0
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: ZZ54358
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: MZ44217
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: CE45579
2026-03-30 11:29:27 [auto1.es] INFO: Found listing with ID: NT36194
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NT36194%27 HTTP/1.1" 200 None
2026-03-30 11:29:27 [auto1.es] INFO: Scrape type for NT36194: 0
2026-03-30 11:29:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:29:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:29:29 [auto1.es] INFO: Channel: 24h | Page: 35 | totalHits: 2241 | hits on page: 40
2026-03-30 11:29:29 [auto1.es] INFO: Found listing with ID: FB55193
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FB55193%27 HTTP/1.1" 200 None
2026-03-30 11:29:29 [auto1.es] INFO: Scrape type for FB55193: 0
2026-03-30 11:29:29 [auto1.es] INFO: Found listing with ID: MR81111
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MR81111%27 HTTP/1.1" 200 None
2026-03-30 11:29:29 [auto1.es] INFO: Scrape type for MR81111: 0
2026-03-30 11:29:29 [auto1.es] INFO: Found listing with ID: WS59204
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WS59204%27 HTTP/1.1" 200 None
2026-03-30 11:29:29 [auto1.es] INFO: Scrape type for WS59204: 0
2026-03-30 11:29:29 [auto1.es] INFO: Found listing with ID: NN13578
2026-03-30 11:29:29 [auto1.es] INFO: Found listing with ID: NB97215
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NB97215%27 HTTP/1.1" 200 None
2026-03-30 11:29:29 [auto1.es] INFO: Scrape type for NB97215: 0
2026-03-30 11:29:29 [auto1.es] INFO: Found listing with ID: JM88117
2026-03-30 11:29:29 [auto1.es] INFO: Found listing with ID: BB64860
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BB64860%27 HTTP/1.1" 200 None
2026-03-30 11:29:29 [auto1.es] INFO: Scrape type for BB64860: 0
2026-03-30 11:29:29 [auto1.es] INFO: Found listing with ID: MN42055
2026-03-30 11:29:29 [auto1.es] INFO: Found listing with ID: UM01301
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UM01301%27 HTTP/1.1" 200 None
2026-03-30 11:29:29 [auto1.es] INFO: Scrape type for UM01301: 0
2026-03-30 11:29:29 [auto1.es] INFO: Found listing with ID: DA46223
2026-03-30 11:29:29 [auto1.es] INFO: Found listing with ID: EK86006
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EK86006%27 HTTP/1.1" 200 None
2026-03-30 11:29:29 [auto1.es] INFO: Scrape type for EK86006: 0
2026-03-30 11:29:29 [auto1.es] INFO: Found listing with ID: JB16763
2026-03-30 11:29:29 [auto1.es] INFO: Found listing with ID: XT42288
2026-03-30 11:29:29 [auto1.es] INFO: Found listing with ID: VM06943
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VM06943%27 HTTP/1.1" 200 None
2026-03-30 11:29:29 [auto1.es] INFO: Scrape type for VM06943: 2
2026-03-30 11:29:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ae10540-fbab-561b-a6f1-536f23699ace with identifier: VM06943
2026-03-30 11:29:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ae10540-fbab-561b-a6f1-536f23699ace with scrape type 2
2026-03-30 11:29:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ae10540-fbab-561b-a6f1-536f23699ace with scrape type 2
2026-03-30 11:29:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3ae10540-fbab-561b-a6f1-536f23699ace, identifier: VM06943
2026-03-30 11:29:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3ae10540-fbab-561b-a6f1-536f23699ace with identifier: VM06943
2026-03-30 11:29:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3ae10540-fbab-561b-a6f1-536f23699ace with identifier: VM06943
2026-03-30 11:29:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3ae10540-fbab-561b-a6f1-536f23699ace with identifier: VM06943 to the API
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:29:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:40:55Z',
'fuel_type': 'diesel',
'id': '3ae10540-fbab-561b-a6f1-536f23699ace',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM06943',
'listing': 'auction',
'make': 'Toyota',
'model': 'Urban Cruiser',
'odometer': 123855,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-11-16',
'seller_name': None,
'title': 'Toyota Urban Cruiser 1.4 D-4D Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2009}
2026-03-30 11:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VM06943%27 HTTP/1.1" 200 None
2026-03-30 11:29:30 [auto1.es] INFO: Saving data for VM06943: {'auction_closing_time': 1774885255.0, 'created_time': 1774015762.498321, 'last_price_update_time': 1774870170.017049}
2026-03-30 11:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VM06943') HTTP/1.1" 204 0
2026-03-30 11:29:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:29:30 [auto1.es] INFO: Found listing with ID: BB29813
2026-03-30 11:29:30 [auto1.es] INFO: Found listing with ID: EE09579
2026-03-30 11:29:30 [auto1.es] INFO: Found listing with ID: YU03196
2026-03-30 11:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU03196%27 HTTP/1.1" 200 None
2026-03-30 11:29:30 [auto1.es] INFO: Scrape type for YU03196: 0
2026-03-30 11:29:30 [auto1.es] INFO: Found listing with ID: HU12913
2026-03-30 11:29:30 [auto1.es] INFO: Found listing with ID: WZ44927
2026-03-30 11:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ44927%27 HTTP/1.1" 200 None
2026-03-30 11:29:30 [auto1.es] INFO: Scrape type for WZ44927: 0
2026-03-30 11:29:30 [auto1.es] INFO: Found listing with ID: UG25415
2026-03-30 11:29:30 [auto1.es] INFO: Found listing with ID: LJ64414
2026-03-30 11:29:30 [auto1.es] INFO: Found listing with ID: DV40298
2026-03-30 11:29:30 [auto1.es] INFO: Found listing with ID: BV69737
2026-03-30 11:29:30 [auto1.es] INFO: Found listing with ID: FJ09985
2026-03-30 11:29:30 [auto1.es] INFO: Found listing with ID: XT49013
2026-03-30 11:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XT49013%27 HTTP/1.1" 200 None
2026-03-30 11:29:30 [auto1.es] INFO: Scrape type for XT49013: 0
2026-03-30 11:29:30 [auto1.es] INFO: Found listing with ID: BM13295
2026-03-30 11:29:30 [auto1.es] INFO: Found listing with ID: JF42327
2026-03-30 11:29:30 [auto1.es] INFO: Found listing with ID: NT66217
2026-03-30 11:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NT66217%27 HTTP/1.1" 200 None
2026-03-30 11:29:30 [auto1.es] INFO: Scrape type for NT66217: 0
2026-03-30 11:29:30 [auto1.es] INFO: Found listing with ID: UE32558
2026-03-30 11:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UE32558%27 HTTP/1.1" 200 None
2026-03-30 11:29:30 [auto1.es] INFO: Scrape type for UE32558: 0
2026-03-30 11:29:30 [auto1.es] INFO: Found listing with ID: FZ71320
2026-03-30 11:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FZ71320%27 HTTP/1.1" 200 None
2026-03-30 11:29:30 [auto1.es] INFO: Scrape type for FZ71320: 0
2026-03-30 11:29:30 [auto1.es] INFO: Found listing with ID: SR43030
2026-03-30 11:29:30 [auto1.es] INFO: Found listing with ID: VP11478
2026-03-30 11:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VP11478%27 HTTP/1.1" 200 None
2026-03-30 11:29:30 [auto1.es] INFO: Scrape type for VP11478: 0
2026-03-30 11:29:30 [auto1.es] INFO: Found listing with ID: TJ92656
2026-03-30 11:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TJ92656%27 HTTP/1.1" 200 None
2026-03-30 11:29:30 [auto1.es] INFO: Scrape type for TJ92656: 0
2026-03-30 11:29:30 [auto1.es] INFO: Found listing with ID: EB93661
2026-03-30 11:29:30 [auto1.es] INFO: Found listing with ID: AE79363
2026-03-30 11:29:30 [auto1.es] INFO: Found listing with ID: AR16993
2026-03-30 11:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR16993%27 HTTP/1.1" 200 None
2026-03-30 11:29:30 [auto1.es] INFO: Scrape type for AR16993: 0
2026-03-30 11:29:30 [auto1.es] INFO: Found listing with ID: RP83421
2026-03-30 11:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RP83421%27 HTTP/1.1" 200 None
2026-03-30 11:29:30 [auto1.es] INFO: Scrape type for RP83421: 0
2026-03-30 11:29:30 [auto1.es] INFO: Found listing with ID: EB96855
2026-03-30 11:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB96855%27 HTTP/1.1" 200 None
2026-03-30 11:29:30 [auto1.es] INFO: Scrape type for EB96855: 0
2026-03-30 11:29:30 [auto1.es] INFO: Found listing with ID: SU20973
2026-03-30 11:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SU20973%27 HTTP/1.1" 200 None
2026-03-30 11:29:30 [auto1.es] INFO: Scrape type for SU20973: 0
2026-03-30 11:29:30 [auto1.es] INFO: Found listing with ID: JM72010
2026-03-30 11:29:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:29:45 [auto1.es] INFO: Channel: 24h | Page: 36 | totalHits: 2241 | hits on page: 40
2026-03-30 11:29:45 [auto1.es] INFO: Found listing with ID: AZ15880
2026-03-30 11:29:45 [auto1.es] INFO: Found listing with ID: UD80780
2026-03-30 11:29:45 [auto1.es] INFO: Found listing with ID: KK58093
2026-03-30 11:29:45 [auto1.es] INFO: Found listing with ID: HA25095
2026-03-30 11:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA25095%27 HTTP/1.1" 200 None
2026-03-30 11:29:45 [auto1.es] INFO: Scrape type for HA25095: 0
2026-03-30 11:29:45 [auto1.es] INFO: Found listing with ID: DW27035
2026-03-30 11:29:45 [auto1.es] INFO: Found listing with ID: ZG18454
2026-03-30 11:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZG18454%27 HTTP/1.1" 200 None
2026-03-30 11:29:45 [auto1.es] INFO: Scrape type for ZG18454: 0
2026-03-30 11:29:45 [auto1.es] INFO: Found listing with ID: XV58633
2026-03-30 11:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XV58633%27 HTTP/1.1" 200 None
2026-03-30 11:29:45 [auto1.es] INFO: Scrape type for XV58633: 2
2026-03-30 11:29:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7ff0c00-b5b8-5152-b53d-cbfe1c659ea1 with identifier: XV58633
2026-03-30 11:29:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7ff0c00-b5b8-5152-b53d-cbfe1c659ea1 with scrape type 2
2026-03-30 11:29:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7ff0c00-b5b8-5152-b53d-cbfe1c659ea1 with scrape type 2
2026-03-30 11:29:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b7ff0c00-b5b8-5152-b53d-cbfe1c659ea1, identifier: XV58633
2026-03-30 11:29:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b7ff0c00-b5b8-5152-b53d-cbfe1c659ea1 with identifier: XV58633
2026-03-30 11:29:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b7ff0c00-b5b8-5152-b53d-cbfe1c659ea1 with identifier: XV58633
2026-03-30 11:29:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b7ff0c00-b5b8-5152-b53d-cbfe1c659ea1 with identifier: XV58633 to the API
2026-03-30 11:29:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:29:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:29:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-30T15:01:17Z',
'fuel_type': 'petrol',
'id': 'b7ff0c00-b5b8-5152-b53d-cbfe1c659ea1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV58633',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 89089,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-18',
'seller_name': None,
'title': 'Citroen C3 1.0 VTi Tonic',
'transmission': 'manual',
'trim': 'Tonic',
'year': 2016}
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XV58633%27 HTTP/1.1" 200 None
2026-03-30 11:29:47 [auto1.es] INFO: Saving data for XV58633: {'auction_closing_time': 1774882877.0, 'created_time': 1773129445.32288, 'last_price_update_time': 1774870187.086219}
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XV58633') HTTP/1.1" 204 0
2026-03-30 11:29:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:29:47 [auto1.es] INFO: Found listing with ID: FJ32217
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FJ32217%27 HTTP/1.1" 200 None
2026-03-30 11:29:47 [auto1.es] INFO: Scrape type for FJ32217: 0
2026-03-30 11:29:47 [auto1.es] INFO: Found listing with ID: LB05915
2026-03-30 11:29:47 [auto1.es] INFO: Found listing with ID: JJ54433
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JJ54433%27 HTTP/1.1" 200 None
2026-03-30 11:29:47 [auto1.es] INFO: Scrape type for JJ54433: 0
2026-03-30 11:29:47 [auto1.es] INFO: Found listing with ID: PW99692
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PW99692%27 HTTP/1.1" 200 None
2026-03-30 11:29:47 [auto1.es] INFO: Scrape type for PW99692: 0
2026-03-30 11:29:47 [auto1.es] INFO: Found listing with ID: AW04396
2026-03-30 11:29:47 [auto1.es] INFO: Found listing with ID: RT81282
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RT81282%27 HTTP/1.1" 200 None
2026-03-30 11:29:47 [auto1.es] INFO: Scrape type for RT81282: 0
2026-03-30 11:29:47 [auto1.es] INFO: Found listing with ID: SN13846
2026-03-30 11:29:47 [auto1.es] INFO: Found listing with ID: SE78782
2026-03-30 11:29:47 [auto1.es] INFO: Found listing with ID: YG58121
2026-03-30 11:29:47 [auto1.es] INFO: Found listing with ID: YX61230
2026-03-30 11:29:47 [auto1.es] INFO: Found listing with ID: ZJ79467
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZJ79467%27 HTTP/1.1" 200 None
2026-03-30 11:29:47 [auto1.es] INFO: Scrape type for ZJ79467: 0
2026-03-30 11:29:47 [auto1.es] INFO: Found listing with ID: DX86055
2026-03-30 11:29:47 [auto1.es] INFO: Found listing with ID: RM79142
2026-03-30 11:29:47 [auto1.es] INFO: Found listing with ID: TC70621
2026-03-30 11:29:47 [auto1.es] INFO: Found listing with ID: MC49666
2026-03-30 11:29:47 [auto1.es] INFO: Found listing with ID: HZ02297
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HZ02297%27 HTTP/1.1" 200 None
2026-03-30 11:29:47 [auto1.es] INFO: Scrape type for HZ02297: 0
2026-03-30 11:29:47 [auto1.es] INFO: Found listing with ID: AG74382
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG74382%27 HTTP/1.1" 200 None
2026-03-30 11:29:47 [auto1.es] INFO: Scrape type for AG74382: 0
2026-03-30 11:29:47 [auto1.es] INFO: Found listing with ID: HU25614
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HU25614%27 HTTP/1.1" 200 None
2026-03-30 11:29:47 [auto1.es] INFO: Scrape type for HU25614: 0
2026-03-30 11:29:47 [auto1.es] INFO: Found listing with ID: KE44681
2026-03-30 11:29:47 [auto1.es] INFO: Found listing with ID: GS59468
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GS59468%27 HTTP/1.1" 200 None
2026-03-30 11:29:47 [auto1.es] INFO: Scrape type for GS59468: 0
2026-03-30 11:29:47 [auto1.es] INFO: Found listing with ID: AV97332
2026-03-30 11:29:47 [auto1.es] INFO: Found listing with ID: EH44076
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EH44076%27 HTTP/1.1" 200 None
2026-03-30 11:29:47 [auto1.es] INFO: Scrape type for EH44076: 0
2026-03-30 11:29:47 [auto1.es] INFO: Found listing with ID: HJ75824
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HJ75824%27 HTTP/1.1" 200 None
2026-03-30 11:29:47 [auto1.es] INFO: Scrape type for HJ75824: 0
2026-03-30 11:29:47 [auto1.es] INFO: Found listing with ID: PE24027
2026-03-30 11:29:47 [auto1.es] INFO: Found listing with ID: HB55085
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HB55085%27 HTTP/1.1" 200 None
2026-03-30 11:29:47 [auto1.es] INFO: Scrape type for HB55085: 0
2026-03-30 11:29:47 [auto1.es] INFO: Found listing with ID: ZL28914
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL28914%27 HTTP/1.1" 200 None
2026-03-30 11:29:47 [auto1.es] INFO: Scrape type for ZL28914: 0
2026-03-30 11:29:47 [auto1.es] INFO: Found listing with ID: VE50785
2026-03-30 11:29:47 [auto1.es] INFO: Found listing with ID: SH67409
2026-03-30 11:29:47 [auto1.es] INFO: Found listing with ID: PJ00608
2026-03-30 11:29:47 [auto1.es] INFO: Found listing with ID: LX82632
2026-03-30 11:29:47 [auto1.es] INFO: Found listing with ID: RY19109
2026-03-30 11:29:47 [auto1.es] INFO: Found listing with ID: RK31632
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK31632%27 HTTP/1.1" 200 None
2026-03-30 11:29:47 [auto1.es] INFO: Scrape type for RK31632: 0
2026-03-30 11:29:47 [auto1.es] INFO: Found listing with ID: RH35807
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RH35807%27 HTTP/1.1" 200 None
2026-03-30 11:29:47 [auto1.es] INFO: Scrape type for RH35807: 0
2026-03-30 11:29:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:29:59 [auto1.es] INFO: Channel: 24h | Page: 37 | totalHits: 2242 | hits on page: 40
2026-03-30 11:29:59 [auto1.es] INFO: Found listing with ID: RH35807
2026-03-30 11:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RH35807%27 HTTP/1.1" 200 None
2026-03-30 11:29:59 [auto1.es] INFO: Scrape type for RH35807: 0
2026-03-30 11:29:59 [auto1.es] INFO: Found listing with ID: ZA80784
2026-03-30 11:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZA80784%27 HTTP/1.1" 200 None
2026-03-30 11:29:59 [auto1.es] INFO: Scrape type for ZA80784: 0
2026-03-30 11:29:59 [auto1.es] INFO: Found listing with ID: AP01935
2026-03-30 11:29:59 [auto1.es] INFO: Found listing with ID: HA98182
2026-03-30 11:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA98182%27 HTTP/1.1" 200 None
2026-03-30 11:29:59 [auto1.es] INFO: Scrape type for HA98182: 0
2026-03-30 11:29:59 [auto1.es] INFO: Found listing with ID: NG74473
2026-03-30 11:29:59 [auto1.es] INFO: Found listing with ID: HB38669
2026-03-30 11:29:59 [auto1.es] INFO: Found listing with ID: WH24419
2026-03-30 11:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WH24419%27 HTTP/1.1" 200 None
2026-03-30 11:29:59 [auto1.es] INFO: Scrape type for WH24419: 0
2026-03-30 11:29:59 [auto1.es] INFO: Found listing with ID: GF99536
2026-03-30 11:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF99536%27 HTTP/1.1" 200 None
2026-03-30 11:29:59 [auto1.es] INFO: Scrape type for GF99536: 0
2026-03-30 11:29:59 [auto1.es] INFO: Found listing with ID: JX70017
2026-03-30 11:29:59 [auto1.es] INFO: Found listing with ID: PL21143
2026-03-30 11:29:59 [auto1.es] INFO: Found listing with ID: GZ61403
2026-03-30 11:29:59 [auto1.es] INFO: Found listing with ID: PD17011
2026-03-30 11:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD17011%27 HTTP/1.1" 200 None
2026-03-30 11:29:59 [auto1.es] INFO: Scrape type for PD17011: 0
2026-03-30 11:29:59 [auto1.es] INFO: Found listing with ID: CW88498
2026-03-30 11:29:59 [auto1.es] INFO: Found listing with ID: RT90695
2026-03-30 11:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RT90695%27 HTTP/1.1" 200 None
2026-03-30 11:29:59 [auto1.es] INFO: Scrape type for RT90695: 0
2026-03-30 11:29:59 [auto1.es] INFO: Found listing with ID: BF22404
2026-03-30 11:29:59 [auto1.es] INFO: Found listing with ID: BL42593
2026-03-30 11:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BL42593%27 HTTP/1.1" 200 None
2026-03-30 11:29:59 [auto1.es] INFO: Scrape type for BL42593: 0
2026-03-30 11:29:59 [auto1.es] INFO: Found listing with ID: HG47154
2026-03-30 11:29:59 [auto1.es] INFO: Found listing with ID: SM50481
2026-03-30 11:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SM50481%27 HTTP/1.1" 200 None
2026-03-30 11:29:59 [auto1.es] INFO: Scrape type for SM50481: 0
2026-03-30 11:29:59 [auto1.es] INFO: Found listing with ID: KG64326
2026-03-30 11:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KG64326%27 HTTP/1.1" 200 None
2026-03-30 11:29:59 [auto1.es] INFO: Scrape type for KG64326: 0
2026-03-30 11:29:59 [auto1.es] INFO: Found listing with ID: HF28057
2026-03-30 11:29:59 [auto1.es] INFO: Found listing with ID: AD15625
2026-03-30 11:29:59 [auto1.es] INFO: Found listing with ID: DV59548
2026-03-30 11:29:59 [auto1.es] INFO: Found listing with ID: XC28006
2026-03-30 11:29:59 [auto1.es] INFO: Found listing with ID: GT68357
2026-03-30 11:29:59 [auto1.es] INFO: Found listing with ID: MZ54464
2026-03-30 11:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MZ54464%27 HTTP/1.1" 200 None
2026-03-30 11:29:59 [auto1.es] INFO: Scrape type for MZ54464: 0
2026-03-30 11:29:59 [auto1.es] INFO: Found listing with ID: NM44751
2026-03-30 11:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM44751%27 HTTP/1.1" 200 None
2026-03-30 11:29:59 [auto1.es] INFO: Scrape type for NM44751: 2
2026-03-30 11:29:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b607508-05c7-539f-a281-a1b9646b5769 with identifier: NM44751
2026-03-30 11:29:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b607508-05c7-539f-a281-a1b9646b5769 with scrape type 2
2026-03-30 11:29:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b607508-05c7-539f-a281-a1b9646b5769 with scrape type 2
2026-03-30 11:30:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9b607508-05c7-539f-a281-a1b9646b5769, identifier: NM44751
2026-03-30 11:30:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9b607508-05c7-539f-a281-a1b9646b5769 with identifier: NM44751
2026-03-30 11:30:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9b607508-05c7-539f-a281-a1b9646b5769 with identifier: NM44751
2026-03-30 11:30:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9b607508-05c7-539f-a281-a1b9646b5769 with identifier: NM44751 to the API
2026-03-30 11:30:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:30:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:30:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:51:36Z',
'fuel_type': 'diesel',
'id': '9b607508-05c7-539f-a281-a1b9646b5769',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM44751',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 251509,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-04-10',
'seller_name': None,
'title': 'Seat Leon 1.9 TDI Reference',
'transmission': 'manual',
'trim': 'Reference',
'year': 2006}
2026-03-30 11:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM44751%27 HTTP/1.1" 200 None
2026-03-30 11:30:00 [auto1.es] INFO: Saving data for NM44751: {'auction_closing_time': 1774885896.0, 'created_time': 1773400149.882344, 'last_price_update_time': 1774870200.492465}
2026-03-30 11:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NM44751') HTTP/1.1" 204 0
2026-03-30 11:30:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:30:00 [auto1.es] INFO: Found listing with ID: ZP51440
2026-03-30 11:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZP51440%27 HTTP/1.1" 200 None
2026-03-30 11:30:00 [auto1.es] INFO: Scrape type for ZP51440: 0
2026-03-30 11:30:00 [auto1.es] INFO: Found listing with ID: MM77073
2026-03-30 11:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MM77073%27 HTTP/1.1" 200 None
2026-03-30 11:30:00 [auto1.es] INFO: Scrape type for MM77073: 0
2026-03-30 11:30:00 [auto1.es] INFO: Found listing with ID: AK44201
2026-03-30 11:30:00 [auto1.es] INFO: Found listing with ID: GT62572
2026-03-30 11:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT62572%27 HTTP/1.1" 200 None
2026-03-30 11:30:00 [auto1.es] INFO: Scrape type for GT62572: 0
2026-03-30 11:30:00 [auto1.es] INFO: Found listing with ID: XC60196
2026-03-30 11:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC60196%27 HTTP/1.1" 200 None
2026-03-30 11:30:00 [auto1.es] INFO: Scrape type for XC60196: 0
2026-03-30 11:30:00 [auto1.es] INFO: Found listing with ID: XT74556
2026-03-30 11:30:00 [auto1.es] INFO: Found listing with ID: YM46867
2026-03-30 11:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YM46867%27 HTTP/1.1" 200 None
2026-03-30 11:30:00 [auto1.es] INFO: Scrape type for YM46867: 0
2026-03-30 11:30:00 [auto1.es] INFO: Found listing with ID: WH83968
2026-03-30 11:30:00 [auto1.es] INFO: Found listing with ID: KS63423
2026-03-30 11:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KS63423%27 HTTP/1.1" 200 None
2026-03-30 11:30:00 [auto1.es] INFO: Scrape type for KS63423: 0
2026-03-30 11:30:00 [auto1.es] INFO: Found listing with ID: KP83247
2026-03-30 11:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KP83247%27 HTTP/1.1" 200 None
2026-03-30 11:30:00 [auto1.es] INFO: Scrape type for KP83247: 0
2026-03-30 11:30:00 [auto1.es] INFO: Found listing with ID: ET28977
2026-03-30 11:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ET28977%27 HTTP/1.1" 200 None
2026-03-30 11:30:00 [auto1.es] INFO: Scrape type for ET28977: 0
2026-03-30 11:30:00 [auto1.es] INFO: Found listing with ID: GM08675
2026-03-30 11:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GM08675%27 HTTP/1.1" 200 None
2026-03-30 11:30:00 [auto1.es] INFO: Scrape type for GM08675: 0
2026-03-30 11:30:00 [auto1.es] INFO: Found listing with ID: PP39110
2026-03-30 11:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PP39110%27 HTTP/1.1" 200 None
2026-03-30 11:30:00 [auto1.es] INFO: Scrape type for PP39110: 0
2026-03-30 11:30:00 [auto1.es] INFO: Found listing with ID: XS51461
2026-03-30 11:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XS51461%27 HTTP/1.1" 200 None
2026-03-30 11:30:00 [auto1.es] INFO: Scrape type for XS51461: 0
2026-03-30 11:30:04 [scrapy.extensions.logstats] INFO: Crawled 215 pages (at 8 pages/min), scraped 225 items (at 5 items/min)
2026-03-30 11:30:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-30 11:30:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:30:21 [auto1.es] INFO: Channel: 24h | Page: 38 | totalHits: 2242 | hits on page: 40
2026-03-30 11:30:21 [auto1.es] INFO: Found listing with ID: YG24338
2026-03-30 11:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YG24338%27 HTTP/1.1" 200 None
2026-03-30 11:30:21 [auto1.es] INFO: Scrape type for YG24338: 0
2026-03-30 11:30:21 [auto1.es] INFO: Found listing with ID: ZY52551
2026-03-30 11:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZY52551%27 HTTP/1.1" 200 None
2026-03-30 11:30:21 [auto1.es] INFO: Scrape type for ZY52551: 0
2026-03-30 11:30:21 [auto1.es] INFO: Found listing with ID: SK48295
2026-03-30 11:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SK48295%27 HTTP/1.1" 200 None
2026-03-30 11:30:21 [auto1.es] INFO: Scrape type for SK48295: 0
2026-03-30 11:30:21 [auto1.es] INFO: Found listing with ID: RJ73355
2026-03-30 11:30:21 [auto1.es] INFO: Found listing with ID: BG55573
2026-03-30 11:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BG55573%27 HTTP/1.1" 200 None
2026-03-30 11:30:21 [auto1.es] INFO: Scrape type for BG55573: 0
2026-03-30 11:30:21 [auto1.es] INFO: Found listing with ID: FP05442
2026-03-30 11:30:21 [auto1.es] INFO: Found listing with ID: FM79545
2026-03-30 11:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FM79545%27 HTTP/1.1" 200 None
2026-03-30 11:30:21 [auto1.es] INFO: Scrape type for FM79545: 0
2026-03-30 11:30:21 [auto1.es] INFO: Found listing with ID: TC59600
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TC59600%27 HTTP/1.1" 200 None
2026-03-30 11:30:22 [auto1.es] INFO: Scrape type for TC59600: 0
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: PD85443
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD85443%27 HTTP/1.1" 200 None
2026-03-30 11:30:22 [auto1.es] INFO: Scrape type for PD85443: 0
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: KB02477
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: GS63441
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: WY33726
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WY33726%27 HTTP/1.1" 200 None
2026-03-30 11:30:22 [auto1.es] INFO: Scrape type for WY33726: 0
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: UN48469
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UN48469%27 HTTP/1.1" 200 None
2026-03-30 11:30:22 [auto1.es] INFO: Scrape type for UN48469: 0
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: TJ35606
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TJ35606%27 HTTP/1.1" 200 None
2026-03-30 11:30:22 [auto1.es] INFO: Scrape type for TJ35606: 0
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: PD75300
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD75300%27 HTTP/1.1" 200 None
2026-03-30 11:30:22 [auto1.es] INFO: Scrape type for PD75300: 0
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: PN16892
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: XV71103
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XV71103%27 HTTP/1.1" 200 None
2026-03-30 11:30:22 [auto1.es] INFO: Scrape type for XV71103: 0
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: PS31871
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: DG38450
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DG38450%27 HTTP/1.1" 200 None
2026-03-30 11:30:22 [auto1.es] INFO: Scrape type for DG38450: 0
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: RP86418
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: MH48496
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: MM73463
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: UF76170
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF76170%27 HTTP/1.1" 200 None
2026-03-30 11:30:22 [auto1.es] INFO: Scrape type for UF76170: 0
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: LR89235
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LR89235%27 HTTP/1.1" 200 None
2026-03-30 11:30:22 [auto1.es] INFO: Scrape type for LR89235: 0
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: ES15520
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: HS16028
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HS16028%27 HTTP/1.1" 200 None
2026-03-30 11:30:22 [auto1.es] INFO: Scrape type for HS16028: 0
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: HT23405
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HT23405%27 HTTP/1.1" 200 None
2026-03-30 11:30:22 [auto1.es] INFO: Scrape type for HT23405: 0
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: FH47587
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FH47587%27 HTTP/1.1" 200 None
2026-03-30 11:30:22 [auto1.es] INFO: Scrape type for FH47587: 0
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: PJ49539
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PJ49539%27 HTTP/1.1" 200 None
2026-03-30 11:30:22 [auto1.es] INFO: Scrape type for PJ49539: 0
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: GB32148
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GB32148%27 HTTP/1.1" 200 None
2026-03-30 11:30:22 [auto1.es] INFO: Scrape type for GB32148: 0
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: NM59518
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM59518%27 HTTP/1.1" 200 None
2026-03-30 11:30:22 [auto1.es] INFO: Scrape type for NM59518: 0
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: JJ75829
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JJ75829%27 HTTP/1.1" 200 None
2026-03-30 11:30:22 [auto1.es] INFO: Scrape type for JJ75829: 0
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: LS97770
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LS97770%27 HTTP/1.1" 200 None
2026-03-30 11:30:22 [auto1.es] INFO: Scrape type for LS97770: 0
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: VK38327
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: XK60422
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: GW16894
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GW16894%27 HTTP/1.1" 200 None
2026-03-30 11:30:22 [auto1.es] INFO: Scrape type for GW16894: 0
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: LP80713
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: FT33215
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FT33215%27 HTTP/1.1" 200 None
2026-03-30 11:30:22 [auto1.es] INFO: Scrape type for FT33215: 0
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: FY66249
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FY66249%27 HTTP/1.1" 200 None
2026-03-30 11:30:22 [auto1.es] INFO: Scrape type for FY66249: 0
2026-03-30 11:30:22 [auto1.es] INFO: Found listing with ID: UD26451
2026-03-30 11:30:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:30:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:30:23 [auto1.es] INFO: Channel: 24h | Page: 39 | totalHits: 2242 | hits on page: 40
2026-03-30 11:30:23 [auto1.es] INFO: Found listing with ID: LF19420
2026-03-30 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LF19420%27 HTTP/1.1" 200 None
2026-03-30 11:30:23 [auto1.es] INFO: Scrape type for LF19420: 0
2026-03-30 11:30:23 [auto1.es] INFO: Found listing with ID: LK07555
2026-03-30 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LK07555%27 HTTP/1.1" 200 None
2026-03-30 11:30:23 [auto1.es] INFO: Scrape type for LK07555: 0
2026-03-30 11:30:23 [auto1.es] INFO: Found listing with ID: MA33029
2026-03-30 11:30:23 [auto1.es] INFO: Found listing with ID: LX51563
2026-03-30 11:30:23 [auto1.es] INFO: Found listing with ID: YH79403
2026-03-30 11:30:23 [auto1.es] INFO: Found listing with ID: MA08789
2026-03-30 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA08789%27 HTTP/1.1" 200 None
2026-03-30 11:30:23 [auto1.es] INFO: Scrape type for MA08789: 0
2026-03-30 11:30:23 [auto1.es] INFO: Found listing with ID: LG55317
2026-03-30 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LG55317%27 HTTP/1.1" 200 None
2026-03-30 11:30:23 [auto1.es] INFO: Scrape type for LG55317: 0
2026-03-30 11:30:23 [auto1.es] INFO: Found listing with ID: JW67554
2026-03-30 11:30:23 [auto1.es] INFO: Found listing with ID: ZS20717
2026-03-30 11:30:23 [auto1.es] INFO: Found listing with ID: HH46764
2026-03-30 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HH46764%27 HTTP/1.1" 200 None
2026-03-30 11:30:23 [auto1.es] INFO: Scrape type for HH46764: 0
2026-03-30 11:30:23 [auto1.es] INFO: Found listing with ID: TA73897
2026-03-30 11:30:23 [auto1.es] INFO: Found listing with ID: UD21856
2026-03-30 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UD21856%27 HTTP/1.1" 200 None
2026-03-30 11:30:23 [auto1.es] INFO: Scrape type for UD21856: 0
2026-03-30 11:30:23 [auto1.es] INFO: Found listing with ID: JY07683
2026-03-30 11:30:23 [auto1.es] INFO: Found listing with ID: BV18028
2026-03-30 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BV18028%27 HTTP/1.1" 200 None
2026-03-30 11:30:23 [auto1.es] INFO: Scrape type for BV18028: 0
2026-03-30 11:30:23 [auto1.es] INFO: Found listing with ID: CV84892
2026-03-30 11:30:23 [auto1.es] INFO: Found listing with ID: LG59471
2026-03-30 11:30:23 [auto1.es] INFO: Found listing with ID: SU85789
2026-03-30 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SU85789%27 HTTP/1.1" 200 None
2026-03-30 11:30:23 [auto1.es] INFO: Scrape type for SU85789: 0
2026-03-30 11:30:23 [auto1.es] INFO: Found listing with ID: HE05235
2026-03-30 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HE05235%27 HTTP/1.1" 200 None
2026-03-30 11:30:23 [auto1.es] INFO: Scrape type for HE05235: 0
2026-03-30 11:30:23 [auto1.es] INFO: Found listing with ID: XH86580
2026-03-30 11:30:23 [auto1.es] INFO: Found listing with ID: PP21573
2026-03-30 11:30:23 [auto1.es] INFO: Found listing with ID: ZE71239
2026-03-30 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZE71239%27 HTTP/1.1" 200 None
2026-03-30 11:30:23 [auto1.es] INFO: Scrape type for ZE71239: 0
2026-03-30 11:30:23 [auto1.es] INFO: Found listing with ID: FF26714
2026-03-30 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FF26714%27 HTTP/1.1" 200 None
2026-03-30 11:30:23 [auto1.es] INFO: Scrape type for FF26714: 0
2026-03-30 11:30:23 [auto1.es] INFO: Found listing with ID: NC38723
2026-03-30 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NC38723%27 HTTP/1.1" 200 None
2026-03-30 11:30:23 [auto1.es] INFO: Scrape type for NC38723: 0
2026-03-30 11:30:23 [auto1.es] INFO: Found listing with ID: LG94479
2026-03-30 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LG94479%27 HTTP/1.1" 200 None
2026-03-30 11:30:23 [auto1.es] INFO: Scrape type for LG94479: 0
2026-03-30 11:30:23 [auto1.es] INFO: Found listing with ID: DZ42678
2026-03-30 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DZ42678%27 HTTP/1.1" 200 None
2026-03-30 11:30:23 [auto1.es] INFO: Scrape type for DZ42678: 0
2026-03-30 11:30:23 [auto1.es] INFO: Found listing with ID: ZS73380
2026-03-30 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZS73380%27 HTTP/1.1" 200 None
2026-03-30 11:30:23 [auto1.es] INFO: Scrape type for ZS73380: 0
2026-03-30 11:30:23 [auto1.es] INFO: Found listing with ID: DB92602
2026-03-30 11:30:23 [auto1.es] INFO: Found listing with ID: AL10193
2026-03-30 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AL10193%27 HTTP/1.1" 200 None
2026-03-30 11:30:23 [auto1.es] INFO: Scrape type for AL10193: 0
2026-03-30 11:30:23 [auto1.es] INFO: Found listing with ID: JH13002
2026-03-30 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JH13002%27 HTTP/1.1" 200 None
2026-03-30 11:30:23 [auto1.es] INFO: Scrape type for JH13002: 0
2026-03-30 11:30:23 [auto1.es] INFO: Found listing with ID: NZ88130
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NZ88130%27 HTTP/1.1" 200 None
2026-03-30 11:30:24 [auto1.es] INFO: Scrape type for NZ88130: 0
2026-03-30 11:30:24 [auto1.es] INFO: Found listing with ID: CT66486
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CT66486%27 HTTP/1.1" 200 None
2026-03-30 11:30:24 [auto1.es] INFO: Scrape type for CT66486: 0
2026-03-30 11:30:24 [auto1.es] INFO: Found listing with ID: RF22633
2026-03-30 11:30:24 [auto1.es] INFO: Found listing with ID: DD15597
2026-03-30 11:30:24 [auto1.es] INFO: Found listing with ID: AS08117
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AS08117%27 HTTP/1.1" 200 None
2026-03-30 11:30:24 [auto1.es] INFO: Scrape type for AS08117: 0
2026-03-30 11:30:24 [auto1.es] INFO: Found listing with ID: HE42254
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HE42254%27 HTTP/1.1" 200 None
2026-03-30 11:30:24 [auto1.es] INFO: Scrape type for HE42254: 0
2026-03-30 11:30:24 [auto1.es] INFO: Found listing with ID: RB01014
2026-03-30 11:30:24 [auto1.es] INFO: Found listing with ID: RK45787
2026-03-30 11:30:24 [auto1.es] INFO: Found listing with ID: DL05579
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL05579%27 HTTP/1.1" 200 None
2026-03-30 11:30:24 [auto1.es] INFO: Scrape type for DL05579: 0
2026-03-30 11:30:24 [auto1.es] INFO: Found listing with ID: RR55958
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RR55958%27 HTTP/1.1" 200 None
2026-03-30 11:30:24 [auto1.es] INFO: Scrape type for RR55958: 0
2026-03-30 11:30:24 [auto1.es] INFO: Found listing with ID: DR60635
2026-03-30 11:30:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:30:41 [auto1.es] INFO: Channel: 24h | Page: 40 | totalHits: 2242 | hits on page: 40
2026-03-30 11:30:41 [auto1.es] INFO: Found listing with ID: XH33697
2026-03-30 11:30:41 [auto1.es] INFO: Found listing with ID: CH33556
2026-03-30 11:30:41 [auto1.es] INFO: Found listing with ID: ZE13912
2026-03-30 11:30:41 [auto1.es] INFO: Found listing with ID: MJ15003
2026-03-30 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MJ15003%27 HTTP/1.1" 200 None
2026-03-30 11:30:41 [auto1.es] INFO: Scrape type for MJ15003: 0
2026-03-30 11:30:41 [auto1.es] INFO: Found listing with ID: EN16009
2026-03-30 11:30:41 [auto1.es] INFO: Found listing with ID: LN78930
2026-03-30 11:30:41 [auto1.es] INFO: Found listing with ID: FL07647
2026-03-30 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FL07647%27 HTTP/1.1" 200 None
2026-03-30 11:30:41 [auto1.es] INFO: Scrape type for FL07647: 0
2026-03-30 11:30:41 [auto1.es] INFO: Found listing with ID: VU96042
2026-03-30 11:30:41 [auto1.es] INFO: Found listing with ID: SB36142
2026-03-30 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SB36142%27 HTTP/1.1" 200 None
2026-03-30 11:30:41 [auto1.es] INFO: Scrape type for SB36142: 2
2026-03-30 11:30:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bee558d4-110e-5c40-917f-045655df1410 with identifier: SB36142
2026-03-30 11:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bee558d4-110e-5c40-917f-045655df1410 with scrape type 2
2026-03-30 11:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bee558d4-110e-5c40-917f-045655df1410 with scrape type 2
2026-03-30 11:30:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bee558d4-110e-5c40-917f-045655df1410, identifier: SB36142
2026-03-30 11:30:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bee558d4-110e-5c40-917f-045655df1410 with identifier: SB36142
2026-03-30 11:30:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bee558d4-110e-5c40-917f-045655df1410 with identifier: SB36142
2026-03-30 11:30:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bee558d4-110e-5c40-917f-045655df1410 with identifier: SB36142 to the API
2026-03-30 11:30:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:30:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:30:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:30:42Z',
'fuel_type': 'diesel',
'id': 'bee558d4-110e-5c40-917f-045655df1410',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB36142',
'listing': 'auction',
'make': 'Jaguar',
'model': 'E-Pace',
'odometer': 125906,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-26',
'seller_name': None,
'title': 'Jaguar E-Pace D150 Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2018}
2026-03-30 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SB36142%27 HTTP/1.1" 200 None
2026-03-30 11:30:41 [auto1.es] INFO: Saving data for SB36142: {'auction_closing_time': 1774884642.0, 'created_time': 1774598729.722753, 'last_price_update_time': 1774870241.94326}
2026-03-30 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SB36142') HTTP/1.1" 204 0
2026-03-30 11:30:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:30:42 [auto1.es] INFO: Found listing with ID: TN84578
2026-03-30 11:30:42 [auto1.es] INFO: Found listing with ID: WH54771
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WH54771%27 HTTP/1.1" 200 None
2026-03-30 11:30:42 [auto1.es] INFO: Scrape type for WH54771: 2
2026-03-30 11:30:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 313d282b-72b1-5113-b1fe-660e070c7f1a with identifier: WH54771
2026-03-30 11:30:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 313d282b-72b1-5113-b1fe-660e070c7f1a with scrape type 2
2026-03-30 11:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 313d282b-72b1-5113-b1fe-660e070c7f1a with scrape type 2
2026-03-30 11:30:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 313d282b-72b1-5113-b1fe-660e070c7f1a, identifier: WH54771
2026-03-30 11:30:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 313d282b-72b1-5113-b1fe-660e070c7f1a with identifier: WH54771
2026-03-30 11:30:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 313d282b-72b1-5113-b1fe-660e070c7f1a with identifier: WH54771
2026-03-30 11:30:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 313d282b-72b1-5113-b1fe-660e070c7f1a with identifier: WH54771 to the API
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:30:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:50:38Z',
'fuel_type': 'diesel',
'id': '313d282b-72b1-5113-b1fe-660e070c7f1a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH54771',
'listing': 'auction',
'make': 'Renault',
'model': 'Espace',
'odometer': 153770,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-11',
'seller_name': None,
'title': 'Renault Espace 1.6 dCi Energy Initiale Paris',
'transmission': 'automatic',
'trim': 'Initiale Paris',
'year': 2017}
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WH54771%27 HTTP/1.1" 200 None
2026-03-30 11:30:42 [auto1.es] INFO: Saving data for WH54771: {'auction_closing_time': 1774885838.0, 'created_time': 1773918443.396507, 'last_price_update_time': 1774870242.452174}
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WH54771') HTTP/1.1" 204 0
2026-03-30 11:30:42 [auto1.es] INFO: Found listing with ID: BC37690
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BC37690%27 HTTP/1.1" 200 None
2026-03-30 11:30:42 [auto1.es] INFO: Scrape type for BC37690: 0
2026-03-30 11:30:42 [auto1.es] INFO: Found listing with ID: AK05110
2026-03-30 11:30:42 [auto1.es] INFO: Found listing with ID: CC73171
2026-03-30 11:30:42 [auto1.es] INFO: Found listing with ID: HV86151
2026-03-30 11:30:42 [auto1.es] INFO: Found listing with ID: WH79460
2026-03-30 11:30:42 [auto1.es] INFO: Found listing with ID: AG66489
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG66489%27 HTTP/1.1" 200 None
2026-03-30 11:30:42 [auto1.es] INFO: Scrape type for AG66489: 0
2026-03-30 11:30:42 [auto1.es] INFO: Found listing with ID: VM02811
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VM02811%27 HTTP/1.1" 200 None
2026-03-30 11:30:42 [auto1.es] INFO: Scrape type for VM02811: 0
2026-03-30 11:30:42 [auto1.es] INFO: Found listing with ID: VJ40506
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VJ40506%27 HTTP/1.1" 200 None
2026-03-30 11:30:42 [auto1.es] INFO: Scrape type for VJ40506: 0
2026-03-30 11:30:42 [auto1.es] INFO: Found listing with ID: BX46671
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BX46671%27 HTTP/1.1" 200 None
2026-03-30 11:30:42 [auto1.es] INFO: Scrape type for BX46671: 0
2026-03-30 11:30:42 [auto1.es] INFO: Found listing with ID: CW49447
2026-03-30 11:30:42 [auto1.es] INFO: Found listing with ID: FA05527
2026-03-30 11:30:42 [auto1.es] INFO: Found listing with ID: MG44284
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MG44284%27 HTTP/1.1" 200 None
2026-03-30 11:30:42 [auto1.es] INFO: Scrape type for MG44284: 0
2026-03-30 11:30:42 [auto1.es] INFO: Found listing with ID: VV22800
2026-03-30 11:30:42 [auto1.es] INFO: Found listing with ID: JC46060
2026-03-30 11:30:42 [auto1.es] INFO: Found listing with ID: SM77284
2026-03-30 11:30:42 [auto1.es] INFO: Found listing with ID: AG32524
2026-03-30 11:30:42 [auto1.es] INFO: Found listing with ID: PH11049
2026-03-30 11:30:42 [auto1.es] INFO: Found listing with ID: YF13100
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YF13100%27 HTTP/1.1" 200 None
2026-03-30 11:30:42 [auto1.es] INFO: Scrape type for YF13100: 0
2026-03-30 11:30:42 [auto1.es] INFO: Found listing with ID: NK92990
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NK92990%27 HTTP/1.1" 200 None
2026-03-30 11:30:42 [auto1.es] INFO: Scrape type for NK92990: 0
2026-03-30 11:30:42 [auto1.es] INFO: Found listing with ID: XY25635
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XY25635%27 HTTP/1.1" 200 None
2026-03-30 11:30:42 [auto1.es] INFO: Scrape type for XY25635: 0
2026-03-30 11:30:42 [auto1.es] INFO: Found listing with ID: WP66264
2026-03-30 11:30:42 [auto1.es] INFO: Found listing with ID: LG93188
2026-03-30 11:30:42 [auto1.es] INFO: Found listing with ID: UR64839
2026-03-30 11:30:42 [auto1.es] INFO: Found listing with ID: BT14659
2026-03-30 11:30:42 [auto1.es] INFO: Found listing with ID: NN09509
2026-03-30 11:30:42 [auto1.es] INFO: Found listing with ID: LL30707
2026-03-30 11:30:42 [auto1.es] INFO: Found listing with ID: XY10294
2026-03-30 11:30:42 [auto1.es] INFO: Found listing with ID: FD66693
2026-03-30 11:30:42 [auto1.es] INFO: Found listing with ID: DC98818
2026-03-30 11:31:04 [scrapy.extensions.logstats] INFO: Crawled 218 pages (at 3 pages/min), scraped 227 items (at 2 items/min)
2026-03-30 11:31:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-30 11:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:31:17 [auto1.es] INFO: Channel: 24h | Page: 41 | totalHits: 2243 | hits on page: 40
2026-03-30 11:31:17 [auto1.es] INFO: Found listing with ID: DC98818
2026-03-30 11:31:17 [auto1.es] INFO: Found listing with ID: YG93174
2026-03-30 11:31:17 [auto1.es] INFO: Found listing with ID: ZH85985
2026-03-30 11:31:17 [auto1.es] INFO: Found listing with ID: UA50937
2026-03-30 11:31:17 [auto1.es] INFO: Found listing with ID: LC97484
2026-03-30 11:31:17 [auto1.es] INFO: Found listing with ID: EE07728
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EE07728%27 HTTP/1.1" 200 None
2026-03-30 11:31:17 [auto1.es] INFO: Scrape type for EE07728: 0
2026-03-30 11:31:17 [auto1.es] INFO: Found listing with ID: BL83097
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BL83097%27 HTTP/1.1" 200 None
2026-03-30 11:31:17 [auto1.es] INFO: Scrape type for BL83097: 0
2026-03-30 11:31:17 [auto1.es] INFO: Found listing with ID: ZJ52163
2026-03-30 11:31:17 [auto1.es] INFO: Found listing with ID: CV75612
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV75612%27 HTTP/1.1" 200 None
2026-03-30 11:31:17 [auto1.es] INFO: Scrape type for CV75612: 0
2026-03-30 11:31:17 [auto1.es] INFO: Found listing with ID: TV15408
2026-03-30 11:31:17 [auto1.es] INFO: Found listing with ID: CH38483
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH38483%27 HTTP/1.1" 200 None
2026-03-30 11:31:17 [auto1.es] INFO: Scrape type for CH38483: 0
2026-03-30 11:31:17 [auto1.es] INFO: Found listing with ID: JP11260
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JP11260%27 HTTP/1.1" 200 None
2026-03-30 11:31:17 [auto1.es] INFO: Scrape type for JP11260: 0
2026-03-30 11:31:17 [auto1.es] INFO: Found listing with ID: NK34270
2026-03-30 11:31:17 [auto1.es] INFO: Found listing with ID: TN34966
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TN34966%27 HTTP/1.1" 200 None
2026-03-30 11:31:17 [auto1.es] INFO: Scrape type for TN34966: 0
2026-03-30 11:31:17 [auto1.es] INFO: Found listing with ID: WW97634
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WW97634%27 HTTP/1.1" 200 None
2026-03-30 11:31:17 [auto1.es] INFO: Scrape type for WW97634: 2
2026-03-30 11:31:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6eb49c3-2fbb-5ab3-bdfa-ff07671fdc89 with identifier: WW97634
2026-03-30 11:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6eb49c3-2fbb-5ab3-bdfa-ff07671fdc89 with scrape type 2
2026-03-30 11:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6eb49c3-2fbb-5ab3-bdfa-ff07671fdc89 with scrape type 2
2026-03-30 11:31:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c6eb49c3-2fbb-5ab3-bdfa-ff07671fdc89, identifier: WW97634
2026-03-30 11:31:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c6eb49c3-2fbb-5ab3-bdfa-ff07671fdc89 with identifier: WW97634
2026-03-30 11:31:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c6eb49c3-2fbb-5ab3-bdfa-ff07671fdc89 with identifier: WW97634
2026-03-30 11:31:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c6eb49c3-2fbb-5ab3-bdfa-ff07671fdc89 with identifier: WW97634 to the API
2026-03-30 11:31:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:31:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:31:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:45:50Z',
'fuel_type': 'diesel',
'id': 'c6eb49c3-2fbb-5ab3-bdfa-ff07671fdc89',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW97634',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 159436,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-07-31',
'seller_name': None,
'title': 'Ford Mondeo 2.2 TDCi Ghia',
'transmission': 'manual',
'trim': 'Ghia',
'year': 2005}
2026-03-30 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WW97634%27 HTTP/1.1" 200 None
2026-03-30 11:31:18 [auto1.es] INFO: Saving data for WW97634: {'auction_closing_time': 1774885550.0, 'created_time': 1773324417.629841, 'last_price_update_time': 1774870278.447493}
2026-03-30 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WW97634') HTTP/1.1" 204 0
2026-03-30 11:31:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:31:18 [auto1.es] INFO: Found listing with ID: CZ73203
2026-03-30 11:31:18 [auto1.es] INFO: Found listing with ID: LV49477
2026-03-30 11:31:18 [auto1.es] INFO: Found listing with ID: KX05892
2026-03-30 11:31:18 [auto1.es] INFO: Found listing with ID: JZ86442
2026-03-30 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JZ86442%27 HTTP/1.1" 200 None
2026-03-30 11:31:18 [auto1.es] INFO: Scrape type for JZ86442: 0
2026-03-30 11:31:18 [auto1.es] INFO: Found listing with ID: TV57362
2026-03-30 11:31:18 [auto1.es] INFO: Found listing with ID: PH10774
2026-03-30 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PH10774%27 HTTP/1.1" 200 None
2026-03-30 11:31:18 [auto1.es] INFO: Scrape type for PH10774: 0
2026-03-30 11:31:18 [auto1.es] INFO: Found listing with ID: CZ94183
2026-03-30 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CZ94183%27 HTTP/1.1" 200 None
2026-03-30 11:31:18 [auto1.es] INFO: Scrape type for CZ94183: 0
2026-03-30 11:31:18 [auto1.es] INFO: Found listing with ID: NM83304
2026-03-30 11:31:18 [auto1.es] INFO: Found listing with ID: YC76181
2026-03-30 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC76181%27 HTTP/1.1" 200 None
2026-03-30 11:31:18 [auto1.es] INFO: Scrape type for YC76181: 0
2026-03-30 11:31:18 [auto1.es] INFO: Found listing with ID: GY52926
2026-03-30 11:31:18 [auto1.es] INFO: Found listing with ID: VF82701
2026-03-30 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VF82701%27 HTTP/1.1" 200 None
2026-03-30 11:31:18 [auto1.es] INFO: Scrape type for VF82701: 0
2026-03-30 11:31:18 [auto1.es] INFO: Found listing with ID: LR10742
2026-03-30 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LR10742%27 HTTP/1.1" 200 None
2026-03-30 11:31:18 [auto1.es] INFO: Scrape type for LR10742: 0
2026-03-30 11:31:18 [auto1.es] INFO: Found listing with ID: RV28339
2026-03-30 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RV28339%27 HTTP/1.1" 200 None
2026-03-30 11:31:18 [auto1.es] INFO: Scrape type for RV28339: 0
2026-03-30 11:31:18 [auto1.es] INFO: Found listing with ID: UV92160
2026-03-30 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UV92160%27 HTTP/1.1" 200 None
2026-03-30 11:31:18 [auto1.es] INFO: Scrape type for UV92160: 0
2026-03-30 11:31:18 [auto1.es] INFO: Found listing with ID: YL57759
2026-03-30 11:31:18 [auto1.es] INFO: Found listing with ID: SJ56624
2026-03-30 11:31:18 [auto1.es] INFO: Found listing with ID: VZ06267
2026-03-30 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VZ06267%27 HTTP/1.1" 200 None
2026-03-30 11:31:18 [auto1.es] INFO: Scrape type for VZ06267: 0
2026-03-30 11:31:18 [auto1.es] INFO: Found listing with ID: ZT56570
2026-03-30 11:31:18 [auto1.es] INFO: Found listing with ID: NW09077
2026-03-30 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NW09077%27 HTTP/1.1" 200 None
2026-03-30 11:31:18 [auto1.es] INFO: Scrape type for NW09077: 0
2026-03-30 11:31:18 [auto1.es] INFO: Found listing with ID: AB11281
2026-03-30 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AB11281%27 HTTP/1.1" 200 None
2026-03-30 11:31:18 [auto1.es] INFO: Scrape type for AB11281: 0
2026-03-30 11:31:18 [auto1.es] INFO: Found listing with ID: YY21107
2026-03-30 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YY21107%27 HTTP/1.1" 200 None
2026-03-30 11:31:18 [auto1.es] INFO: Scrape type for YY21107: 0
2026-03-30 11:31:18 [auto1.es] INFO: Found listing with ID: YT85498
2026-03-30 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YT85498%27 HTTP/1.1" 200 None
2026-03-30 11:31:18 [auto1.es] INFO: Scrape type for YT85498: 0
2026-03-30 11:31:18 [auto1.es] INFO: Found listing with ID: VY69585
2026-03-30 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY69585%27 HTTP/1.1" 200 None
2026-03-30 11:31:18 [auto1.es] INFO: Scrape type for VY69585: 0
2026-03-30 11:31:18 [auto1.es] INFO: Found listing with ID: XU33886
2026-03-30 11:31:18 [auto1.es] INFO: Found listing with ID: VG77720
2026-03-30 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VG77720%27 HTTP/1.1" 200 None
2026-03-30 11:31:18 [auto1.es] INFO: Scrape type for VG77720: 0
2026-03-30 11:31:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:31:31 [auto1.es] INFO: Channel: 24h | Page: 42 | totalHits: 2245 | hits on page: 40
2026-03-30 11:31:31 [auto1.es] INFO: Found listing with ID: XU33886
2026-03-30 11:31:31 [auto1.es] INFO: Found listing with ID: VG77720
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VG77720%27 HTTP/1.1" 200 None
2026-03-30 11:31:31 [auto1.es] INFO: Scrape type for VG77720: 0
2026-03-30 11:31:31 [auto1.es] INFO: Found listing with ID: MA45744
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA45744%27 HTTP/1.1" 200 None
2026-03-30 11:31:31 [auto1.es] INFO: Scrape type for MA45744: 0
2026-03-30 11:31:31 [auto1.es] INFO: Found listing with ID: CD12764
2026-03-30 11:31:31 [auto1.es] INFO: Found listing with ID: RL13967
2026-03-30 11:31:31 [auto1.es] INFO: Found listing with ID: GU02949
2026-03-30 11:31:31 [auto1.es] INFO: Found listing with ID: FS30541
2026-03-30 11:31:31 [auto1.es] INFO: Found listing with ID: SG84832
2026-03-30 11:31:31 [auto1.es] INFO: Found listing with ID: WA94101
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA94101%27 HTTP/1.1" 200 None
2026-03-30 11:31:31 [auto1.es] INFO: Scrape type for WA94101: 0
2026-03-30 11:31:31 [auto1.es] INFO: Found listing with ID: VL72913
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL72913%27 HTTP/1.1" 200 None
2026-03-30 11:31:31 [auto1.es] INFO: Scrape type for VL72913: 0
2026-03-30 11:31:31 [auto1.es] INFO: Found listing with ID: RT56400
2026-03-30 11:31:31 [auto1.es] INFO: Found listing with ID: DD02198
2026-03-30 11:31:31 [auto1.es] INFO: Found listing with ID: EN73965
2026-03-30 11:31:31 [auto1.es] INFO: Found listing with ID: NJ18297
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NJ18297%27 HTTP/1.1" 200 None
2026-03-30 11:31:31 [auto1.es] INFO: Scrape type for NJ18297: 0
2026-03-30 11:31:31 [auto1.es] INFO: Found listing with ID: AV04114
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AV04114%27 HTTP/1.1" 200 None
2026-03-30 11:31:31 [auto1.es] INFO: Scrape type for AV04114: 0
2026-03-30 11:31:31 [auto1.es] INFO: Found listing with ID: WC85393
2026-03-30 11:31:31 [auto1.es] INFO: Found listing with ID: CH09218
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH09218%27 HTTP/1.1" 200 None
2026-03-30 11:31:31 [auto1.es] INFO: Scrape type for CH09218: 0
2026-03-30 11:31:31 [auto1.es] INFO: Found listing with ID: CE26517
2026-03-30 11:31:31 [auto1.es] INFO: Found listing with ID: YD82310
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YD82310%27 HTTP/1.1" 200 None
2026-03-30 11:31:31 [auto1.es] INFO: Scrape type for YD82310: 0
2026-03-30 11:31:31 [auto1.es] INFO: Found listing with ID: SZ71076
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SZ71076%27 HTTP/1.1" 200 None
2026-03-30 11:31:31 [auto1.es] INFO: Scrape type for SZ71076: 0
2026-03-30 11:31:31 [auto1.es] INFO: Found listing with ID: GT34308
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT34308%27 HTTP/1.1" 200 None
2026-03-30 11:31:31 [auto1.es] INFO: Scrape type for GT34308: 0
2026-03-30 11:31:31 [auto1.es] INFO: Found listing with ID: GG82225
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GG82225%27 HTTP/1.1" 200 None
2026-03-30 11:31:31 [auto1.es] INFO: Scrape type for GG82225: 0
2026-03-30 11:31:31 [auto1.es] INFO: Found listing with ID: CF71670
2026-03-30 11:31:31 [auto1.es] INFO: Found listing with ID: GY32674
2026-03-30 11:31:31 [auto1.es] INFO: Found listing with ID: ML55356
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ML55356%27 HTTP/1.1" 200 None
2026-03-30 11:31:31 [auto1.es] INFO: Scrape type for ML55356: 0
2026-03-30 11:31:31 [auto1.es] INFO: Found listing with ID: EB66984
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB66984%27 HTTP/1.1" 200 None
2026-03-30 11:31:31 [auto1.es] INFO: Scrape type for EB66984: 0
2026-03-30 11:31:31 [auto1.es] INFO: Found listing with ID: ES45064
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ES45064%27 HTTP/1.1" 200 None
2026-03-30 11:31:31 [auto1.es] INFO: Scrape type for ES45064: 0
2026-03-30 11:31:31 [auto1.es] INFO: Found listing with ID: YM72054
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YM72054%27 HTTP/1.1" 200 None
2026-03-30 11:31:31 [auto1.es] INFO: Scrape type for YM72054: 0
2026-03-30 11:31:31 [auto1.es] INFO: Found listing with ID: KX99272
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KX99272%27 HTTP/1.1" 200 None
2026-03-30 11:31:31 [auto1.es] INFO: Scrape type for KX99272: 0
2026-03-30 11:31:31 [auto1.es] INFO: Found listing with ID: UU25578
2026-03-30 11:31:31 [auto1.es] INFO: Found listing with ID: WC57455
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WC57455%27 HTTP/1.1" 200 None
2026-03-30 11:31:31 [auto1.es] INFO: Scrape type for WC57455: 0
2026-03-30 11:31:31 [auto1.es] INFO: Found listing with ID: DT02195
2026-03-30 11:31:31 [auto1.es] INFO: Found listing with ID: RH85625
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RH85625%27 HTTP/1.1" 200 None
2026-03-30 11:31:31 [auto1.es] INFO: Scrape type for RH85625: 0
2026-03-30 11:31:31 [auto1.es] INFO: Found listing with ID: HN11800
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HN11800%27 HTTP/1.1" 200 None
2026-03-30 11:31:31 [auto1.es] INFO: Scrape type for HN11800: 0
2026-03-30 11:31:31 [auto1.es] INFO: Found listing with ID: FU14405
2026-03-30 11:31:31 [auto1.es] INFO: Found listing with ID: FG12610
2026-03-30 11:31:31 [auto1.es] INFO: Found listing with ID: PZ51501
2026-03-30 11:31:31 [auto1.es] INFO: Found listing with ID: PN60622
2026-03-30 11:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PN60622%27 HTTP/1.1" 200 None
2026-03-30 11:31:32 [auto1.es] INFO: Scrape type for PN60622: 0
2026-03-30 11:31:32 [auto1.es] INFO: Found listing with ID: FM31640
2026-03-30 11:31:32 [auto1.es] INFO: Found listing with ID: SP11103
2026-03-30 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SP11103%27 HTTP/1.1" 200 None
2026-03-30 11:31:32 [auto1.es] INFO: Scrape type for SP11103: 0
2026-03-30 11:31:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:31:39 [auto1.es] INFO: Channel: 24h | Page: 43 | totalHits: 2245 | hits on page: 40
2026-03-30 11:31:39 [auto1.es] INFO: Found listing with ID: MD28950
2026-03-30 11:31:39 [auto1.es] INFO: Found listing with ID: KL48857
2026-03-30 11:31:39 [auto1.es] INFO: Found listing with ID: XR91515
2026-03-30 11:31:39 [auto1.es] INFO: Found listing with ID: ZD58886
2026-03-30 11:31:39 [auto1.es] INFO: Found listing with ID: MA84687
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA84687%27 HTTP/1.1" 200 None
2026-03-30 11:31:40 [auto1.es] INFO: Scrape type for MA84687: 0
2026-03-30 11:31:40 [auto1.es] INFO: Found listing with ID: GN52396
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GN52396%27 HTTP/1.1" 200 None
2026-03-30 11:31:40 [auto1.es] INFO: Scrape type for GN52396: 0
2026-03-30 11:31:40 [auto1.es] INFO: Found listing with ID: RW68168
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RW68168%27 HTTP/1.1" 200 None
2026-03-30 11:31:40 [auto1.es] INFO: Scrape type for RW68168: 0
2026-03-30 11:31:40 [auto1.es] INFO: Found listing with ID: SN05044
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SN05044%27 HTTP/1.1" 200 None
2026-03-30 11:31:40 [auto1.es] INFO: Scrape type for SN05044: 0
2026-03-30 11:31:40 [auto1.es] INFO: Found listing with ID: XP48517
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XP48517%27 HTTP/1.1" 200 None
2026-03-30 11:31:40 [auto1.es] INFO: Scrape type for XP48517: 0
2026-03-30 11:31:40 [auto1.es] INFO: Found listing with ID: DR19910
2026-03-30 11:31:40 [auto1.es] INFO: Found listing with ID: VW52839
2026-03-30 11:31:40 [auto1.es] INFO: Found listing with ID: RJ81343
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RJ81343%27 HTTP/1.1" 200 None
2026-03-30 11:31:40 [auto1.es] INFO: Scrape type for RJ81343: 0
2026-03-30 11:31:40 [auto1.es] INFO: Found listing with ID: KU93995
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KU93995%27 HTTP/1.1" 200 None
2026-03-30 11:31:40 [auto1.es] INFO: Scrape type for KU93995: 0
2026-03-30 11:31:40 [auto1.es] INFO: Found listing with ID: ZT16054
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZT16054%27 HTTP/1.1" 200 None
2026-03-30 11:31:40 [auto1.es] INFO: Scrape type for ZT16054: 0
2026-03-30 11:31:40 [auto1.es] INFO: Found listing with ID: CD34626
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CD34626%27 HTTP/1.1" 200 None
2026-03-30 11:31:40 [auto1.es] INFO: Scrape type for CD34626: 0
2026-03-30 11:31:40 [auto1.es] INFO: Found listing with ID: UT51740
2026-03-30 11:31:40 [auto1.es] INFO: Found listing with ID: WN15214
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WN15214%27 HTTP/1.1" 200 None
2026-03-30 11:31:40 [auto1.es] INFO: Scrape type for WN15214: 0
2026-03-30 11:31:40 [auto1.es] INFO: Found listing with ID: YY16835
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YY16835%27 HTTP/1.1" 200 None
2026-03-30 11:31:40 [auto1.es] INFO: Scrape type for YY16835: 0
2026-03-30 11:31:40 [auto1.es] INFO: Found listing with ID: ZF10967
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZF10967%27 HTTP/1.1" 200 None
2026-03-30 11:31:40 [auto1.es] INFO: Scrape type for ZF10967: 0
2026-03-30 11:31:40 [auto1.es] INFO: Found listing with ID: EV20244
2026-03-30 11:31:40 [auto1.es] INFO: Found listing with ID: SB84191
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SB84191%27 HTTP/1.1" 200 None
2026-03-30 11:31:40 [auto1.es] INFO: Scrape type for SB84191: 0
2026-03-30 11:31:40 [auto1.es] INFO: Found listing with ID: WM47601
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WM47601%27 HTTP/1.1" 200 None
2026-03-30 11:31:40 [auto1.es] INFO: Scrape type for WM47601: 0
2026-03-30 11:31:40 [auto1.es] INFO: Found listing with ID: AE81863
2026-03-30 11:31:40 [auto1.es] INFO: Found listing with ID: PL43950
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PL43950%27 HTTP/1.1" 200 None
2026-03-30 11:31:40 [auto1.es] INFO: Scrape type for PL43950: 0
2026-03-30 11:31:40 [auto1.es] INFO: Found listing with ID: LK68537
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LK68537%27 HTTP/1.1" 200 None
2026-03-30 11:31:40 [auto1.es] INFO: Scrape type for LK68537: 2
2026-03-30 11:31:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c72b53c-2996-5fb6-952f-435f769d67ad with identifier: LK68537
2026-03-30 11:31:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c72b53c-2996-5fb6-952f-435f769d67ad with scrape type 2
2026-03-30 11:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c72b53c-2996-5fb6-952f-435f769d67ad with scrape type 2
2026-03-30 11:31:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9c72b53c-2996-5fb6-952f-435f769d67ad, identifier: LK68537
2026-03-30 11:31:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9c72b53c-2996-5fb6-952f-435f769d67ad with identifier: LK68537
2026-03-30 11:31:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9c72b53c-2996-5fb6-952f-435f769d67ad with identifier: LK68537
2026-03-30 11:31:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9c72b53c-2996-5fb6-952f-435f769d67ad with identifier: LK68537 to the API
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:27:25Z',
'fuel_type': 'petrol',
'id': '9c72b53c-2996-5fb6-952f-435f769d67ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK68537',
'listing': 'auction',
'make': 'Jeep',
'model': 'Compass',
'odometer': 60628,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-17',
'seller_name': None,
'title': 'Jeep Compass 1.4 M-Air Sport FWD',
'transmission': 'manual',
'trim': 'Sport FWD',
'year': 2018}
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LK68537%27 HTTP/1.1" 200 None
2026-03-30 11:31:40 [auto1.es] INFO: Saving data for LK68537: {'auction_closing_time': 1774884445.0, 'created_time': 1772623803.667705, 'last_price_update_time': 1774870300.772545}
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LK68537') HTTP/1.1" 204 0
2026-03-30 11:31:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:31:40 [auto1.es] INFO: Found listing with ID: EH39769
2026-03-30 11:31:40 [auto1.es] INFO: Found listing with ID: SH75312
2026-03-30 11:31:40 [auto1.es] INFO: Found listing with ID: XD15291
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XD15291%27 HTTP/1.1" 200 None
2026-03-30 11:31:40 [auto1.es] INFO: Scrape type for XD15291: 0
2026-03-30 11:31:40 [auto1.es] INFO: Found listing with ID: VT03580
2026-03-30 11:31:40 [auto1.es] INFO: Found listing with ID: DB28446
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DB28446%27 HTTP/1.1" 200 None
2026-03-30 11:31:40 [auto1.es] INFO: Scrape type for DB28446: 0
2026-03-30 11:31:40 [auto1.es] INFO: Found listing with ID: LU54456
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LU54456%27 HTTP/1.1" 200 None
2026-03-30 11:31:40 [auto1.es] INFO: Scrape type for LU54456: 0
2026-03-30 11:31:40 [auto1.es] INFO: Found listing with ID: UY97217
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UY97217%27 HTTP/1.1" 200 None
2026-03-30 11:31:40 [auto1.es] INFO: Scrape type for UY97217: 0
2026-03-30 11:31:40 [auto1.es] INFO: Found listing with ID: PK04858
2026-03-30 11:31:40 [auto1.es] INFO: Found listing with ID: UM71516
2026-03-30 11:31:40 [auto1.es] INFO: Found listing with ID: UH45112
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UH45112%27 HTTP/1.1" 200 None
2026-03-30 11:31:40 [auto1.es] INFO: Scrape type for UH45112: 0
2026-03-30 11:31:40 [auto1.es] INFO: Found listing with ID: HF92394
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HF92394%27 HTTP/1.1" 200 None
2026-03-30 11:31:40 [auto1.es] INFO: Scrape type for HF92394: 0
2026-03-30 11:31:40 [auto1.es] INFO: Found listing with ID: PX22333
2026-03-30 11:31:40 [auto1.es] INFO: Found listing with ID: SG11403
2026-03-30 11:31:40 [auto1.es] INFO: Found listing with ID: YF90515
2026-03-30 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YF90515%27 HTTP/1.1" 200 None
2026-03-30 11:31:41 [auto1.es] INFO: Scrape type for YF90515: 0
2026-03-30 11:31:41 [auto1.es] INFO: Found listing with ID: DH00541
2026-03-30 11:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:31:43 [auto1.es] INFO: Channel: 24h | Page: 44 | totalHits: 2245 | hits on page: 40
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: YS60567
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: HL39596
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HL39596%27 HTTP/1.1" 200 None
2026-03-30 11:31:43 [auto1.es] INFO: Scrape type for HL39596: 0
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: LK18237
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: LC05327
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: WA10977
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: PS29729
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS29729%27 HTTP/1.1" 200 None
2026-03-30 11:31:43 [auto1.es] INFO: Scrape type for PS29729: 0
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: WC91216
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WC91216%27 HTTP/1.1" 200 None
2026-03-30 11:31:43 [auto1.es] INFO: Scrape type for WC91216: 0
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: RV14480
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: NS96167
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NS96167%27 HTTP/1.1" 200 None
2026-03-30 11:31:43 [auto1.es] INFO: Scrape type for NS96167: 2
2026-03-30 11:31:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b06b278-a734-5ad9-8827-6f0d324c8a45 with identifier: NS96167
2026-03-30 11:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b06b278-a734-5ad9-8827-6f0d324c8a45 with scrape type 2
2026-03-30 11:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b06b278-a734-5ad9-8827-6f0d324c8a45 with scrape type 2
2026-03-30 11:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3b06b278-a734-5ad9-8827-6f0d324c8a45, identifier: NS96167
2026-03-30 11:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3b06b278-a734-5ad9-8827-6f0d324c8a45 with identifier: NS96167
2026-03-30 11:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3b06b278-a734-5ad9-8827-6f0d324c8a45 with identifier: NS96167
2026-03-30 11:31:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3b06b278-a734-5ad9-8827-6f0d324c8a45 with identifier: NS96167 to the API
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:31:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:15:29Z',
'fuel_type': 'petrol',
'id': '3b06b278-a734-5ad9-8827-6f0d324c8a45',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS96167',
'listing': 'auction',
'make': 'Lexus',
'model': 'RX-Serie',
'odometer': 221686,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-03-28',
'seller_name': None,
'title': 'Lexus RX-Serie RX 300',
'transmission': 'automatic',
'trim': '',
'year': 2005}
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NS96167%27 HTTP/1.1" 200 None
2026-03-30 11:31:43 [auto1.es] INFO: Saving data for NS96167: {'auction_closing_time': 1774883729.0, 'created_time': 1774598731.318832, 'last_price_update_time': 1774870303.435335}
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NS96167') HTTP/1.1" 204 0
2026-03-30 11:31:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: MW68540
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: MN90156
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MN90156%27 HTTP/1.1" 200 None
2026-03-30 11:31:43 [auto1.es] INFO: Scrape type for MN90156: 0
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: LW73612
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LW73612%27 HTTP/1.1" 200 None
2026-03-30 11:31:43 [auto1.es] INFO: Scrape type for LW73612: 0
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: SK17439
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SK17439%27 HTTP/1.1" 200 None
2026-03-30 11:31:43 [auto1.es] INFO: Scrape type for SK17439: 0
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: PD96380
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: MU04629
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MU04629%27 HTTP/1.1" 200 None
2026-03-30 11:31:43 [auto1.es] INFO: Scrape type for MU04629: 0
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: HT85667
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: GY39157
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GY39157%27 HTTP/1.1" 200 None
2026-03-30 11:31:43 [auto1.es] INFO: Scrape type for GY39157: 0
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: ZZ21581
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZZ21581%27 HTTP/1.1" 200 None
2026-03-30 11:31:43 [auto1.es] INFO: Scrape type for ZZ21581: 0
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: UR06074
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UR06074%27 HTTP/1.1" 200 None
2026-03-30 11:31:43 [auto1.es] INFO: Scrape type for UR06074: 0
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: CB32241
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CB32241%27 HTTP/1.1" 200 None
2026-03-30 11:31:43 [auto1.es] INFO: Scrape type for CB32241: 0
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: XR92407
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XR92407%27 HTTP/1.1" 200 None
2026-03-30 11:31:43 [auto1.es] INFO: Scrape type for XR92407: 0
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: UD00521
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: GT44883
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: NA66808
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA66808%27 HTTP/1.1" 200 None
2026-03-30 11:31:43 [auto1.es] INFO: Scrape type for NA66808: 0
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: JW04171
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW04171%27 HTTP/1.1" 200 None
2026-03-30 11:31:43 [auto1.es] INFO: Scrape type for JW04171: 0
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: YA86748
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YA86748%27 HTTP/1.1" 200 None
2026-03-30 11:31:43 [auto1.es] INFO: Scrape type for YA86748: 0
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: ZC78414
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: RJ55423
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: HA27882
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: SK01159
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SK01159%27 HTTP/1.1" 200 None
2026-03-30 11:31:43 [auto1.es] INFO: Scrape type for SK01159: 0
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: CE82736
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: CP72287
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: SU07288
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SU07288%27 HTTP/1.1" 200 None
2026-03-30 11:31:43 [auto1.es] INFO: Scrape type for SU07288: 0
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: ZZ49032
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: WJ83814
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WJ83814%27 HTTP/1.1" 200 None
2026-03-30 11:31:43 [auto1.es] INFO: Scrape type for WJ83814: 0
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: BJ36748
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BJ36748%27 HTTP/1.1" 200 None
2026-03-30 11:31:43 [auto1.es] INFO: Scrape type for BJ36748: 0
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: YP76490
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YP76490%27 HTTP/1.1" 200 None
2026-03-30 11:31:43 [auto1.es] INFO: Scrape type for YP76490: 0
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: RS45242
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: AB84528
2026-03-30 11:31:43 [auto1.es] INFO: Found listing with ID: PS20422
2026-03-30 11:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:31:45 [auto1.es] INFO: Channel: 24h | Page: 45 | totalHits: 2245 | hits on page: 40
2026-03-30 11:31:45 [auto1.es] INFO: Found listing with ID: ZR59289
2026-03-30 11:31:45 [auto1.es] INFO: Found listing with ID: XV33818
2026-03-30 11:31:45 [auto1.es] INFO: Found listing with ID: EN12947
2026-03-30 11:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN12947%27 HTTP/1.1" 200 None
2026-03-30 11:31:45 [auto1.es] INFO: Scrape type for EN12947: 0
2026-03-30 11:31:45 [auto1.es] INFO: Found listing with ID: KK99044
2026-03-30 11:31:45 [auto1.es] INFO: Found listing with ID: VL09919
2026-03-30 11:31:45 [auto1.es] INFO: Found listing with ID: SX15472
2026-03-30 11:31:45 [auto1.es] INFO: Found listing with ID: DG13081
2026-03-30 11:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DG13081%27 HTTP/1.1" 200 None
2026-03-30 11:31:45 [auto1.es] INFO: Scrape type for DG13081: 0
2026-03-30 11:31:45 [auto1.es] INFO: Found listing with ID: FT05886
2026-03-30 11:31:45 [auto1.es] INFO: Found listing with ID: EU03494
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EU03494%27 HTTP/1.1" 200 None
2026-03-30 11:31:46 [auto1.es] INFO: Scrape type for EU03494: 0
2026-03-30 11:31:46 [auto1.es] INFO: Found listing with ID: ZC21665
2026-03-30 11:31:46 [auto1.es] INFO: Found listing with ID: MF02343
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MF02343%27 HTTP/1.1" 200 None
2026-03-30 11:31:46 [auto1.es] INFO: Scrape type for MF02343: 0
2026-03-30 11:31:46 [auto1.es] INFO: Found listing with ID: HP01859
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HP01859%27 HTTP/1.1" 200 None
2026-03-30 11:31:46 [auto1.es] INFO: Scrape type for HP01859: 0
2026-03-30 11:31:46 [auto1.es] INFO: Found listing with ID: VL50797
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL50797%27 HTTP/1.1" 200 None
2026-03-30 11:31:46 [auto1.es] INFO: Scrape type for VL50797: 0
2026-03-30 11:31:46 [auto1.es] INFO: Found listing with ID: BN03285
2026-03-30 11:31:46 [auto1.es] INFO: Found listing with ID: WZ30869
2026-03-30 11:31:46 [auto1.es] INFO: Found listing with ID: ZM69944
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZM69944%27 HTTP/1.1" 200 None
2026-03-30 11:31:46 [auto1.es] INFO: Scrape type for ZM69944: 0
2026-03-30 11:31:46 [auto1.es] INFO: Found listing with ID: YB94347
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YB94347%27 HTTP/1.1" 200 None
2026-03-30 11:31:46 [auto1.es] INFO: Scrape type for YB94347: 0
2026-03-30 11:31:46 [auto1.es] INFO: Found listing with ID: RN76428
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RN76428%27 HTTP/1.1" 200 None
2026-03-30 11:31:46 [auto1.es] INFO: Scrape type for RN76428: 0
2026-03-30 11:31:46 [auto1.es] INFO: Found listing with ID: LD17478
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LD17478%27 HTTP/1.1" 200 None
2026-03-30 11:31:46 [auto1.es] INFO: Scrape type for LD17478: 0
2026-03-30 11:31:46 [auto1.es] INFO: Found listing with ID: VG01013
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VG01013%27 HTTP/1.1" 200 None
2026-03-30 11:31:46 [auto1.es] INFO: Scrape type for VG01013: 0
2026-03-30 11:31:46 [auto1.es] INFO: Found listing with ID: FD79630
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FD79630%27 HTTP/1.1" 200 None
2026-03-30 11:31:46 [auto1.es] INFO: Scrape type for FD79630: 0
2026-03-30 11:31:46 [auto1.es] INFO: Found listing with ID: WL49874
2026-03-30 11:31:46 [auto1.es] INFO: Found listing with ID: WX54724
2026-03-30 11:31:46 [auto1.es] INFO: Found listing with ID: RX23320
2026-03-30 11:31:46 [auto1.es] INFO: Found listing with ID: XN30812
2026-03-30 11:31:46 [auto1.es] INFO: Found listing with ID: FK50437
2026-03-30 11:31:46 [auto1.es] INFO: Found listing with ID: CJ73946
2026-03-30 11:31:46 [auto1.es] INFO: Found listing with ID: KS53137
2026-03-30 11:31:46 [auto1.es] INFO: Found listing with ID: BR63324
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BR63324%27 HTTP/1.1" 200 None
2026-03-30 11:31:46 [auto1.es] INFO: Scrape type for BR63324: 0
2026-03-30 11:31:46 [auto1.es] INFO: Found listing with ID: TF28365
2026-03-30 11:31:46 [auto1.es] INFO: Found listing with ID: KD08887
2026-03-30 11:31:46 [auto1.es] INFO: Found listing with ID: PF82044
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PF82044%27 HTTP/1.1" 200 None
2026-03-30 11:31:46 [auto1.es] INFO: Scrape type for PF82044: 0
2026-03-30 11:31:46 [auto1.es] INFO: Found listing with ID: LU79245
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LU79245%27 HTTP/1.1" 200 None
2026-03-30 11:31:46 [auto1.es] INFO: Scrape type for LU79245: 0
2026-03-30 11:31:46 [auto1.es] INFO: Found listing with ID: VT35195
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VT35195%27 HTTP/1.1" 200 None
2026-03-30 11:31:46 [auto1.es] INFO: Scrape type for VT35195: 0
2026-03-30 11:31:46 [auto1.es] INFO: Found listing with ID: EH02657
2026-03-30 11:31:46 [auto1.es] INFO: Found listing with ID: LB45570
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LB45570%27 HTTP/1.1" 200 None
2026-03-30 11:31:46 [auto1.es] INFO: Scrape type for LB45570: 0
2026-03-30 11:31:46 [auto1.es] INFO: Found listing with ID: UV89988
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UV89988%27 HTTP/1.1" 200 None
2026-03-30 11:31:46 [auto1.es] INFO: Scrape type for UV89988: 2
2026-03-30 11:31:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2fb1fdf-be55-5f76-8f24-149aba69025f with identifier: UV89988
2026-03-30 11:31:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2fb1fdf-be55-5f76-8f24-149aba69025f with scrape type 2
2026-03-30 11:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2fb1fdf-be55-5f76-8f24-149aba69025f with scrape type 2
2026-03-30 11:31:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a2fb1fdf-be55-5f76-8f24-149aba69025f, identifier: UV89988
2026-03-30 11:31:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a2fb1fdf-be55-5f76-8f24-149aba69025f with identifier: UV89988
2026-03-30 11:31:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a2fb1fdf-be55-5f76-8f24-149aba69025f with identifier: UV89988
2026-03-30 11:31:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a2fb1fdf-be55-5f76-8f24-149aba69025f with identifier: UV89988 to the API
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:30:31Z',
'fuel_type': 'diesel',
'id': 'a2fb1fdf-be55-5f76-8f24-149aba69025f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV89988',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 406065,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-11-21',
'seller_name': None,
'title': 'Audi A3 Sportback 2.0 TDI Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2010}
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UV89988%27 HTTP/1.1" 200 None
2026-03-30 11:31:46 [auto1.es] INFO: Saving data for UV89988: {'auction_closing_time': 1774884631.0, 'created_time': 1773952331.309157, 'last_price_update_time': 1774870306.833145}
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UV89988') HTTP/1.1" 204 0
2026-03-30 11:31:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:31:46 [auto1.es] INFO: Found listing with ID: JC23738
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC23738%27 HTTP/1.1" 200 None
2026-03-30 11:31:46 [auto1.es] INFO: Scrape type for JC23738: 0
2026-03-30 11:31:46 [auto1.es] INFO: Found listing with ID: UB42787
2026-03-30 11:31:46 [auto1.es] INFO: Found listing with ID: YU77194
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU77194%27 HTTP/1.1" 200 None
2026-03-30 11:31:46 [auto1.es] INFO: Scrape type for YU77194: 0
2026-03-30 11:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:31:48 [auto1.es] INFO: Channel: 24h | Page: 46 | totalHits: 2245 | hits on page: 40
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: DD46195
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: CZ41335
2026-03-30 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CZ41335%27 HTTP/1.1" 200 None
2026-03-30 11:31:48 [auto1.es] INFO: Scrape type for CZ41335: 0
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: BS14602
2026-03-30 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BS14602%27 HTTP/1.1" 200 None
2026-03-30 11:31:48 [auto1.es] INFO: Scrape type for BS14602: 0
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: CW02489
2026-03-30 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CW02489%27 HTTP/1.1" 200 None
2026-03-30 11:31:48 [auto1.es] INFO: Scrape type for CW02489: 0
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: YL07915
2026-03-30 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YL07915%27 HTTP/1.1" 200 None
2026-03-30 11:31:48 [auto1.es] INFO: Scrape type for YL07915: 0
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: LY43971
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: ML86623
2026-03-30 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ML86623%27 HTTP/1.1" 200 None
2026-03-30 11:31:48 [auto1.es] INFO: Scrape type for ML86623: 0
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: CL39322
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: JC37021
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: UT20809
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: MX17134
2026-03-30 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MX17134%27 HTTP/1.1" 200 None
2026-03-30 11:31:48 [auto1.es] INFO: Scrape type for MX17134: 0
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: TS75802
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: LK62452
2026-03-30 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LK62452%27 HTTP/1.1" 200 None
2026-03-30 11:31:48 [auto1.es] INFO: Scrape type for LK62452: 0
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: YM80761
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: UZ32916
2026-03-30 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UZ32916%27 HTTP/1.1" 200 None
2026-03-30 11:31:48 [auto1.es] INFO: Scrape type for UZ32916: 0
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: VL93613
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: YU55670
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: YS21780
2026-03-30 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YS21780%27 HTTP/1.1" 200 None
2026-03-30 11:31:48 [auto1.es] INFO: Scrape type for YS21780: 0
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: PC51622
2026-03-30 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PC51622%27 HTTP/1.1" 200 None
2026-03-30 11:31:48 [auto1.es] INFO: Scrape type for PC51622: 0
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: RT35335
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: TU21075
2026-03-30 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TU21075%27 HTTP/1.1" 200 None
2026-03-30 11:31:48 [auto1.es] INFO: Scrape type for TU21075: 0
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: PS45222
2026-03-30 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS45222%27 HTTP/1.1" 200 None
2026-03-30 11:31:48 [auto1.es] INFO: Scrape type for PS45222: 0
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: AP64708
2026-03-30 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AP64708%27 HTTP/1.1" 200 None
2026-03-30 11:31:48 [auto1.es] INFO: Scrape type for AP64708: 0
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: YY12745
2026-03-30 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YY12745%27 HTTP/1.1" 200 None
2026-03-30 11:31:48 [auto1.es] INFO: Scrape type for YY12745: 0
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: MW15131
2026-03-30 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MW15131%27 HTTP/1.1" 200 None
2026-03-30 11:31:48 [auto1.es] INFO: Scrape type for MW15131: 0
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: TF48403
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: XL12491
2026-03-30 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XL12491%27 HTTP/1.1" 200 None
2026-03-30 11:31:48 [auto1.es] INFO: Scrape type for XL12491: 0
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: RB88414
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: XL66794
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: WE21693
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: FG54373
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: XS23007
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: UA81124
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: JC49855
2026-03-30 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC49855%27 HTTP/1.1" 200 None
2026-03-30 11:31:48 [auto1.es] INFO: Scrape type for JC49855: 0
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: GT09442
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: SN05978
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: KP85608
2026-03-30 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KP85608%27 HTTP/1.1" 200 None
2026-03-30 11:31:48 [auto1.es] INFO: Scrape type for KP85608: 0
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: JH04975
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: EN74570
2026-03-30 11:31:48 [auto1.es] INFO: Found listing with ID: XA71436
2026-03-30 11:31:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:31:50 [auto1.es] INFO: Channel: 24h | Page: 47 | totalHits: 2245 | hits on page: 40
2026-03-30 11:31:50 [auto1.es] INFO: Found listing with ID: BF21105
2026-03-30 11:31:50 [auto1.es] INFO: Found listing with ID: FN32638
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FN32638%27 HTTP/1.1" 200 None
2026-03-30 11:31:50 [auto1.es] INFO: Scrape type for FN32638: 0
2026-03-30 11:31:50 [auto1.es] INFO: Found listing with ID: PP85710
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PP85710%27 HTTP/1.1" 200 None
2026-03-30 11:31:50 [auto1.es] INFO: Scrape type for PP85710: 2
2026-03-30 11:31:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2acc12d8-461c-568f-8d69-e7f077ba1db4 with identifier: PP85710
2026-03-30 11:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2acc12d8-461c-568f-8d69-e7f077ba1db4 with scrape type 2
2026-03-30 11:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2acc12d8-461c-568f-8d69-e7f077ba1db4 with scrape type 2
2026-03-30 11:31:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2acc12d8-461c-568f-8d69-e7f077ba1db4, identifier: PP85710
2026-03-30 11:31:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2acc12d8-461c-568f-8d69-e7f077ba1db4 with identifier: PP85710
2026-03-30 11:31:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2acc12d8-461c-568f-8d69-e7f077ba1db4 with identifier: PP85710
2026-03-30 11:31:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2acc12d8-461c-568f-8d69-e7f077ba1db4 with identifier: PP85710 to the API
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:31:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:43:33Z',
'fuel_type': 'diesel',
'id': '2acc12d8-461c-568f-8d69-e7f077ba1db4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP85710',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 77691,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-14',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 220 4Matic Exclusive',
'transmission': 'automatic',
'trim': '4Matic Exclusive',
'year': 2019}
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PP85710%27 HTTP/1.1" 200 None
2026-03-30 11:31:51 [auto1.es] INFO: Saving data for PP85710: {'auction_closing_time': 1774885413.0, 'created_time': 1772705132.070516, 'last_price_update_time': 1774870311.047015}
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PP85710') HTTP/1.1" 204 0
2026-03-30 11:31:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:31:51 [auto1.es] INFO: Found listing with ID: GJ06814
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GJ06814%27 HTTP/1.1" 200 None
2026-03-30 11:31:51 [auto1.es] INFO: Scrape type for GJ06814: 0
2026-03-30 11:31:51 [auto1.es] INFO: Found listing with ID: UF43058
2026-03-30 11:31:51 [auto1.es] INFO: Found listing with ID: WC72839
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WC72839%27 HTTP/1.1" 200 None
2026-03-30 11:31:51 [auto1.es] INFO: Scrape type for WC72839: 0
2026-03-30 11:31:51 [auto1.es] INFO: Found listing with ID: XZ49849
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ49849%27 HTTP/1.1" 200 None
2026-03-30 11:31:51 [auto1.es] INFO: Scrape type for XZ49849: 0
2026-03-30 11:31:51 [auto1.es] INFO: Found listing with ID: TU32370
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TU32370%27 HTTP/1.1" 200 None
2026-03-30 11:31:51 [auto1.es] INFO: Scrape type for TU32370: 0
2026-03-30 11:31:51 [auto1.es] INFO: Found listing with ID: YW58225
2026-03-30 11:31:51 [auto1.es] INFO: Found listing with ID: WH26152
2026-03-30 11:31:51 [auto1.es] INFO: Found listing with ID: GJ16527
2026-03-30 11:31:51 [auto1.es] INFO: Found listing with ID: AN25119
2026-03-30 11:31:51 [auto1.es] INFO: Found listing with ID: EA52375
2026-03-30 11:31:51 [auto1.es] INFO: Found listing with ID: PD86662
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD86662%27 HTTP/1.1" 200 None
2026-03-30 11:31:51 [auto1.es] INFO: Scrape type for PD86662: 0
2026-03-30 11:31:51 [auto1.es] INFO: Found listing with ID: JK64156
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JK64156%27 HTTP/1.1" 200 None
2026-03-30 11:31:51 [auto1.es] INFO: Scrape type for JK64156: 0
2026-03-30 11:31:51 [auto1.es] INFO: Found listing with ID: EW34917
2026-03-30 11:31:51 [auto1.es] INFO: Found listing with ID: XN31464
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XN31464%27 HTTP/1.1" 200 None
2026-03-30 11:31:51 [auto1.es] INFO: Scrape type for XN31464: 0
2026-03-30 11:31:51 [auto1.es] INFO: Found listing with ID: DF08485
2026-03-30 11:31:51 [auto1.es] INFO: Found listing with ID: HF43561
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HF43561%27 HTTP/1.1" 200 None
2026-03-30 11:31:51 [auto1.es] INFO: Scrape type for HF43561: 2
2026-03-30 11:31:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9cb4ddb6-c80b-572c-989d-dd920d085813 with identifier: HF43561
2026-03-30 11:31:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9cb4ddb6-c80b-572c-989d-dd920d085813 with scrape type 2
2026-03-30 11:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9cb4ddb6-c80b-572c-989d-dd920d085813 with scrape type 2
2026-03-30 11:31:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9cb4ddb6-c80b-572c-989d-dd920d085813, identifier: HF43561
2026-03-30 11:31:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9cb4ddb6-c80b-572c-989d-dd920d085813 with identifier: HF43561
2026-03-30 11:31:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9cb4ddb6-c80b-572c-989d-dd920d085813 with identifier: HF43561
2026-03-30 11:31:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9cb4ddb6-c80b-572c-989d-dd920d085813 with identifier: HF43561 to the API
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:31:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:02:20Z',
'fuel_type': 'diesel',
'id': '9cb4ddb6-c80b-572c-989d-dd920d085813',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF43561',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 164679,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-04',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2018}
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HF43561%27 HTTP/1.1" 200 None
2026-03-30 11:31:51 [auto1.es] INFO: Saving data for HF43561: {'auction_closing_time': 1774882940.0, 'created_time': 1774037412.290013, 'last_price_update_time': 1774870311.812208}
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HF43561') HTTP/1.1" 204 0
2026-03-30 11:31:51 [auto1.es] INFO: Found listing with ID: ZE85496
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZE85496%27 HTTP/1.1" 200 None
2026-03-30 11:31:51 [auto1.es] INFO: Scrape type for ZE85496: 0
2026-03-30 11:31:51 [auto1.es] INFO: Found listing with ID: DU61809
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DU61809%27 HTTP/1.1" 200 None
2026-03-30 11:31:51 [auto1.es] INFO: Scrape type for DU61809: 0
2026-03-30 11:31:51 [auto1.es] INFO: Found listing with ID: KW07393
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KW07393%27 HTTP/1.1" 200 None
2026-03-30 11:31:51 [auto1.es] INFO: Scrape type for KW07393: 0
2026-03-30 11:31:51 [auto1.es] INFO: Found listing with ID: HC67204
2026-03-30 11:31:51 [auto1.es] INFO: Found listing with ID: AP77113
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AP77113%27 HTTP/1.1" 200 None
2026-03-30 11:31:51 [auto1.es] INFO: Scrape type for AP77113: 0
2026-03-30 11:31:51 [auto1.es] INFO: Found listing with ID: YF73149
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YF73149%27 HTTP/1.1" 200 None
2026-03-30 11:31:52 [auto1.es] INFO: Scrape type for YF73149: 0
2026-03-30 11:31:52 [auto1.es] INFO: Found listing with ID: BY74928
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BY74928%27 HTTP/1.1" 200 None
2026-03-30 11:31:52 [auto1.es] INFO: Scrape type for BY74928: 0
2026-03-30 11:31:52 [auto1.es] INFO: Found listing with ID: WD34727
2026-03-30 11:31:52 [auto1.es] INFO: Found listing with ID: XS50380
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XS50380%27 HTTP/1.1" 200 None
2026-03-30 11:31:52 [auto1.es] INFO: Scrape type for XS50380: 0
2026-03-30 11:31:52 [auto1.es] INFO: Found listing with ID: XA81448
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XA81448%27 HTTP/1.1" 200 None
2026-03-30 11:31:52 [auto1.es] INFO: Scrape type for XA81448: 0
2026-03-30 11:31:52 [auto1.es] INFO: Found listing with ID: XW29028
2026-03-30 11:31:52 [auto1.es] INFO: Found listing with ID: NJ73279
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NJ73279%27 HTTP/1.1" 200 None
2026-03-30 11:31:52 [auto1.es] INFO: Scrape type for NJ73279: 0
2026-03-30 11:31:52 [auto1.es] INFO: Found listing with ID: BR73846
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BR73846%27 HTTP/1.1" 200 None
2026-03-30 11:31:52 [auto1.es] INFO: Scrape type for BR73846: 0
2026-03-30 11:31:52 [auto1.es] INFO: Found listing with ID: LA48157
2026-03-30 11:31:52 [auto1.es] INFO: Found listing with ID: UU20141
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UU20141%27 HTTP/1.1" 200 None
2026-03-30 11:31:52 [auto1.es] INFO: Scrape type for UU20141: 2
2026-03-30 11:31:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e910d34-69ee-5999-9867-bc99485ee249 with identifier: UU20141
2026-03-30 11:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e910d34-69ee-5999-9867-bc99485ee249 with scrape type 2
2026-03-30 11:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e910d34-69ee-5999-9867-bc99485ee249 with scrape type 2
2026-03-30 11:31:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3e910d34-69ee-5999-9867-bc99485ee249, identifier: UU20141
2026-03-30 11:31:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3e910d34-69ee-5999-9867-bc99485ee249 with identifier: UU20141
2026-03-30 11:31:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3e910d34-69ee-5999-9867-bc99485ee249 with identifier: UU20141
2026-03-30 11:31:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3e910d34-69ee-5999-9867-bc99485ee249 with identifier: UU20141 to the API
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:31:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:20:16Z',
'fuel_type': 'diesel',
'id': '3e910d34-69ee-5999-9867-bc99485ee249',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU20141',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 111332,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-24',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2018}
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UU20141%27 HTTP/1.1" 200 None
2026-03-30 11:31:52 [auto1.es] INFO: Saving data for UU20141: {'auction_closing_time': 1774884016.0, 'created_time': 1773918604.030905, 'last_price_update_time': 1774870312.506901}
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UU20141') HTTP/1.1" 204 0
2026-03-30 11:31:52 [auto1.es] INFO: Found listing with ID: TR96675
2026-03-30 11:31:52 [auto1.es] INFO: Found listing with ID: VB99654
2026-03-30 11:31:52 [auto1.es] INFO: Found listing with ID: PK37230
2026-03-30 11:31:52 [auto1.es] INFO: Found listing with ID: DR08098
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DR08098%27 HTTP/1.1" 200 None
2026-03-30 11:31:52 [auto1.es] INFO: Scrape type for DR08098: 0
2026-03-30 11:31:52 [auto1.es] INFO: Found listing with ID: AJ61664
2026-03-30 11:31:52 [auto1.es] INFO: Found listing with ID: FR40817
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FR40817%27 HTTP/1.1" 200 None
2026-03-30 11:31:52 [auto1.es] INFO: Scrape type for FR40817: 0
2026-03-30 11:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:31:56 [auto1.es] INFO: Channel: 24h | Page: 48 | totalHits: 2245 | hits on page: 40
2026-03-30 11:31:56 [auto1.es] INFO: Found listing with ID: WC06824
2026-03-30 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WC06824%27 HTTP/1.1" 200 None
2026-03-30 11:31:56 [auto1.es] INFO: Scrape type for WC06824: 0
2026-03-30 11:31:56 [auto1.es] INFO: Found listing with ID: DL11284
2026-03-30 11:31:56 [auto1.es] INFO: Found listing with ID: SK07271
2026-03-30 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SK07271%27 HTTP/1.1" 200 None
2026-03-30 11:31:56 [auto1.es] INFO: Scrape type for SK07271: 0
2026-03-30 11:31:56 [auto1.es] INFO: Found listing with ID: XH48089
2026-03-30 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH48089%27 HTTP/1.1" 200 None
2026-03-30 11:31:56 [auto1.es] INFO: Scrape type for XH48089: 0
2026-03-30 11:31:56 [auto1.es] INFO: Found listing with ID: VY31603
2026-03-30 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY31603%27 HTTP/1.1" 200 None
2026-03-30 11:31:56 [auto1.es] INFO: Scrape type for VY31603: 0
2026-03-30 11:31:56 [auto1.es] INFO: Found listing with ID: ZL78219
2026-03-30 11:31:56 [auto1.es] INFO: Found listing with ID: EN05559
2026-03-30 11:31:56 [auto1.es] INFO: Found listing with ID: KV41270
2026-03-30 11:31:56 [auto1.es] INFO: Found listing with ID: TV36544
2026-03-30 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV36544%27 HTTP/1.1" 200 None
2026-03-30 11:31:56 [auto1.es] INFO: Scrape type for TV36544: 0
2026-03-30 11:31:56 [auto1.es] INFO: Found listing with ID: NY16020
2026-03-30 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NY16020%27 HTTP/1.1" 200 None
2026-03-30 11:31:56 [auto1.es] INFO: Scrape type for NY16020: 0
2026-03-30 11:31:56 [auto1.es] INFO: Found listing with ID: ZZ18199
2026-03-30 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZZ18199%27 HTTP/1.1" 200 None
2026-03-30 11:31:56 [auto1.es] INFO: Scrape type for ZZ18199: 0
2026-03-30 11:31:56 [auto1.es] INFO: Found listing with ID: SL87514
2026-03-30 11:31:56 [auto1.es] INFO: Found listing with ID: TR33339
2026-03-30 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TR33339%27 HTTP/1.1" 200 None
2026-03-30 11:31:56 [auto1.es] INFO: Scrape type for TR33339: 0
2026-03-30 11:31:56 [auto1.es] INFO: Found listing with ID: JW07247
2026-03-30 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW07247%27 HTTP/1.1" 200 None
2026-03-30 11:31:56 [auto1.es] INFO: Scrape type for JW07247: 0
2026-03-30 11:31:56 [auto1.es] INFO: Found listing with ID: LV56361
2026-03-30 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV56361%27 HTTP/1.1" 200 None
2026-03-30 11:31:56 [auto1.es] INFO: Scrape type for LV56361: 0
2026-03-30 11:31:56 [auto1.es] INFO: Found listing with ID: VY28267
2026-03-30 11:31:56 [auto1.es] INFO: Found listing with ID: ZW73484
2026-03-30 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZW73484%27 HTTP/1.1" 200 None
2026-03-30 11:31:56 [auto1.es] INFO: Scrape type for ZW73484: 0
2026-03-30 11:31:56 [auto1.es] INFO: Found listing with ID: JF75670
2026-03-30 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JF75670%27 HTTP/1.1" 200 None
2026-03-30 11:31:56 [auto1.es] INFO: Scrape type for JF75670: 0
2026-03-30 11:31:56 [auto1.es] INFO: Found listing with ID: EU98432
2026-03-30 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EU98432%27 HTTP/1.1" 200 None
2026-03-30 11:31:56 [auto1.es] INFO: Scrape type for EU98432: 0
2026-03-30 11:31:56 [auto1.es] INFO: Found listing with ID: FH30373
2026-03-30 11:31:56 [auto1.es] INFO: Found listing with ID: UK08613
2026-03-30 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UK08613%27 HTTP/1.1" 200 None
2026-03-30 11:31:56 [auto1.es] INFO: Scrape type for UK08613: 0
2026-03-30 11:31:56 [auto1.es] INFO: Found listing with ID: XX98366
2026-03-30 11:31:56 [auto1.es] INFO: Found listing with ID: NL75511
2026-03-30 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NL75511%27 HTTP/1.1" 200 None
2026-03-30 11:31:56 [auto1.es] INFO: Scrape type for NL75511: 2
2026-03-30 11:31:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e4ea1f7-300e-57b2-ab32-2518ff9b18f9 with identifier: NL75511
2026-03-30 11:31:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e4ea1f7-300e-57b2-ab32-2518ff9b18f9 with scrape type 2
2026-03-30 11:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e4ea1f7-300e-57b2-ab32-2518ff9b18f9 with scrape type 2
2026-03-30 11:31:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7e4ea1f7-300e-57b2-ab32-2518ff9b18f9, identifier: NL75511
2026-03-30 11:31:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7e4ea1f7-300e-57b2-ab32-2518ff9b18f9 with identifier: NL75511
2026-03-30 11:31:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7e4ea1f7-300e-57b2-ab32-2518ff9b18f9 with identifier: NL75511
2026-03-30 11:31:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7e4ea1f7-300e-57b2-ab32-2518ff9b18f9 with identifier: NL75511 to the API
2026-03-30 11:31:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:31:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:31:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:27:02Z',
'fuel_type': 'petrol',
'id': '7e4ea1f7-300e-57b2-ab32-2518ff9b18f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL75511',
'listing': 'auction',
'make': 'Audi',
'model': 'A1',
'odometer': 23272,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-06',
'seller_name': None,
'title': 'Audi A1 1.4 TFSI Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2011}
2026-03-30 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NL75511%27 HTTP/1.1" 200 None
2026-03-30 11:31:57 [auto1.es] INFO: Saving data for NL75511: {'auction_closing_time': 1774884422.0, 'created_time': 1773432589.545972, 'last_price_update_time': 1774870317.360722}
2026-03-30 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NL75511') HTTP/1.1" 204 0
2026-03-30 11:31:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:31:57 [auto1.es] INFO: Found listing with ID: LL24572
2026-03-30 11:31:57 [auto1.es] INFO: Found listing with ID: FT04300
2026-03-30 11:31:57 [auto1.es] INFO: Found listing with ID: GX91950
2026-03-30 11:31:57 [auto1.es] INFO: Found listing with ID: TZ81028
2026-03-30 11:31:57 [auto1.es] INFO: Found listing with ID: ZC95482
2026-03-30 11:31:57 [auto1.es] INFO: Found listing with ID: XJ69303
2026-03-30 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XJ69303%27 HTTP/1.1" 200 None
2026-03-30 11:31:57 [auto1.es] INFO: Scrape type for XJ69303: 0
2026-03-30 11:31:57 [auto1.es] INFO: Found listing with ID: UU89702
2026-03-30 11:31:57 [auto1.es] INFO: Found listing with ID: VC68158
2026-03-30 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC68158%27 HTTP/1.1" 200 None
2026-03-30 11:31:57 [auto1.es] INFO: Scrape type for VC68158: 0
2026-03-30 11:31:57 [auto1.es] INFO: Found listing with ID: JC38983
2026-03-30 11:31:57 [auto1.es] INFO: Found listing with ID: VR01411
2026-03-30 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VR01411%27 HTTP/1.1" 200 None
2026-03-30 11:31:57 [auto1.es] INFO: Scrape type for VR01411: 0
2026-03-30 11:31:57 [auto1.es] INFO: Found listing with ID: PD45625
2026-03-30 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD45625%27 HTTP/1.1" 200 None
2026-03-30 11:31:57 [auto1.es] INFO: Scrape type for PD45625: 0
2026-03-30 11:31:57 [auto1.es] INFO: Found listing with ID: ND59157
2026-03-30 11:31:57 [auto1.es] INFO: Found listing with ID: VY26684
2026-03-30 11:31:57 [auto1.es] INFO: Found listing with ID: MK23766
2026-03-30 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MK23766%27 HTTP/1.1" 200 None
2026-03-30 11:31:57 [auto1.es] INFO: Scrape type for MK23766: 0
2026-03-30 11:31:57 [auto1.es] INFO: Found listing with ID: VC05043
2026-03-30 11:31:57 [auto1.es] INFO: Found listing with ID: UH68821
2026-03-30 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UH68821%27 HTTP/1.1" 200 None
2026-03-30 11:31:57 [auto1.es] INFO: Scrape type for UH68821: 0
2026-03-30 11:31:57 [auto1.es] INFO: Found listing with ID: UP55531
2026-03-30 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UP55531%27 HTTP/1.1" 200 None
2026-03-30 11:31:57 [auto1.es] INFO: Scrape type for UP55531: 0
2026-03-30 11:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:31:59 [auto1.es] INFO: Channel: 24h | Page: 49 | totalHits: 2245 | hits on page: 40
2026-03-30 11:31:59 [auto1.es] INFO: Found listing with ID: BR35184
2026-03-30 11:31:59 [auto1.es] INFO: Found listing with ID: KK03288
2026-03-30 11:31:59 [auto1.es] INFO: Found listing with ID: AR59073
2026-03-30 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR59073%27 HTTP/1.1" 200 None
2026-03-30 11:31:59 [auto1.es] INFO: Scrape type for AR59073: 0
2026-03-30 11:31:59 [auto1.es] INFO: Found listing with ID: HP42544
2026-03-30 11:31:59 [auto1.es] INFO: Found listing with ID: UP27315
2026-03-30 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UP27315%27 HTTP/1.1" 200 None
2026-03-30 11:31:59 [auto1.es] INFO: Scrape type for UP27315: 0
2026-03-30 11:31:59 [auto1.es] INFO: Found listing with ID: CR84391
2026-03-30 11:31:59 [auto1.es] INFO: Found listing with ID: ZM86466
2026-03-30 11:31:59 [auto1.es] INFO: Found listing with ID: KD09714
2026-03-30 11:31:59 [auto1.es] INFO: Found listing with ID: VP18393
2026-03-30 11:31:59 [auto1.es] INFO: Found listing with ID: GV40212
2026-03-30 11:31:59 [auto1.es] INFO: Found listing with ID: NY33487
2026-03-30 11:31:59 [auto1.es] INFO: Found listing with ID: JT33139
2026-03-30 11:31:59 [auto1.es] INFO: Found listing with ID: NW63422
2026-03-30 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NW63422%27 HTTP/1.1" 200 None
2026-03-30 11:31:59 [auto1.es] INFO: Scrape type for NW63422: 0
2026-03-30 11:31:59 [auto1.es] INFO: Found listing with ID: XN45249
2026-03-30 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XN45249%27 HTTP/1.1" 200 None
2026-03-30 11:31:59 [auto1.es] INFO: Scrape type for XN45249: 0
2026-03-30 11:31:59 [auto1.es] INFO: Found listing with ID: DS74778
2026-03-30 11:31:59 [auto1.es] INFO: Found listing with ID: MD70003
2026-03-30 11:31:59 [auto1.es] INFO: Found listing with ID: AM05329
2026-03-30 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AM05329%27 HTTP/1.1" 200 None
2026-03-30 11:31:59 [auto1.es] INFO: Scrape type for AM05329: 0
2026-03-30 11:31:59 [auto1.es] INFO: Found listing with ID: BY33283
2026-03-30 11:31:59 [auto1.es] INFO: Found listing with ID: VU28227
2026-03-30 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VU28227%27 HTTP/1.1" 200 None
2026-03-30 11:31:59 [auto1.es] INFO: Scrape type for VU28227: 0
2026-03-30 11:31:59 [auto1.es] INFO: Found listing with ID: ZL27133
2026-03-30 11:31:59 [auto1.es] INFO: Found listing with ID: AP64153
2026-03-30 11:31:59 [auto1.es] INFO: Found listing with ID: JZ51794
2026-03-30 11:31:59 [auto1.es] INFO: Found listing with ID: RD07091
2026-03-30 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD07091%27 HTTP/1.1" 200 None
2026-03-30 11:31:59 [auto1.es] INFO: Scrape type for RD07091: 0
2026-03-30 11:31:59 [auto1.es] INFO: Found listing with ID: JG89903
2026-03-30 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG89903%27 HTTP/1.1" 200 None
2026-03-30 11:31:59 [auto1.es] INFO: Scrape type for JG89903: 0
2026-03-30 11:31:59 [auto1.es] INFO: Found listing with ID: LE34718
2026-03-30 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LE34718%27 HTTP/1.1" 200 None
2026-03-30 11:31:59 [auto1.es] INFO: Scrape type for LE34718: 0
2026-03-30 11:31:59 [auto1.es] INFO: Found listing with ID: GX38118
2026-03-30 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GX38118%27 HTTP/1.1" 200 None
2026-03-30 11:31:59 [auto1.es] INFO: Scrape type for GX38118: 0
2026-03-30 11:31:59 [auto1.es] INFO: Found listing with ID: ZM34932
2026-03-30 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZM34932%27 HTTP/1.1" 200 None
2026-03-30 11:31:59 [auto1.es] INFO: Scrape type for ZM34932: 0
2026-03-30 11:31:59 [auto1.es] INFO: Found listing with ID: CG09187
2026-03-30 11:31:59 [auto1.es] INFO: Found listing with ID: EB62750
2026-03-30 11:31:59 [auto1.es] INFO: Found listing with ID: TK95363
2026-03-30 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TK95363%27 HTTP/1.1" 200 None
2026-03-30 11:31:59 [auto1.es] INFO: Scrape type for TK95363: 0
2026-03-30 11:31:59 [auto1.es] INFO: Found listing with ID: WN54679
2026-03-30 11:31:59 [auto1.es] INFO: Found listing with ID: SW23101
2026-03-30 11:31:59 [auto1.es] INFO: Found listing with ID: LC59267
2026-03-30 11:31:59 [auto1.es] INFO: Found listing with ID: ZL32724
2026-03-30 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL32724%27 HTTP/1.1" 200 None
2026-03-30 11:31:59 [auto1.es] INFO: Scrape type for ZL32724: 0
2026-03-30 11:31:59 [auto1.es] INFO: Found listing with ID: YK51395
2026-03-30 11:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YK51395%27 HTTP/1.1" 200 None
2026-03-30 11:32:00 [auto1.es] INFO: Scrape type for YK51395: 0
2026-03-30 11:32:00 [auto1.es] INFO: Found listing with ID: GL92788
2026-03-30 11:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GL92788%27 HTTP/1.1" 200 None
2026-03-30 11:32:00 [auto1.es] INFO: Scrape type for GL92788: 0
2026-03-30 11:32:00 [auto1.es] INFO: Found listing with ID: VF01083
2026-03-30 11:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VF01083%27 HTTP/1.1" 200 None
2026-03-30 11:32:00 [auto1.es] INFO: Scrape type for VF01083: 0
2026-03-30 11:32:00 [auto1.es] INFO: Found listing with ID: BG05674
2026-03-30 11:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BG05674%27 HTTP/1.1" 200 None
2026-03-30 11:32:00 [auto1.es] INFO: Scrape type for BG05674: 0
2026-03-30 11:32:00 [auto1.es] INFO: Found listing with ID: UD80298
2026-03-30 11:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UD80298%27 HTTP/1.1" 200 None
2026-03-30 11:32:00 [auto1.es] INFO: Scrape type for UD80298: 0
2026-03-30 11:32:00 [auto1.es] INFO: Found listing with ID: FZ04394
2026-03-30 11:32:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:32:04 [scrapy.extensions.logstats] INFO: Crawled 227 pages (at 9 pages/min), scraped 235 items (at 8 items/min)
2026-03-30 11:32:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-30 11:33:04 [scrapy.extensions.logstats] INFO: Crawled 227 pages (at 0 pages/min), scraped 235 items (at 0 items/min)
2026-03-30 11:33:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-30 11:33:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:05 [auto1.es] INFO: Channel: 24h | Page: 50 | totalHits: 2245 | hits on page: 40
2026-03-30 11:33:05 [auto1.es] INFO: Found listing with ID: YL06778
2026-03-30 11:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YL06778%27 HTTP/1.1" 200 None
2026-03-30 11:33:05 [auto1.es] INFO: Scrape type for YL06778: 0
2026-03-30 11:33:05 [auto1.es] INFO: Found listing with ID: AV93278
2026-03-30 11:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AV93278%27 HTTP/1.1" 200 None
2026-03-30 11:33:05 [auto1.es] INFO: Scrape type for AV93278: 0
2026-03-30 11:33:05 [auto1.es] INFO: Found listing with ID: MP31569
2026-03-30 11:33:05 [auto1.es] INFO: Found listing with ID: GR78945
2026-03-30 11:33:05 [auto1.es] INFO: Found listing with ID: CR48575
2026-03-30 11:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CR48575%27 HTTP/1.1" 200 None
2026-03-30 11:33:05 [auto1.es] INFO: Scrape type for CR48575: 0
2026-03-30 11:33:05 [auto1.es] INFO: Found listing with ID: JY09497
2026-03-30 11:33:05 [auto1.es] INFO: Found listing with ID: BZ21450
2026-03-30 11:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BZ21450%27 HTTP/1.1" 200 None
2026-03-30 11:33:05 [auto1.es] INFO: Scrape type for BZ21450: 0
2026-03-30 11:33:05 [auto1.es] INFO: Found listing with ID: UT89838
2026-03-30 11:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT89838%27 HTTP/1.1" 200 None
2026-03-30 11:33:05 [auto1.es] INFO: Scrape type for UT89838: 0
2026-03-30 11:33:05 [auto1.es] INFO: Found listing with ID: JX90216
2026-03-30 11:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JX90216%27 HTTP/1.1" 200 None
2026-03-30 11:33:05 [auto1.es] INFO: Scrape type for JX90216: 0
2026-03-30 11:33:05 [auto1.es] INFO: Found listing with ID: DC35826
2026-03-30 11:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DC35826%27 HTTP/1.1" 200 None
2026-03-30 11:33:05 [auto1.es] INFO: Scrape type for DC35826: 0
2026-03-30 11:33:05 [auto1.es] INFO: Found listing with ID: FG81749
2026-03-30 11:33:05 [auto1.es] INFO: Found listing with ID: BR13060
2026-03-30 11:33:05 [auto1.es] INFO: Found listing with ID: HA51253
2026-03-30 11:33:05 [auto1.es] INFO: Found listing with ID: RR74853
2026-03-30 11:33:05 [auto1.es] INFO: Found listing with ID: GE94512
2026-03-30 11:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GE94512%27 HTTP/1.1" 200 None
2026-03-30 11:33:05 [auto1.es] INFO: Scrape type for GE94512: 2
2026-03-30 11:33:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdefd8f0-3ab0-5766-9580-b204553ffbf9 with identifier: GE94512
2026-03-30 11:33:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdefd8f0-3ab0-5766-9580-b204553ffbf9 with scrape type 2
2026-03-30 11:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bdefd8f0-3ab0-5766-9580-b204553ffbf9 with scrape type 2
2026-03-30 11:33:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bdefd8f0-3ab0-5766-9580-b204553ffbf9, identifier: GE94512
2026-03-30 11:33:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bdefd8f0-3ab0-5766-9580-b204553ffbf9 with identifier: GE94512
2026-03-30 11:33:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bdefd8f0-3ab0-5766-9580-b204553ffbf9 with identifier: GE94512
2026-03-30 11:33:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bdefd8f0-3ab0-5766-9580-b204553ffbf9 with identifier: GE94512 to the API
2026-03-30 11:33:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:33:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:33:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:53:06Z',
'fuel_type': 'diesel',
'id': 'bdefd8f0-3ab0-5766-9580-b204553ffbf9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE94512',
'listing': 'auction',
'make': 'Seat',
'model': 'Tarraco',
'odometer': 61841,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-08',
'seller_name': None,
'title': 'Seat Tarraco 2.0 TDI Xcellence',
'transmission': 'automatic',
'trim': 'Xcellence',
'year': 2021}
2026-03-30 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GE94512%27 HTTP/1.1" 200 None
2026-03-30 11:33:06 [auto1.es] INFO: Saving data for GE94512: {'auction_closing_time': 1774885986.0, 'created_time': 1773918578.516804, 'last_price_update_time': 1774870386.055567}
2026-03-30 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GE94512') HTTP/1.1" 204 0
2026-03-30 11:33:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:06 [auto1.es] INFO: Found listing with ID: CY04008
2026-03-30 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CY04008%27 HTTP/1.1" 200 None
2026-03-30 11:33:06 [auto1.es] INFO: Scrape type for CY04008: 0
2026-03-30 11:33:06 [auto1.es] INFO: Found listing with ID: JV95856
2026-03-30 11:33:06 [auto1.es] INFO: Found listing with ID: CM70741
2026-03-30 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CM70741%27 HTTP/1.1" 200 None
2026-03-30 11:33:06 [auto1.es] INFO: Scrape type for CM70741: 0
2026-03-30 11:33:06 [auto1.es] INFO: Found listing with ID: DC47971
2026-03-30 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DC47971%27 HTTP/1.1" 200 None
2026-03-30 11:33:06 [auto1.es] INFO: Scrape type for DC47971: 0
2026-03-30 11:33:06 [auto1.es] INFO: Found listing with ID: DD74793
2026-03-30 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD74793%27 HTTP/1.1" 200 None
2026-03-30 11:33:06 [auto1.es] INFO: Scrape type for DD74793: 0
2026-03-30 11:33:06 [auto1.es] INFO: Found listing with ID: VT11458
2026-03-30 11:33:06 [auto1.es] INFO: Found listing with ID: XC40695
2026-03-30 11:33:06 [auto1.es] INFO: Found listing with ID: TT72287
2026-03-30 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TT72287%27 HTTP/1.1" 200 None
2026-03-30 11:33:06 [auto1.es] INFO: Scrape type for TT72287: 0
2026-03-30 11:33:06 [auto1.es] INFO: Found listing with ID: EY91693
2026-03-30 11:33:06 [auto1.es] INFO: Found listing with ID: PW28611
2026-03-30 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PW28611%27 HTTP/1.1" 200 None
2026-03-30 11:33:06 [auto1.es] INFO: Scrape type for PW28611: 0
2026-03-30 11:33:06 [auto1.es] INFO: Found listing with ID: ME07403
2026-03-30 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ME07403%27 HTTP/1.1" 200 None
2026-03-30 11:33:06 [auto1.es] INFO: Scrape type for ME07403: 0
2026-03-30 11:33:06 [auto1.es] INFO: Found listing with ID: JR29098
2026-03-30 11:33:06 [auto1.es] INFO: Found listing with ID: JE65744
2026-03-30 11:33:06 [auto1.es] INFO: Found listing with ID: RU65769
2026-03-30 11:33:06 [auto1.es] INFO: Found listing with ID: LC77404
2026-03-30 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC77404%27 HTTP/1.1" 200 None
2026-03-30 11:33:06 [auto1.es] INFO: Scrape type for LC77404: 0
2026-03-30 11:33:06 [auto1.es] INFO: Found listing with ID: FK65100
2026-03-30 11:33:06 [auto1.es] INFO: Found listing with ID: LS69638
2026-03-30 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LS69638%27 HTTP/1.1" 200 None
2026-03-30 11:33:06 [auto1.es] INFO: Scrape type for LS69638: 0
2026-03-30 11:33:06 [auto1.es] INFO: Found listing with ID: XG18917
2026-03-30 11:33:06 [auto1.es] INFO: Found listing with ID: FU29422
2026-03-30 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FU29422%27 HTTP/1.1" 200 None
2026-03-30 11:33:06 [auto1.es] INFO: Scrape type for FU29422: 0
2026-03-30 11:33:06 [auto1.es] INFO: Found listing with ID: FX14772
2026-03-30 11:33:06 [auto1.es] INFO: Found listing with ID: ML17412
2026-03-30 11:33:06 [auto1.es] INFO: Found listing with ID: KC46578
2026-03-30 11:33:06 [auto1.es] INFO: Found listing with ID: XR73155
2026-03-30 11:33:06 [auto1.es] INFO: Found listing with ID: RK55405
2026-03-30 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK55405%27 HTTP/1.1" 200 None
2026-03-30 11:33:06 [auto1.es] INFO: Scrape type for RK55405: 0
2026-03-30 11:33:06 [auto1.es] INFO: Found listing with ID: MW76524
2026-03-30 11:33:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:26 [auto1.es] INFO: Channel: 24h | Page: 51 | totalHits: 2245 | hits on page: 40
2026-03-30 11:33:26 [auto1.es] INFO: Found listing with ID: PL96310
2026-03-30 11:33:26 [auto1.es] INFO: Found listing with ID: XZ20616
2026-03-30 11:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ20616%27 HTTP/1.1" 200 None
2026-03-30 11:33:26 [auto1.es] INFO: Scrape type for XZ20616: 0
2026-03-30 11:33:26 [auto1.es] INFO: Found listing with ID: DL51279
2026-03-30 11:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL51279%27 HTTP/1.1" 200 None
2026-03-30 11:33:26 [auto1.es] INFO: Scrape type for DL51279: 0
2026-03-30 11:33:26 [auto1.es] INFO: Found listing with ID: KD88168
2026-03-30 11:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KD88168%27 HTTP/1.1" 200 None
2026-03-30 11:33:26 [auto1.es] INFO: Scrape type for KD88168: 0
2026-03-30 11:33:26 [auto1.es] INFO: Found listing with ID: LP98864
2026-03-30 11:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LP98864%27 HTTP/1.1" 200 None
2026-03-30 11:33:26 [auto1.es] INFO: Scrape type for LP98864: 0
2026-03-30 11:33:26 [auto1.es] INFO: Found listing with ID: SZ95909
2026-03-30 11:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SZ95909%27 HTTP/1.1" 200 None
2026-03-30 11:33:26 [auto1.es] INFO: Scrape type for SZ95909: 0
2026-03-30 11:33:26 [auto1.es] INFO: Found listing with ID: YK45669
2026-03-30 11:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YK45669%27 HTTP/1.1" 200 None
2026-03-30 11:33:26 [auto1.es] INFO: Scrape type for YK45669: 0
2026-03-30 11:33:26 [auto1.es] INFO: Found listing with ID: ZN14981
2026-03-30 11:33:26 [auto1.es] INFO: Found listing with ID: XX41705
2026-03-30 11:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XX41705%27 HTTP/1.1" 200 None
2026-03-30 11:33:26 [auto1.es] INFO: Scrape type for XX41705: 0
2026-03-30 11:33:26 [auto1.es] INFO: Found listing with ID: KE50509
2026-03-30 11:33:26 [auto1.es] INFO: Found listing with ID: RR11017
2026-03-30 11:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RR11017%27 HTTP/1.1" 200 None
2026-03-30 11:33:26 [auto1.es] INFO: Scrape type for RR11017: 0
2026-03-30 11:33:26 [auto1.es] INFO: Found listing with ID: WX13119
2026-03-30 11:33:26 [auto1.es] INFO: Found listing with ID: XF66468
2026-03-30 11:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XF66468%27 HTTP/1.1" 200 None
2026-03-30 11:33:26 [auto1.es] INFO: Scrape type for XF66468: 0
2026-03-30 11:33:26 [auto1.es] INFO: Found listing with ID: WZ85087
2026-03-30 11:33:26 [auto1.es] INFO: Found listing with ID: CT91769
2026-03-30 11:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CT91769%27 HTTP/1.1" 200 None
2026-03-30 11:33:26 [auto1.es] INFO: Scrape type for CT91769: 0
2026-03-30 11:33:26 [auto1.es] INFO: Found listing with ID: TT49974
2026-03-30 11:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TT49974%27 HTTP/1.1" 200 None
2026-03-30 11:33:26 [auto1.es] INFO: Scrape type for TT49974: 0
2026-03-30 11:33:26 [auto1.es] INFO: Found listing with ID: AE24734
2026-03-30 11:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE24734%27 HTTP/1.1" 200 None
2026-03-30 11:33:26 [auto1.es] INFO: Scrape type for AE24734: 0
2026-03-30 11:33:26 [auto1.es] INFO: Found listing with ID: YW75502
2026-03-30 11:33:26 [auto1.es] INFO: Found listing with ID: JY28028
2026-03-30 11:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JY28028%27 HTTP/1.1" 200 None
2026-03-30 11:33:26 [auto1.es] INFO: Scrape type for JY28028: 0
2026-03-30 11:33:26 [auto1.es] INFO: Found listing with ID: CT45338
2026-03-30 11:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CT45338%27 HTTP/1.1" 200 None
2026-03-30 11:33:26 [auto1.es] INFO: Scrape type for CT45338: 0
2026-03-30 11:33:26 [auto1.es] INFO: Found listing with ID: WZ34012
2026-03-30 11:33:26 [auto1.es] INFO: Found listing with ID: MT58726
2026-03-30 11:33:26 [auto1.es] INFO: Found listing with ID: KT63961
2026-03-30 11:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KT63961%27 HTTP/1.1" 200 None
2026-03-30 11:33:27 [auto1.es] INFO: Scrape type for KT63961: 0
2026-03-30 11:33:27 [auto1.es] INFO: Found listing with ID: ZA21810
2026-03-30 11:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZA21810%27 HTTP/1.1" 200 None
2026-03-30 11:33:27 [auto1.es] INFO: Scrape type for ZA21810: 0
2026-03-30 11:33:27 [auto1.es] INFO: Found listing with ID: VR29926
2026-03-30 11:33:27 [auto1.es] INFO: Found listing with ID: SV29323
2026-03-30 11:33:27 [auto1.es] INFO: Found listing with ID: VT96833
2026-03-30 11:33:27 [auto1.es] INFO: Found listing with ID: BE63337
2026-03-30 11:33:27 [auto1.es] INFO: Found listing with ID: RH33829
2026-03-30 11:33:27 [auto1.es] INFO: Found listing with ID: EY86051
2026-03-30 11:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY86051%27 HTTP/1.1" 200 None
2026-03-30 11:33:27 [auto1.es] INFO: Scrape type for EY86051: 0
2026-03-30 11:33:27 [auto1.es] INFO: Found listing with ID: RK09701
2026-03-30 11:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK09701%27 HTTP/1.1" 200 None
2026-03-30 11:33:27 [auto1.es] INFO: Scrape type for RK09701: 0
2026-03-30 11:33:27 [auto1.es] INFO: Found listing with ID: MY48214
2026-03-30 11:33:27 [auto1.es] INFO: Found listing with ID: SM51869
2026-03-30 11:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SM51869%27 HTTP/1.1" 200 None
2026-03-30 11:33:27 [auto1.es] INFO: Scrape type for SM51869: 0
2026-03-30 11:33:27 [auto1.es] INFO: Found listing with ID: UN59874
2026-03-30 11:33:27 [auto1.es] INFO: Found listing with ID: DH56387
2026-03-30 11:33:27 [auto1.es] INFO: Found listing with ID: SC27418
2026-03-30 11:33:27 [auto1.es] INFO: Found listing with ID: ZJ95453
2026-03-30 11:33:27 [auto1.es] INFO: Found listing with ID: HR31272
2026-03-30 11:33:27 [auto1.es] INFO: Found listing with ID: PA92548
2026-03-30 11:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PA92548%27 HTTP/1.1" 200 None
2026-03-30 11:33:27 [auto1.es] INFO: Scrape type for PA92548: 0
2026-03-30 11:33:27 [auto1.es] INFO: Found listing with ID: LM00276
2026-03-30 11:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LM00276%27 HTTP/1.1" 200 None
2026-03-30 11:33:27 [auto1.es] INFO: Scrape type for LM00276: 0
2026-03-30 11:33:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:34:04 [scrapy.extensions.logstats] INFO: Crawled 229 pages (at 2 pages/min), scraped 236 items (at 1 items/min)
2026-03-30 11:34:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-30 11:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:08 [auto1.es] INFO: Channel: 24h | Page: 52 | totalHits: 2246 | hits on page: 40
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: LM00276
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LM00276%27 HTTP/1.1" 200 None
2026-03-30 11:34:08 [auto1.es] INFO: Scrape type for LM00276: 0
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: YU51978
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU51978%27 HTTP/1.1" 200 None
2026-03-30 11:34:08 [auto1.es] INFO: Scrape type for YU51978: 0
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: MA61689
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA61689%27 HTTP/1.1" 200 None
2026-03-30 11:34:08 [auto1.es] INFO: Scrape type for MA61689: 0
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: ED57476
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: TW11063
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: RN82930
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: MF36359
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MF36359%27 HTTP/1.1" 200 None
2026-03-30 11:34:08 [auto1.es] INFO: Scrape type for MF36359: 0
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: JG85850
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG85850%27 HTTP/1.1" 200 None
2026-03-30 11:34:08 [auto1.es] INFO: Scrape type for JG85850: 0
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: FC13262
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FC13262%27 HTTP/1.1" 200 None
2026-03-30 11:34:08 [auto1.es] INFO: Scrape type for FC13262: 0
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: ZW97071
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZW97071%27 HTTP/1.1" 200 None
2026-03-30 11:34:08 [auto1.es] INFO: Scrape type for ZW97071: 0
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: EG32676
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: VC62552
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: PF61621
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: CP49442
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CP49442%27 HTTP/1.1" 200 None
2026-03-30 11:34:08 [auto1.es] INFO: Scrape type for CP49442: 0
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: AD67761
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: RT04886
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RT04886%27 HTTP/1.1" 200 None
2026-03-30 11:34:08 [auto1.es] INFO: Scrape type for RT04886: 0
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: GA00375
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: ZJ56625
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: VN13138
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VN13138%27 HTTP/1.1" 200 None
2026-03-30 11:34:08 [auto1.es] INFO: Scrape type for VN13138: 0
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: ZC64345
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC64345%27 HTTP/1.1" 200 None
2026-03-30 11:34:08 [auto1.es] INFO: Scrape type for ZC64345: 0
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: AR88261
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: MD04984
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD04984%27 HTTP/1.1" 200 None
2026-03-30 11:34:08 [auto1.es] INFO: Scrape type for MD04984: 0
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: MU93951
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MU93951%27 HTTP/1.1" 200 None
2026-03-30 11:34:08 [auto1.es] INFO: Scrape type for MU93951: 0
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: WV15930
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: WW30264
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WW30264%27 HTTP/1.1" 200 None
2026-03-30 11:34:08 [auto1.es] INFO: Scrape type for WW30264: 0
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: UF95473
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF95473%27 HTTP/1.1" 200 None
2026-03-30 11:34:08 [auto1.es] INFO: Scrape type for UF95473: 0
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: TH31010
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: TZ65854
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TZ65854%27 HTTP/1.1" 200 None
2026-03-30 11:34:08 [auto1.es] INFO: Scrape type for TZ65854: 0
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: TD60260
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TD60260%27 HTTP/1.1" 200 None
2026-03-30 11:34:08 [auto1.es] INFO: Scrape type for TD60260: 0
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: UL24539
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: TB73704
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: GB72499
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: RY22174
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RY22174%27 HTTP/1.1" 200 None
2026-03-30 11:34:08 [auto1.es] INFO: Scrape type for RY22174: 0
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: TX70336
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: MA61086
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA61086%27 HTTP/1.1" 200 None
2026-03-30 11:34:08 [auto1.es] INFO: Scrape type for MA61086: 0
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: YH86623
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: YX68233
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YX68233%27 HTTP/1.1" 200 None
2026-03-30 11:34:08 [auto1.es] INFO: Scrape type for YX68233: 0
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: SV12911
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SV12911%27 HTTP/1.1" 200 None
2026-03-30 11:34:08 [auto1.es] INFO: Scrape type for SV12911: 0
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: EJ16249
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EJ16249%27 HTTP/1.1" 200 None
2026-03-30 11:34:08 [auto1.es] INFO: Scrape type for EJ16249: 0
2026-03-30 11:34:08 [auto1.es] INFO: Found listing with ID: AS19038
2026-03-30 11:34:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:09 [auto1.es] INFO: Channel: 24h | Page: 53 | totalHits: 2246 | hits on page: 40
2026-03-30 11:34:09 [auto1.es] INFO: Found listing with ID: YH97828
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH97828%27 HTTP/1.1" 200 None
2026-03-30 11:34:09 [auto1.es] INFO: Scrape type for YH97828: 0
2026-03-30 11:34:09 [auto1.es] INFO: Found listing with ID: GZ44252
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GZ44252%27 HTTP/1.1" 200 None
2026-03-30 11:34:09 [auto1.es] INFO: Scrape type for GZ44252: 0
2026-03-30 11:34:09 [auto1.es] INFO: Found listing with ID: BF55946
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF55946%27 HTTP/1.1" 200 None
2026-03-30 11:34:09 [auto1.es] INFO: Scrape type for BF55946: 0
2026-03-30 11:34:09 [auto1.es] INFO: Found listing with ID: WV47930
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WV47930%27 HTTP/1.1" 200 None
2026-03-30 11:34:09 [auto1.es] INFO: Scrape type for WV47930: 0
2026-03-30 11:34:09 [auto1.es] INFO: Found listing with ID: YJ04642
2026-03-30 11:34:09 [auto1.es] INFO: Found listing with ID: KZ49779
2026-03-30 11:34:09 [auto1.es] INFO: Found listing with ID: ET46210
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ET46210%27 HTTP/1.1" 200 None
2026-03-30 11:34:09 [auto1.es] INFO: Scrape type for ET46210: 0
2026-03-30 11:34:09 [auto1.es] INFO: Found listing with ID: KP17570
2026-03-30 11:34:09 [auto1.es] INFO: Found listing with ID: FG46245
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG46245%27 HTTP/1.1" 200 None
2026-03-30 11:34:09 [auto1.es] INFO: Scrape type for FG46245: 0
2026-03-30 11:34:09 [auto1.es] INFO: Found listing with ID: KR67716
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KR67716%27 HTTP/1.1" 200 None
2026-03-30 11:34:09 [auto1.es] INFO: Scrape type for KR67716: 0
2026-03-30 11:34:09 [auto1.es] INFO: Found listing with ID: CA13811
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CA13811%27 HTTP/1.1" 200 None
2026-03-30 11:34:09 [auto1.es] INFO: Scrape type for CA13811: 2
2026-03-30 11:34:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4ee997a-43af-55bf-ad64-15c9f130d4eb with identifier: CA13811
2026-03-30 11:34:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4ee997a-43af-55bf-ad64-15c9f130d4eb with scrape type 2
2026-03-30 11:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4ee997a-43af-55bf-ad64-15c9f130d4eb with scrape type 2
2026-03-30 11:34:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d4ee997a-43af-55bf-ad64-15c9f130d4eb, identifier: CA13811
2026-03-30 11:34:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d4ee997a-43af-55bf-ad64-15c9f130d4eb with identifier: CA13811
2026-03-30 11:34:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d4ee997a-43af-55bf-ad64-15c9f130d4eb with identifier: CA13811
2026-03-30 11:34:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d4ee997a-43af-55bf-ad64-15c9f130d4eb with identifier: CA13811 to the API
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:34:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:34:56Z',
'fuel_type': 'diesel',
'id': 'd4ee997a-43af-55bf-ad64-15c9f130d4eb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA13811',
'listing': 'auction',
'make': 'Peugeot',
'model': '307',
'odometer': 116154,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-11-29',
'seller_name': None,
'title': 'Peugeot 307 1.6 HDi XS',
'transmission': 'manual',
'trim': 'XS',
'year': 2007}
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CA13811%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [auto1.es] INFO: Saving data for CA13811: {'auction_closing_time': 1774884896.0, 'created_time': 1774598730.39903, 'last_price_update_time': 1774870450.295013}
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CA13811') HTTP/1.1" 204 0
2026-03-30 11:34:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:34:10 [auto1.es] INFO: Found listing with ID: GP65825
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GP65825%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [auto1.es] INFO: Scrape type for GP65825: 0
2026-03-30 11:34:10 [auto1.es] INFO: Found listing with ID: KH58937
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KH58937%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [auto1.es] INFO: Scrape type for KH58937: 0
2026-03-30 11:34:10 [auto1.es] INFO: Found listing with ID: ZT52456
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZT52456%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [auto1.es] INFO: Scrape type for ZT52456: 0
2026-03-30 11:34:10 [auto1.es] INFO: Found listing with ID: LA57781
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LA57781%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [auto1.es] INFO: Scrape type for LA57781: 0
2026-03-30 11:34:10 [auto1.es] INFO: Found listing with ID: DM84841
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DM84841%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [auto1.es] INFO: Scrape type for DM84841: 0
2026-03-30 11:34:10 [auto1.es] INFO: Found listing with ID: TL38815
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TL38815%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [auto1.es] INFO: Scrape type for TL38815: 0
2026-03-30 11:34:10 [auto1.es] INFO: Found listing with ID: DS90195
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DS90195%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [auto1.es] INFO: Scrape type for DS90195: 0
2026-03-30 11:34:10 [auto1.es] INFO: Found listing with ID: FY96744
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FY96744%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [auto1.es] INFO: Scrape type for FY96744: 0
2026-03-30 11:34:10 [auto1.es] INFO: Found listing with ID: VP19091
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VP19091%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [auto1.es] INFO: Scrape type for VP19091: 0
2026-03-30 11:34:10 [auto1.es] INFO: Found listing with ID: NH85653
2026-03-30 11:34:10 [auto1.es] INFO: Found listing with ID: BZ65753
2026-03-30 11:34:10 [auto1.es] INFO: Found listing with ID: PK26809
2026-03-30 11:34:10 [auto1.es] INFO: Found listing with ID: GH53703
2026-03-30 11:34:10 [auto1.es] INFO: Found listing with ID: HH60103
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HH60103%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [auto1.es] INFO: Scrape type for HH60103: 0
2026-03-30 11:34:10 [auto1.es] INFO: Found listing with ID: DY61189
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DY61189%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [auto1.es] INFO: Scrape type for DY61189: 0
2026-03-30 11:34:10 [auto1.es] INFO: Found listing with ID: FJ44146
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FJ44146%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [auto1.es] INFO: Scrape type for FJ44146: 0
2026-03-30 11:34:10 [auto1.es] INFO: Found listing with ID: SF85973
2026-03-30 11:34:10 [auto1.es] INFO: Found listing with ID: EK60433
2026-03-30 11:34:10 [auto1.es] INFO: Found listing with ID: ZT13794
2026-03-30 11:34:10 [auto1.es] INFO: Found listing with ID: VA59339
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VA59339%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [auto1.es] INFO: Scrape type for VA59339: 0
2026-03-30 11:34:10 [auto1.es] INFO: Found listing with ID: DY95344
2026-03-30 11:34:10 [auto1.es] INFO: Found listing with ID: DC79827
2026-03-30 11:34:10 [auto1.es] INFO: Found listing with ID: BL04446
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BL04446%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [auto1.es] INFO: Scrape type for BL04446: 0
2026-03-30 11:34:10 [auto1.es] INFO: Found listing with ID: YV38932
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YV38932%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [auto1.es] INFO: Scrape type for YV38932: 0
2026-03-30 11:34:10 [auto1.es] INFO: Found listing with ID: MW67047
2026-03-30 11:34:10 [auto1.es] INFO: Found listing with ID: VU55173
2026-03-30 11:34:10 [auto1.es] INFO: Found listing with ID: KL23416
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL23416%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [auto1.es] INFO: Scrape type for KL23416: 0
2026-03-30 11:34:10 [auto1.es] INFO: Found listing with ID: BM49479
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BM49479%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [auto1.es] INFO: Scrape type for BM49479: 0
2026-03-30 11:34:10 [auto1.es] INFO: Found listing with ID: ZV45444
2026-03-30 11:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:12 [auto1.es] INFO: Channel: 24h | Page: 54 | totalHits: 2246 | hits on page: 40
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: UD75301
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: CD83035
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: PZ56509
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PZ56509%27 HTTP/1.1" 200 None
2026-03-30 11:34:12 [auto1.es] INFO: Scrape type for PZ56509: 0
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: AJ69515
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: YS20114
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YS20114%27 HTTP/1.1" 200 None
2026-03-30 11:34:12 [auto1.es] INFO: Scrape type for YS20114: 0
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: AU66709
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: EK69979
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EK69979%27 HTTP/1.1" 200 None
2026-03-30 11:34:12 [auto1.es] INFO: Scrape type for EK69979: 0
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: CS18132
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CS18132%27 HTTP/1.1" 200 None
2026-03-30 11:34:12 [auto1.es] INFO: Scrape type for CS18132: 0
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: AS37941
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: HC11332
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: UN29242
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: ZX62184
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: BW10675
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: MG85806
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: DX19120
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: KS42658
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: UE67433
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: TZ01977
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: GW37320
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GW37320%27 HTTP/1.1" 200 None
2026-03-30 11:34:12 [auto1.es] INFO: Scrape type for GW37320: 0
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: GG74961
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: XW94395
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: PK32914
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK32914%27 HTTP/1.1" 200 None
2026-03-30 11:34:12 [auto1.es] INFO: Scrape type for PK32914: 0
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: GW88114
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GW88114%27 HTTP/1.1" 200 None
2026-03-30 11:34:12 [auto1.es] INFO: Scrape type for GW88114: 0
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: LZ33351
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LZ33351%27 HTTP/1.1" 200 None
2026-03-30 11:34:12 [auto1.es] INFO: Scrape type for LZ33351: 0
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: TR19943
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TR19943%27 HTTP/1.1" 200 None
2026-03-30 11:34:12 [auto1.es] INFO: Scrape type for TR19943: 0
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: JS77996
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JS77996%27 HTTP/1.1" 200 None
2026-03-30 11:34:12 [auto1.es] INFO: Scrape type for JS77996: 0
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: ES07988
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: VZ79262
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: HA87935
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA87935%27 HTTP/1.1" 200 None
2026-03-30 11:34:12 [auto1.es] INFO: Scrape type for HA87935: 0
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: XC96716
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: VC74313
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: RG03753
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: CN77625
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CN77625%27 HTTP/1.1" 200 None
2026-03-30 11:34:12 [auto1.es] INFO: Scrape type for CN77625: 0
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: XD32564
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XD32564%27 HTTP/1.1" 200 None
2026-03-30 11:34:12 [auto1.es] INFO: Scrape type for XD32564: 0
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: YK19704
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: AE50164
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: VD65621
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VD65621%27 HTTP/1.1" 200 None
2026-03-30 11:34:12 [auto1.es] INFO: Scrape type for VD65621: 0
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: JZ79034
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JZ79034%27 HTTP/1.1" 200 None
2026-03-30 11:34:12 [auto1.es] INFO: Scrape type for JZ79034: 0
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: UC73568
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UC73568%27 HTTP/1.1" 200 None
2026-03-30 11:34:12 [auto1.es] INFO: Scrape type for UC73568: 0
2026-03-30 11:34:12 [auto1.es] INFO: Found listing with ID: LN12503
2026-03-30 11:34:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:45 [auto1.es] INFO: Channel: 24h | Page: 55 | totalHits: 2247 | hits on page: 40
2026-03-30 11:34:45 [auto1.es] INFO: Found listing with ID: LN12503
2026-03-30 11:34:45 [auto1.es] INFO: Found listing with ID: UM67436
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UM67436%27 HTTP/1.1" 200 None
2026-03-30 11:34:45 [auto1.es] INFO: Scrape type for UM67436: 0
2026-03-30 11:34:45 [auto1.es] INFO: Found listing with ID: DB51566
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DB51566%27 HTTP/1.1" 200 None
2026-03-30 11:34:45 [auto1.es] INFO: Scrape type for DB51566: 0
2026-03-30 11:34:45 [auto1.es] INFO: Found listing with ID: BA40352
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BA40352%27 HTTP/1.1" 200 None
2026-03-30 11:34:45 [auto1.es] INFO: Scrape type for BA40352: 0
2026-03-30 11:34:45 [auto1.es] INFO: Found listing with ID: JM41258
2026-03-30 11:34:45 [auto1.es] INFO: Found listing with ID: MW71818
2026-03-30 11:34:45 [auto1.es] INFO: Found listing with ID: HX86510
2026-03-30 11:34:45 [auto1.es] INFO: Found listing with ID: SX49726
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SX49726%27 HTTP/1.1" 200 None
2026-03-30 11:34:45 [auto1.es] INFO: Scrape type for SX49726: 0
2026-03-30 11:34:45 [auto1.es] INFO: Found listing with ID: PE94683
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PE94683%27 HTTP/1.1" 200 None
2026-03-30 11:34:45 [auto1.es] INFO: Scrape type for PE94683: 0
2026-03-30 11:34:45 [auto1.es] INFO: Found listing with ID: VJ61216
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VJ61216%27 HTTP/1.1" 200 None
2026-03-30 11:34:45 [auto1.es] INFO: Scrape type for VJ61216: 0
2026-03-30 11:34:45 [auto1.es] INFO: Found listing with ID: KX75561
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KX75561%27 HTTP/1.1" 200 None
2026-03-30 11:34:45 [auto1.es] INFO: Scrape type for KX75561: 0
2026-03-30 11:34:45 [auto1.es] INFO: Found listing with ID: GW51820
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GW51820%27 HTTP/1.1" 200 None
2026-03-30 11:34:45 [auto1.es] INFO: Scrape type for GW51820: 0
2026-03-30 11:34:45 [auto1.es] INFO: Found listing with ID: BT71977
2026-03-30 11:34:45 [auto1.es] INFO: Found listing with ID: CC89526
2026-03-30 11:34:45 [auto1.es] INFO: Found listing with ID: MY23078
2026-03-30 11:34:45 [auto1.es] INFO: Found listing with ID: PN58754
2026-03-30 11:34:45 [auto1.es] INFO: Found listing with ID: TS39016
2026-03-30 11:34:45 [auto1.es] INFO: Found listing with ID: ZK42012
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZK42012%27 HTTP/1.1" 200 None
2026-03-30 11:34:45 [auto1.es] INFO: Scrape type for ZK42012: 0
2026-03-30 11:34:45 [auto1.es] INFO: Found listing with ID: PS53569
2026-03-30 11:34:45 [auto1.es] INFO: Found listing with ID: LG52328
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LG52328%27 HTTP/1.1" 200 None
2026-03-30 11:34:45 [auto1.es] INFO: Scrape type for LG52328: 0
2026-03-30 11:34:45 [auto1.es] INFO: Found listing with ID: RF71791
2026-03-30 11:34:45 [auto1.es] INFO: Found listing with ID: GE54234
2026-03-30 11:34:45 [auto1.es] INFO: Found listing with ID: XP71209
2026-03-30 11:34:45 [auto1.es] INFO: Found listing with ID: AT12035
2026-03-30 11:34:45 [auto1.es] INFO: Found listing with ID: BT51966
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BT51966%27 HTTP/1.1" 200 None
2026-03-30 11:34:45 [auto1.es] INFO: Scrape type for BT51966: 0
2026-03-30 11:34:45 [auto1.es] INFO: Found listing with ID: YD38751
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YD38751%27 HTTP/1.1" 200 None
2026-03-30 11:34:45 [auto1.es] INFO: Scrape type for YD38751: 0
2026-03-30 11:34:45 [auto1.es] INFO: Found listing with ID: LR44040
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LR44040%27 HTTP/1.1" 200 None
2026-03-30 11:34:45 [auto1.es] INFO: Scrape type for LR44040: 0
2026-03-30 11:34:45 [auto1.es] INFO: Found listing with ID: LV43298
2026-03-30 11:34:45 [auto1.es] INFO: Found listing with ID: LS22424
2026-03-30 11:34:45 [auto1.es] INFO: Found listing with ID: MB84722
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MB84722%27 HTTP/1.1" 200 None
2026-03-30 11:34:45 [auto1.es] INFO: Scrape type for MB84722: 2
2026-03-30 11:34:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95d29d70-4752-50ba-bba2-3736a46e3c8c with identifier: MB84722
2026-03-30 11:34:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95d29d70-4752-50ba-bba2-3736a46e3c8c with scrape type 2
2026-03-30 11:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95d29d70-4752-50ba-bba2-3736a46e3c8c with scrape type 2
2026-03-30 11:34:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 95d29d70-4752-50ba-bba2-3736a46e3c8c, identifier: MB84722
2026-03-30 11:34:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 95d29d70-4752-50ba-bba2-3736a46e3c8c with identifier: MB84722
2026-03-30 11:34:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 95d29d70-4752-50ba-bba2-3736a46e3c8c with identifier: MB84722
2026-03-30 11:34:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 95d29d70-4752-50ba-bba2-3736a46e3c8c with identifier: MB84722 to the API
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:34:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:38:22Z',
'fuel_type': 'diesel',
'id': '95d29d70-4752-50ba-bba2-3736a46e3c8c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB84722',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 125463,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-17',
'seller_name': None,
'title': 'Volvo XC60 2.0 D4 Momentum AWD',
'transmission': 'automatic',
'trim': 'Momentum AWD',
'year': 2018}
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MB84722%27 HTTP/1.1" 200 None
2026-03-30 11:34:46 [auto1.es] INFO: Saving data for MB84722: {'auction_closing_time': 1774885102.0, 'created_time': 1774695920.046347, 'last_price_update_time': 1774870486.057227}
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MB84722') HTTP/1.1" 204 0
2026-03-30 11:34:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:34:46 [auto1.es] INFO: Found listing with ID: SR36141
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SR36141%27 HTTP/1.1" 200 None
2026-03-30 11:34:46 [auto1.es] INFO: Scrape type for SR36141: 2
2026-03-30 11:34:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83059e13-8b66-57e7-866a-ff8c344857a6 with identifier: SR36141
2026-03-30 11:34:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83059e13-8b66-57e7-866a-ff8c344857a6 with scrape type 2
2026-03-30 11:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83059e13-8b66-57e7-866a-ff8c344857a6 with scrape type 2
2026-03-30 11:34:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 83059e13-8b66-57e7-866a-ff8c344857a6, identifier: SR36141
2026-03-30 11:34:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 83059e13-8b66-57e7-866a-ff8c344857a6 with identifier: SR36141
2026-03-30 11:34:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 83059e13-8b66-57e7-866a-ff8c344857a6 with identifier: SR36141
2026-03-30 11:34:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 83059e13-8b66-57e7-866a-ff8c344857a6 with identifier: SR36141 to the API
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:34:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 88,
'expiration_date': '2026-03-30T15:03:59Z',
'fuel_type': 'diesel',
'id': '83059e13-8b66-57e7-866a-ff8c344857a6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR36141',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 40370,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-08-30',
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Authentique',
'transmission': 'manual',
'trim': 'Authentique',
'year': 2011}
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SR36141%27 HTTP/1.1" 200 None
2026-03-30 11:34:46 [auto1.es] INFO: Saving data for SR36141: {'auction_closing_time': 1774883039.0, 'created_time': 1774102053.767162, 'last_price_update_time': 1774870486.553798}
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SR36141') HTTP/1.1" 204 0
2026-03-30 11:34:46 [auto1.es] INFO: Found listing with ID: UB86701
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB86701%27 HTTP/1.1" 200 None
2026-03-30 11:34:46 [auto1.es] INFO: Scrape type for UB86701: 2
2026-03-30 11:34:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5581c6ab-43c6-5edf-b0a6-31c1a6af0597 with identifier: UB86701
2026-03-30 11:34:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5581c6ab-43c6-5edf-b0a6-31c1a6af0597 with scrape type 2
2026-03-30 11:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5581c6ab-43c6-5edf-b0a6-31c1a6af0597 with scrape type 2
2026-03-30 11:34:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5581c6ab-43c6-5edf-b0a6-31c1a6af0597, identifier: UB86701
2026-03-30 11:34:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5581c6ab-43c6-5edf-b0a6-31c1a6af0597 with identifier: UB86701
2026-03-30 11:34:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5581c6ab-43c6-5edf-b0a6-31c1a6af0597 with identifier: UB86701
2026-03-30 11:34:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5581c6ab-43c6-5edf-b0a6-31c1a6af0597 with identifier: UB86701 to the API
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:34:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-30T15:03:37Z',
'fuel_type': 'petrol',
'id': '5581c6ab-43c6-5edf-b0a6-31c1a6af0597',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB86701',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 73110,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-29',
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2021}
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB86701%27 HTTP/1.1" 200 None
2026-03-30 11:34:47 [auto1.es] INFO: Saving data for UB86701: {'auction_closing_time': 1774883017.0, 'created_time': 1773432419.263659, 'last_price_update_time': 1774870487.004674}
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UB86701') HTTP/1.1" 204 0
2026-03-30 11:34:47 [auto1.es] INFO: Found listing with ID: MD68479
2026-03-30 11:34:47 [auto1.es] INFO: Found listing with ID: NV64390
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NV64390%27 HTTP/1.1" 200 None
2026-03-30 11:34:47 [auto1.es] INFO: Scrape type for NV64390: 2
2026-03-30 11:34:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49de0fa3-f694-5341-9684-53b2d8cad80c with identifier: NV64390
2026-03-30 11:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49de0fa3-f694-5341-9684-53b2d8cad80c with scrape type 2
2026-03-30 11:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49de0fa3-f694-5341-9684-53b2d8cad80c with scrape type 2
2026-03-30 11:34:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 49de0fa3-f694-5341-9684-53b2d8cad80c, identifier: NV64390
2026-03-30 11:34:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 49de0fa3-f694-5341-9684-53b2d8cad80c with identifier: NV64390
2026-03-30 11:34:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 49de0fa3-f694-5341-9684-53b2d8cad80c with identifier: NV64390
2026-03-30 11:34:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 49de0fa3-f694-5341-9684-53b2d8cad80c with identifier: NV64390 to the API
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:34:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:54:05Z',
'fuel_type': 'diesel',
'id': '49de0fa3-f694-5341-9684-53b2d8cad80c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV64390',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 190301,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-25',
'seller_name': None,
'title': 'BMW X1 sDrive 18d xLine',
'transmission': 'automatic',
'trim': 'xLine',
'year': 2019}
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NV64390%27 HTTP/1.1" 200 None
2026-03-30 11:34:47 [auto1.es] INFO: Saving data for NV64390: {'auction_closing_time': 1774886045.0, 'created_time': 1774695923.238461, 'last_price_update_time': 1774870487.438474}
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NV64390') HTTP/1.1" 204 0
2026-03-30 11:34:47 [auto1.es] INFO: Found listing with ID: UP08006
2026-03-30 11:34:47 [auto1.es] INFO: Found listing with ID: HP31470
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HP31470%27 HTTP/1.1" 200 None
2026-03-30 11:34:47 [auto1.es] INFO: Scrape type for HP31470: 2
2026-03-30 11:34:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2 with identifier: HP31470
2026-03-30 11:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2 with scrape type 2
2026-03-30 11:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2 with scrape type 2
2026-03-30 11:34:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2, identifier: HP31470
2026-03-30 11:34:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2 with identifier: HP31470
2026-03-30 11:34:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2 with identifier: HP31470
2026-03-30 11:34:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2 with identifier: HP31470 to the API
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:34:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:46:01Z',
'fuel_type': 'diesel',
'id': '8e948e97-fcbf-5fcc-b5a4-a9d87ad27ad2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP31470',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3',
'odometer': 57625,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-10-18',
'seller_name': None,
'title': 'Audi Q3 35 TDI Advanced',
'transmission': 'automatic',
'trim': 'Advanced',
'year': 2023}
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HP31470%27 HTTP/1.1" 200 None
2026-03-30 11:34:47 [auto1.es] INFO: Saving data for HP31470: {'auction_closing_time': 1774885561.0, 'created_time': 1774695965.445191, 'last_price_update_time': 1774870487.838023}
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HP31470') HTTP/1.1" 204 0
2026-03-30 11:34:47 [auto1.es] INFO: Found listing with ID: TW94946
2026-03-30 11:34:47 [auto1.es] INFO: Found listing with ID: RF07402
2026-03-30 11:34:47 [auto1.es] INFO: Found listing with ID: YJ22884
2026-03-30 11:34:47 [auto1.es] INFO: Found listing with ID: UE40961
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UE40961%27 HTTP/1.1" 200 None
2026-03-30 11:34:47 [auto1.es] INFO: Scrape type for UE40961: 2
2026-03-30 11:34:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cab8644c-ef55-530e-a443-a11bb746b190 with identifier: UE40961
2026-03-30 11:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cab8644c-ef55-530e-a443-a11bb746b190 with scrape type 2
2026-03-30 11:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cab8644c-ef55-530e-a443-a11bb746b190 with scrape type 2
2026-03-30 11:34:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cab8644c-ef55-530e-a443-a11bb746b190, identifier: UE40961
2026-03-30 11:34:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cab8644c-ef55-530e-a443-a11bb746b190 with identifier: UE40961
2026-03-30 11:34:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cab8644c-ef55-530e-a443-a11bb746b190 with identifier: UE40961
2026-03-30 11:34:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cab8644c-ef55-530e-a443-a11bb746b190 with identifier: UE40961 to the API
2026-03-30 11:34:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:34:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:34:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:26:25Z',
'fuel_type': 'diesel',
'id': 'cab8644c-ef55-530e-a443-a11bb746b190',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE40961',
'listing': 'auction',
'make': 'Audi',
'model': 'A3',
'odometer': 123537,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-30',
'seller_name': None,
'title': 'Audi A3 1.6 TDI Ambiente',
'transmission': 'manual',
'trim': 'Ambiente',
'year': 2015}
2026-03-30 11:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UE40961%27 HTTP/1.1" 200 None
2026-03-30 11:34:48 [auto1.es] INFO: Saving data for UE40961: {'auction_closing_time': 1774884385.0, 'created_time': 1774037190.521114, 'last_price_update_time': 1774870488.237906}
2026-03-30 11:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UE40961') HTTP/1.1" 204 0
2026-03-30 11:35:04 [scrapy.extensions.logstats] INFO: Crawled 233 pages (at 4 pages/min), scraped 243 items (at 7 items/min)
2026-03-30 11:35:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-30 11:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:35:55 [auto1.es] INFO: Channel: 24h | Page: 56 | totalHits: 2248 | hits on page: 40
2026-03-30 11:35:55 [auto1.es] INFO: Found listing with ID: UE40961
2026-03-30 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UE40961%27 HTTP/1.1" 200 None
2026-03-30 11:35:55 [auto1.es] INFO: Scrape type for UE40961: 0
2026-03-30 11:35:55 [auto1.es] INFO: Found listing with ID: MK70823
2026-03-30 11:35:55 [auto1.es] INFO: Found listing with ID: WV13003
2026-03-30 11:35:55 [auto1.es] INFO: Found listing with ID: SR52978
2026-03-30 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SR52978%27 HTTP/1.1" 200 None
2026-03-30 11:35:55 [auto1.es] INFO: Scrape type for SR52978: 2
2026-03-30 11:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1a7378e-c91f-5018-99e2-f18006793514 with identifier: SR52978
2026-03-30 11:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1a7378e-c91f-5018-99e2-f18006793514 with scrape type 2
2026-03-30 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1a7378e-c91f-5018-99e2-f18006793514 with scrape type 2
2026-03-30 11:35:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d1a7378e-c91f-5018-99e2-f18006793514, identifier: SR52978
2026-03-30 11:35:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d1a7378e-c91f-5018-99e2-f18006793514 with identifier: SR52978
2026-03-30 11:35:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d1a7378e-c91f-5018-99e2-f18006793514 with identifier: SR52978
2026-03-30 11:35:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d1a7378e-c91f-5018-99e2-f18006793514 with identifier: SR52978 to the API
2026-03-30 11:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:35:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:35:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:14:57Z',
'fuel_type': 'diesel',
'id': 'd1a7378e-c91f-5018-99e2-f18006793514',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR52978',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 90456,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-06-07',
'seller_name': None,
'title': 'Seat Leon 1.9 TDI Reference Ecomotive',
'transmission': 'manual',
'trim': 'Reference Ecomotive',
'year': 2009}
2026-03-30 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SR52978%27 HTTP/1.1" 200 None
2026-03-30 11:35:55 [auto1.es] INFO: Saving data for SR52978: {'auction_closing_time': 1774883697.0, 'created_time': 1774695950.502423, 'last_price_update_time': 1774870555.67894}
2026-03-30 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SR52978') HTTP/1.1" 204 0
2026-03-30 11:35:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:35:55 [auto1.es] INFO: Found listing with ID: BA23720
2026-03-30 11:35:55 [auto1.es] INFO: Found listing with ID: PL84711
2026-03-30 11:35:55 [auto1.es] INFO: Found listing with ID: AZ04928
2026-03-30 11:35:55 [auto1.es] INFO: Found listing with ID: JA60709
2026-03-30 11:35:55 [auto1.es] INFO: Found listing with ID: EF82008
2026-03-30 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EF82008%27 HTTP/1.1" 200 None
2026-03-30 11:35:55 [auto1.es] INFO: Scrape type for EF82008: 2
2026-03-30 11:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f9c06d5-2665-5ae2-b405-a384413ede27 with identifier: EF82008
2026-03-30 11:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f9c06d5-2665-5ae2-b405-a384413ede27 with scrape type 2
2026-03-30 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f9c06d5-2665-5ae2-b405-a384413ede27 with scrape type 2
2026-03-30 11:35:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6f9c06d5-2665-5ae2-b405-a384413ede27, identifier: EF82008
2026-03-30 11:35:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6f9c06d5-2665-5ae2-b405-a384413ede27 with identifier: EF82008
2026-03-30 11:35:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6f9c06d5-2665-5ae2-b405-a384413ede27 with identifier: EF82008
2026-03-30 11:35:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6f9c06d5-2665-5ae2-b405-a384413ede27 with identifier: EF82008 to the API
2026-03-30 11:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:03:15Z',
'fuel_type': 'diesel',
'id': '6f9c06d5-2665-5ae2-b405-a384413ede27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF82008',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 116703,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-19',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 d Progressive',
'transmission': 'automatic',
'trim': 'Progressive',
'year': 2019}
2026-03-30 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EF82008%27 HTTP/1.1" 200 None
2026-03-30 11:35:56 [auto1.es] INFO: Saving data for EF82008: {'auction_closing_time': 1774882995.0, 'created_time': 1773238784.4297, 'last_price_update_time': 1774870556.241143}
2026-03-30 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EF82008') HTTP/1.1" 204 0
2026-03-30 11:35:56 [auto1.es] INFO: Found listing with ID: TX62344
2026-03-30 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TX62344%27 HTTP/1.1" 200 None
2026-03-30 11:35:56 [auto1.es] INFO: Scrape type for TX62344: 2
2026-03-30 11:35:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6fa563c-edbb-5160-a197-0166b9861af6 with identifier: TX62344
2026-03-30 11:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6fa563c-edbb-5160-a197-0166b9861af6 with scrape type 2
2026-03-30 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6fa563c-edbb-5160-a197-0166b9861af6 with scrape type 2
2026-03-30 11:35:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d6fa563c-edbb-5160-a197-0166b9861af6, identifier: TX62344
2026-03-30 11:35:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d6fa563c-edbb-5160-a197-0166b9861af6 with identifier: TX62344
2026-03-30 11:35:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d6fa563c-edbb-5160-a197-0166b9861af6 with identifier: TX62344
2026-03-30 11:35:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d6fa563c-edbb-5160-a197-0166b9861af6 with identifier: TX62344 to the API
2026-03-30 11:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:27:06Z',
'fuel_type': 'petrol',
'id': 'd6fa563c-edbb-5160-a197-0166b9861af6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX62344',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 27420,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-14',
'seller_name': None,
'title': 'MINI Cooper',
'transmission': 'automatic',
'trim': '',
'year': 2023}
2026-03-30 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TX62344%27 HTTP/1.1" 200 None
2026-03-30 11:35:56 [auto1.es] INFO: Saving data for TX62344: {'auction_closing_time': 1774884426.0, 'created_time': 1774695951.734513, 'last_price_update_time': 1774870556.639657}
2026-03-30 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TX62344') HTTP/1.1" 204 0
2026-03-30 11:35:56 [auto1.es] INFO: Found listing with ID: ML70720
2026-03-30 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ML70720%27 HTTP/1.1" 200 None
2026-03-30 11:35:56 [auto1.es] INFO: Scrape type for ML70720: 2
2026-03-30 11:35:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79efab29-f494-52a6-8bfe-15ba7bead4b9 with identifier: ML70720
2026-03-30 11:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79efab29-f494-52a6-8bfe-15ba7bead4b9 with scrape type 2
2026-03-30 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79efab29-f494-52a6-8bfe-15ba7bead4b9 with scrape type 2
2026-03-30 11:35:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 79efab29-f494-52a6-8bfe-15ba7bead4b9, identifier: ML70720
2026-03-30 11:35:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 79efab29-f494-52a6-8bfe-15ba7bead4b9 with identifier: ML70720
2026-03-30 11:35:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 79efab29-f494-52a6-8bfe-15ba7bead4b9 with identifier: ML70720
2026-03-30 11:35:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 79efab29-f494-52a6-8bfe-15ba7bead4b9 with identifier: ML70720 to the API
2026-03-30 11:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:35:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 220,
'expiration_date': '2026-03-30T15:11:40Z',
'fuel_type': 'diesel',
'id': '79efab29-f494-52a6-8bfe-15ba7bead4b9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML70720',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 123222,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-06',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d Mild-Hybrid AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2023}
2026-03-30 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ML70720%27 HTTP/1.1" 200 None
2026-03-30 11:35:57 [auto1.es] INFO: Saving data for ML70720: {'auction_closing_time': 1774883500.0, 'created_time': 1774695998.812135, 'last_price_update_time': 1774870557.065633}
2026-03-30 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ML70720') HTTP/1.1" 204 0
2026-03-30 11:35:57 [auto1.es] INFO: Found listing with ID: DL67174
2026-03-30 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL67174%27 HTTP/1.1" 200 None
2026-03-30 11:35:57 [auto1.es] INFO: Scrape type for DL67174: 2
2026-03-30 11:35:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f0a60d5-e253-560b-971d-6acef668247b with identifier: DL67174
2026-03-30 11:35:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f0a60d5-e253-560b-971d-6acef668247b with scrape type 2
2026-03-30 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f0a60d5-e253-560b-971d-6acef668247b with scrape type 2
2026-03-30 11:35:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7f0a60d5-e253-560b-971d-6acef668247b, identifier: DL67174
2026-03-30 11:35:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7f0a60d5-e253-560b-971d-6acef668247b with identifier: DL67174
2026-03-30 11:35:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7f0a60d5-e253-560b-971d-6acef668247b with identifier: DL67174
2026-03-30 11:35:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7f0a60d5-e253-560b-971d-6acef668247b with identifier: DL67174 to the API
2026-03-30 11:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:35:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:35:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:26:29Z',
'fuel_type': 'diesel',
'id': '7f0a60d5-e253-560b-971d-6acef668247b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL67174',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3',
'odometer': 246968,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-04-09',
'seller_name': None,
'title': 'Audi Q3 2.0 TDI quattro Ambition',
'transmission': 'manual',
'trim': 'quattro Ambition',
'year': 2014}
2026-03-30 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL67174%27 HTTP/1.1" 200 None
2026-03-30 11:35:57 [auto1.es] INFO: Saving data for DL67174: {'auction_closing_time': 1774884389.0, 'created_time': 1774015813.098778, 'last_price_update_time': 1774870557.452998}
2026-03-30 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DL67174') HTTP/1.1" 204 0
2026-03-30 11:35:57 [auto1.es] INFO: Found listing with ID: MS21138
2026-03-30 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MS21138%27 HTTP/1.1" 200 None
2026-03-30 11:35:57 [auto1.es] INFO: Scrape type for MS21138: 2
2026-03-30 11:35:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1459d18b-252e-55ba-b8fb-5a48a8af25c7 with identifier: MS21138
2026-03-30 11:35:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1459d18b-252e-55ba-b8fb-5a48a8af25c7 with scrape type 2
2026-03-30 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1459d18b-252e-55ba-b8fb-5a48a8af25c7 with scrape type 2
2026-03-30 11:35:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1459d18b-252e-55ba-b8fb-5a48a8af25c7, identifier: MS21138
2026-03-30 11:35:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1459d18b-252e-55ba-b8fb-5a48a8af25c7 with identifier: MS21138
2026-03-30 11:35:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1459d18b-252e-55ba-b8fb-5a48a8af25c7 with identifier: MS21138
2026-03-30 11:35:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1459d18b-252e-55ba-b8fb-5a48a8af25c7 with identifier: MS21138 to the API
2026-03-30 11:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:35:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:35:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 92,
'expiration_date': '2026-03-30T15:20:05Z',
'fuel_type': 'diesel',
'id': '1459d18b-252e-55ba-b8fb-5a48a8af25c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS21138',
'listing': 'auction',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 222056,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-26',
'seller_name': None,
'title': 'Citroen Berlingo 1.6 HDi XTR Plus',
'transmission': 'manual',
'trim': 'XTR Plus',
'year': 2014}
2026-03-30 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MS21138%27 HTTP/1.1" 200 None
2026-03-30 11:35:57 [auto1.es] INFO: Saving data for MS21138: {'auction_closing_time': 1774884005.0, 'created_time': 1774695970.085935, 'last_price_update_time': 1774870557.843633}
2026-03-30 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MS21138') HTTP/1.1" 204 0
2026-03-30 11:35:57 [auto1.es] INFO: Found listing with ID: EG18417
2026-03-30 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG18417%27 HTTP/1.1" 200 None
2026-03-30 11:35:57 [auto1.es] INFO: Scrape type for EG18417: 2
2026-03-30 11:35:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3707387-1b88-5d16-a811-afc8357ab3c8 with identifier: EG18417
2026-03-30 11:35:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3707387-1b88-5d16-a811-afc8357ab3c8 with scrape type 2
2026-03-30 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3707387-1b88-5d16-a811-afc8357ab3c8 with scrape type 2
2026-03-30 11:35:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e3707387-1b88-5d16-a811-afc8357ab3c8, identifier: EG18417
2026-03-30 11:35:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e3707387-1b88-5d16-a811-afc8357ab3c8 with identifier: EG18417
2026-03-30 11:35:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e3707387-1b88-5d16-a811-afc8357ab3c8 with identifier: EG18417
2026-03-30 11:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e3707387-1b88-5d16-a811-afc8357ab3c8 with identifier: EG18417 to the API
2026-03-30 11:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:35:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:35:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-30T15:49:17Z',
'fuel_type': 'diesel',
'id': 'e3707387-1b88-5d16-a811-afc8357ab3c8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG18417',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 232088,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-09-16',
'seller_name': None,
'title': 'Citroen C3 1.4 HDi SX Plus',
'transmission': 'manual',
'trim': 'SX Plus',
'year': 2003}
2026-03-30 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG18417%27 HTTP/1.1" 200 None
2026-03-30 11:35:58 [auto1.es] INFO: Saving data for EG18417: {'auction_closing_time': 1774885757.0, 'created_time': 1774037150.416479, 'last_price_update_time': 1774870558.753007}
2026-03-30 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EG18417') HTTP/1.1" 204 0
2026-03-30 11:35:58 [auto1.es] INFO: Found listing with ID: HD15587
2026-03-30 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HD15587%27 HTTP/1.1" 200 None
2026-03-30 11:35:58 [auto1.es] INFO: Scrape type for HD15587: 2
2026-03-30 11:35:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c53ce88e-9e36-59fa-add6-f0db42bbb7d7 with identifier: HD15587
2026-03-30 11:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c53ce88e-9e36-59fa-add6-f0db42bbb7d7 with scrape type 2
2026-03-30 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c53ce88e-9e36-59fa-add6-f0db42bbb7d7 with scrape type 2
2026-03-30 11:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c53ce88e-9e36-59fa-add6-f0db42bbb7d7, identifier: HD15587
2026-03-30 11:35:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c53ce88e-9e36-59fa-add6-f0db42bbb7d7 with identifier: HD15587
2026-03-30 11:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c53ce88e-9e36-59fa-add6-f0db42bbb7d7 with identifier: HD15587
2026-03-30 11:35:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c53ce88e-9e36-59fa-add6-f0db42bbb7d7 with identifier: HD15587 to the API
2026-03-30 11:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:35:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 192,
'expiration_date': '2026-03-30T15:38:37Z',
'fuel_type': 'petrol',
'id': 'c53ce88e-9e36-59fa-add6-f0db42bbb7d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD15587',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 68537,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-14',
'seller_name': None,
'title': 'MINI Cooper S',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-03-30 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HD15587%27 HTTP/1.1" 200 None
2026-03-30 11:35:59 [auto1.es] INFO: Saving data for HD15587: {'auction_closing_time': 1774885117.0, 'created_time': 1774695971.695406, 'last_price_update_time': 1774870559.211599}
2026-03-30 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HD15587') HTTP/1.1" 204 0
2026-03-30 11:35:59 [auto1.es] INFO: Found listing with ID: BE52894
2026-03-30 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE52894%27 HTTP/1.1" 200 None
2026-03-30 11:35:59 [auto1.es] INFO: Scrape type for BE52894: 2
2026-03-30 11:35:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bee3e6c-d88c-5935-b130-d834f69a1b81 with identifier: BE52894
2026-03-30 11:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bee3e6c-d88c-5935-b130-d834f69a1b81 with scrape type 2
2026-03-30 11:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bee3e6c-d88c-5935-b130-d834f69a1b81 with scrape type 2
2026-03-30 11:35:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7bee3e6c-d88c-5935-b130-d834f69a1b81, identifier: BE52894
2026-03-30 11:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7bee3e6c-d88c-5935-b130-d834f69a1b81 with identifier: BE52894
2026-03-30 11:35:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7bee3e6c-d88c-5935-b130-d834f69a1b81 with identifier: BE52894
2026-03-30 11:35:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7bee3e6c-d88c-5935-b130-d834f69a1b81 with identifier: BE52894 to the API
2026-03-30 11:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:35:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:32:55Z',
'fuel_type': 'hybrid',
'id': '7bee3e6c-d88c-5935-b130-d834f69a1b81',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE52894',
'listing': 'auction',
'make': 'Toyota',
'model': 'Prius+',
'odometer': 248650,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-29',
'seller_name': None,
'title': 'Toyota Prius+ 1.8 Hybrid Dynamic Business',
'transmission': 'automatic',
'trim': 'Dynamic Business',
'year': 2012}
2026-03-30 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE52894%27 HTTP/1.1" 200 None
2026-03-30 11:35:59 [auto1.es] INFO: Saving data for BE52894: {'auction_closing_time': 1774884775.0, 'created_time': 1774002157.56526, 'last_price_update_time': 1774870559.675617}
2026-03-30 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BE52894') HTTP/1.1" 204 0
2026-03-30 11:35:59 [auto1.es] INFO: Found listing with ID: BE06656
2026-03-30 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE06656%27 HTTP/1.1" 200 None
2026-03-30 11:35:59 [auto1.es] INFO: Scrape type for BE06656: 2
2026-03-30 11:35:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78fbfa0c-316f-5651-a579-20ee7657b3c5 with identifier: BE06656
2026-03-30 11:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78fbfa0c-316f-5651-a579-20ee7657b3c5 with scrape type 2
2026-03-30 11:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78fbfa0c-316f-5651-a579-20ee7657b3c5 with scrape type 2
2026-03-30 11:35:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 78fbfa0c-316f-5651-a579-20ee7657b3c5, identifier: BE06656
2026-03-30 11:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 78fbfa0c-316f-5651-a579-20ee7657b3c5 with identifier: BE06656
2026-03-30 11:35:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 78fbfa0c-316f-5651-a579-20ee7657b3c5 with identifier: BE06656
2026-03-30 11:35:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 78fbfa0c-316f-5651-a579-20ee7657b3c5 with identifier: BE06656 to the API
2026-03-30 11:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:35:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 147,
'expiration_date': '2026-03-30T15:35:38Z',
'fuel_type': 'diesel',
'id': '78fbfa0c-316f-5651-a579-20ee7657b3c5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE06656',
'listing': 'auction',
'make': 'Subaru',
'model': 'Forester',
'odometer': 170071,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-23',
'seller_name': None,
'title': 'Subaru Forester 2.0 Diesel Executive',
'transmission': 'automatic',
'trim': 'Executive',
'year': 2016}
2026-03-30 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE06656%27 HTTP/1.1" 200 None
2026-03-30 11:36:00 [auto1.es] INFO: Saving data for BE06656: {'auction_closing_time': 1774884938.0, 'created_time': 1774695984.29148, 'last_price_update_time': 1774870560.103344}
2026-03-30 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BE06656') HTTP/1.1" 204 0
2026-03-30 11:36:00 [auto1.es] INFO: Found listing with ID: KW41207
2026-03-30 11:36:00 [auto1.es] INFO: Found listing with ID: DZ14313
2026-03-30 11:36:00 [auto1.es] INFO: Found listing with ID: GB85500
2026-03-30 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GB85500%27 HTTP/1.1" 200 None
2026-03-30 11:36:00 [auto1.es] INFO: Scrape type for GB85500: 2
2026-03-30 11:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ff81bef-daa1-56f5-8d16-a6b84ffb169c with identifier: GB85500
2026-03-30 11:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ff81bef-daa1-56f5-8d16-a6b84ffb169c with scrape type 2
2026-03-30 11:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ff81bef-daa1-56f5-8d16-a6b84ffb169c with scrape type 2
2026-03-30 11:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9ff81bef-daa1-56f5-8d16-a6b84ffb169c, identifier: GB85500
2026-03-30 11:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9ff81bef-daa1-56f5-8d16-a6b84ffb169c with identifier: GB85500
2026-03-30 11:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9ff81bef-daa1-56f5-8d16-a6b84ffb169c with identifier: GB85500
2026-03-30 11:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9ff81bef-daa1-56f5-8d16-a6b84ffb169c with identifier: GB85500 to the API
2026-03-30 11:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:57:25Z',
'fuel_type': 'diesel',
'id': '9ff81bef-daa1-56f5-8d16-a6b84ffb169c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB85500',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 295147,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-11-12',
'seller_name': None,
'title': 'Seat Ibiza 1.4 TDI Arena',
'transmission': 'manual',
'trim': 'Arena',
'year': 2006}
2026-03-30 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GB85500%27 HTTP/1.1" 200 None
2026-03-30 11:36:00 [auto1.es] INFO: Saving data for GB85500: {'auction_closing_time': 1774886245.0, 'created_time': 1774695985.040942, 'last_price_update_time': 1774870560.497424}
2026-03-30 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GB85500') HTTP/1.1" 204 0
2026-03-30 11:36:00 [auto1.es] INFO: Found listing with ID: SX89883
2026-03-30 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SX89883%27 HTTP/1.1" 200 None
2026-03-30 11:36:00 [auto1.es] INFO: Scrape type for SX89883: 2
2026-03-30 11:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 346cd28f-8696-5f0e-9ce1-899a11aa5816 with identifier: SX89883
2026-03-30 11:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 346cd28f-8696-5f0e-9ce1-899a11aa5816 with scrape type 2
2026-03-30 11:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 346cd28f-8696-5f0e-9ce1-899a11aa5816 with scrape type 2
2026-03-30 11:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 346cd28f-8696-5f0e-9ce1-899a11aa5816, identifier: SX89883
2026-03-30 11:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 346cd28f-8696-5f0e-9ce1-899a11aa5816 with identifier: SX89883
2026-03-30 11:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 346cd28f-8696-5f0e-9ce1-899a11aa5816 with identifier: SX89883
2026-03-30 11:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 346cd28f-8696-5f0e-9ce1-899a11aa5816 with identifier: SX89883 to the API
2026-03-30 11:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:56:27Z',
'fuel_type': 'petrol',
'id': '346cd28f-8696-5f0e-9ce1-899a11aa5816',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX89883',
'listing': 'auction',
'make': 'Honda',
'model': 'Accord',
'odometer': 68180,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-11-28',
'seller_name': None,
'title': 'Honda Accord 2.0 VTEC Executive',
'transmission': 'automatic',
'trim': 'Executive',
'year': 2004}
2026-03-30 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SX89883%27 HTTP/1.1" 200 None
2026-03-30 11:36:00 [auto1.es] INFO: Saving data for SX89883: {'auction_closing_time': 1774886187.0, 'created_time': 1774350714.354069, 'last_price_update_time': 1774870560.950158}
2026-03-30 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SX89883') HTTP/1.1" 204 0
2026-03-30 11:36:00 [auto1.es] INFO: Found listing with ID: FN14601
2026-03-30 11:36:00 [auto1.es] INFO: Found listing with ID: UG73300
2026-03-30 11:36:00 [auto1.es] INFO: Found listing with ID: CE73826
2026-03-30 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CE73826%27 HTTP/1.1" 200 None
2026-03-30 11:36:00 [auto1.es] INFO: Scrape type for CE73826: 2
2026-03-30 11:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c27994e4-df0b-53e0-a600-74328038f075 with identifier: CE73826
2026-03-30 11:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c27994e4-df0b-53e0-a600-74328038f075 with scrape type 2
2026-03-30 11:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c27994e4-df0b-53e0-a600-74328038f075 with scrape type 2
2026-03-30 11:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c27994e4-df0b-53e0-a600-74328038f075, identifier: CE73826
2026-03-30 11:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c27994e4-df0b-53e0-a600-74328038f075 with identifier: CE73826
2026-03-30 11:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c27994e4-df0b-53e0-a600-74328038f075 with identifier: CE73826
2026-03-30 11:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c27994e4-df0b-53e0-a600-74328038f075 with identifier: CE73826 to the API
2026-03-30 11:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:07:23Z',
'fuel_type': 'diesel',
'id': 'c27994e4-df0b-53e0-a600-74328038f075',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE73826',
'listing': 'auction',
'make': 'Citroen',
'model': 'C5 Aircross',
'odometer': 89411,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-30',
'seller_name': None,
'title': 'Citroen C5 Aircross 1.5 Blue-HDi Feel',
'transmission': 'manual',
'trim': 'Feel',
'year': 2021}
2026-03-30 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CE73826%27 HTTP/1.1" 200 None
2026-03-30 11:36:01 [auto1.es] INFO: Saving data for CE73826: {'auction_closing_time': 1774883243.0, 'created_time': 1774696005.363277, 'last_price_update_time': 1774870561.350174}
2026-03-30 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CE73826') HTTP/1.1" 204 0
2026-03-30 11:36:01 [auto1.es] INFO: Found listing with ID: DW64016
2026-03-30 11:36:01 [auto1.es] INFO: Found listing with ID: XB82673
2026-03-30 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XB82673%27 HTTP/1.1" 200 None
2026-03-30 11:36:01 [auto1.es] INFO: Scrape type for XB82673: 2
2026-03-30 11:36:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de6db737-e8b2-5b8b-9d04-6f97bc5b0715 with identifier: XB82673
2026-03-30 11:36:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de6db737-e8b2-5b8b-9d04-6f97bc5b0715 with scrape type 2
2026-03-30 11:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de6db737-e8b2-5b8b-9d04-6f97bc5b0715 with scrape type 2
2026-03-30 11:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: de6db737-e8b2-5b8b-9d04-6f97bc5b0715, identifier: XB82673
2026-03-30 11:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: de6db737-e8b2-5b8b-9d04-6f97bc5b0715 with identifier: XB82673
2026-03-30 11:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: de6db737-e8b2-5b8b-9d04-6f97bc5b0715 with identifier: XB82673
2026-03-30 11:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: de6db737-e8b2-5b8b-9d04-6f97bc5b0715 with identifier: XB82673 to the API
2026-03-30 11:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:40:18Z',
'fuel_type': 'petrol',
'id': 'de6db737-e8b2-5b8b-9d04-6f97bc5b0715',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB82673',
'listing': 'auction',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 101049,
'odometer_reading_unit': 'km',
'origin_country_code': 'ES',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-05-07',
'seller_name': None,
'title': 'Toyota Yaris 1.33 Dual VVT-i Active',
'transmission': 'automatic',
'trim': 'Active',
'year': 2014}
2026-03-30 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XB82673%27 HTTP/1.1" 200 None
2026-03-30 11:36:01 [auto1.es] INFO: Saving data for XB82673: {'auction_closing_time': 1774885218.0, 'created_time': 1774037319.68861, 'last_price_update_time': 1774870561.754095}
2026-03-30 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XB82673') HTTP/1.1" 204 0
2026-03-30 11:36:01 [auto1.es] INFO: Found listing with ID: RV29319
2026-03-30 11:36:01 [auto1.es] INFO: Found listing with ID: US62634
2026-03-30 11:36:01 [auto1.es] INFO: Found listing with ID: XN12672
2026-03-30 11:36:01 [auto1.es] INFO: Found listing with ID: RW91373
2026-03-30 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RW91373%27 HTTP/1.1" 200 None
2026-03-30 11:36:01 [auto1.es] INFO: Scrape type for RW91373: 0
2026-03-30 11:36:01 [auto1.es] INFO: Found listing with ID: RP67068
2026-03-30 11:36:01 [auto1.es] INFO: Found listing with ID: LG74328
2026-03-30 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LG74328%27 HTTP/1.1" 200 None
2026-03-30 11:36:01 [auto1.es] INFO: Scrape type for LG74328: 0
2026-03-30 11:36:01 [auto1.es] INFO: Found listing with ID: RF85744
2026-03-30 11:36:01 [auto1.es] INFO: Found listing with ID: YX32704
2026-03-30 11:36:01 [auto1.es] INFO: Found listing with ID: ZG63896
2026-03-30 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZG63896%27 HTTP/1.1" 200 None
2026-03-30 11:36:01 [auto1.es] INFO: Scrape type for ZG63896: 0
2026-03-30 11:36:01 [auto1.es] INFO: Found listing with ID: XN94474
2026-03-30 11:36:01 [auto1.es] INFO: Found listing with ID: VU26922
2026-03-30 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VU26922%27 HTTP/1.1" 200 None
2026-03-30 11:36:01 [auto1.es] INFO: Scrape type for VU26922: 0
2026-03-30 11:36:01 [auto1.es] INFO: Found listing with ID: AG57096
2026-03-30 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG57096%27 HTTP/1.1" 200 None
2026-03-30 11:36:01 [auto1.es] INFO: Scrape type for AG57096: 0
2026-03-30 11:36:01 [auto1.es] INFO: Found listing with ID: CM29770
2026-03-30 11:36:01 [auto1.es] INFO: Found listing with ID: PU80612
2026-03-30 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PU80612%27 HTTP/1.1" 200 None
2026-03-30 11:36:01 [auto1.es] INFO: Scrape type for PU80612: 0
2026-03-30 11:36:01 [auto1.es] INFO: Channel: 24h | Page: 57 | totalHits: 2249 | hits on page: 9
2026-03-30 11:36:01 [auto1.es] INFO: Found listing with ID: PU80612
2026-03-30 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PU80612%27 HTTP/1.1" 200 None
2026-03-30 11:36:01 [auto1.es] INFO: Scrape type for PU80612: 0
2026-03-30 11:36:01 [auto1.es] INFO: Found listing with ID: RX82713
2026-03-30 11:36:01 [auto1.es] INFO: Found listing with ID: AE71783
2026-03-30 11:36:01 [auto1.es] INFO: Found listing with ID: GH02704
2026-03-30 11:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH02704%27 HTTP/1.1" 200 None
2026-03-30 11:36:02 [auto1.es] INFO: Scrape type for GH02704: 0
2026-03-30 11:36:02 [auto1.es] INFO: Found listing with ID: GR51630
2026-03-30 11:36:02 [auto1.es] INFO: Found listing with ID: CM09391
2026-03-30 11:36:02 [auto1.es] INFO: Found listing with ID: DU59373
2026-03-30 11:36:02 [auto1.es] INFO: Found listing with ID: ZH62909
2026-03-30 11:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZH62909%27 HTTP/1.1" 200 None
2026-03-30 11:36:02 [auto1.es] INFO: Scrape type for ZH62909: 0
2026-03-30 11:36:02 [auto1.es] INFO: Found listing with ID: HZ84685
2026-03-30 11:36:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:36:04 [scrapy.extensions.logstats] INFO: Crawled 235 pages (at 2 pages/min), scraped 257 items (at 14 items/min)
2026-03-30 11:36:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-30 11:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:36:06 [auto1.es] INFO: Channel: 24h | Page: 58 | totalHits: 2249 | hits on page: 0
2026-03-30 11:36:06 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 11:36:06 [auto1.es] INFO: auto1.es Batch config: batch 2/2
2026-03-30 11:36:06 [auto1.es] INFO: auto1.es Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 9, <ScrapeType.BATCH_SKIPPED: 5>: 14}
2026-03-30 11:36:06 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (257 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.es/task_22_2026-03-30T11_05_00.jl
2026-03-30 11:36:06 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 1345517,
'downloader/request_count': 748,
'downloader/request_method_count/GET': 688,
'downloader/request_method_count/POST': 60,
'downloader/response_bytes': 58510332,
'downloader/response_count': 748,
'downloader/response_status_count/200': 748,
'dupefilter/filtered': 21,
'elapsed_time_seconds': 1861.811139,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 30, 11, 36, 6, 320114, tzinfo=datetime.timezone.utc),
'item_scraped_count': 257,
'log_count/DEBUG': 8985,
'log_count/INFO': 9622,
'memusage/max': 170827776,
'memusage/startup': 147902464,
'photo_download_count': 512,
'request_depth_max': 61,
'response_received_count': 236,
'scheduler/dequeued': 748,
'scheduler/dequeued/memory': 748,
'scheduler/enqueued': 748,
'scheduler/enqueued/memory': 748,
'scrape_type/batch_skipped': 1132,
'scrape_type/new': 87,
'scrape_type/price_update': 170,
'scrape_type/skipped': 879,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 274,
'scrapy-zyte-api/error_ratio': 0.1386861313868613,
'scrapy-zyte-api/errors': 38,
"scrapy-zyte-api/exception_types/<class 'aiohttp.client_exceptions.ClientConnectorError'>": 38,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 12.196250744913785,
'scrapy-zyte-api/mean_response_seconds': 12.239006042926396,
'scrapy-zyte-api/processed': 236,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 236,
'scrapy-zyte-api/request_args/experimental.requestCookies': 235,
'scrapy-zyte-api/request_args/experimental.responseCookies': 236,
'scrapy-zyte-api/request_args/httpRequestBody': 60,
'scrapy-zyte-api/request_args/httpRequestMethod': 60,
'scrapy-zyte-api/request_args/httpResponseBody': 236,
'scrapy-zyte-api/request_args/httpResponseHeaders': 236,
'scrapy-zyte-api/request_args/sessionContext': 236,
'scrapy-zyte-api/request_args/url': 236,
'scrapy-zyte-api/status_codes/0': 38,
'scrapy-zyte-api/status_codes/200': 236,
'scrapy-zyte-api/success': 236,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'source/items_encountered': 2289,
'source/total_available': 2249,
'start_time': datetime.datetime(2026, 3, 30, 11, 5, 4, 508975, tzinfo=datetime.timezone.utc)}
2026-03-30 11:36:06 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-30 11:36:06 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fc060d3e750>
2026-03-30 11:36:06 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fc060d3ebd0>