2026-03-26 14:33:59 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-26 14:33:59 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-26 14:33:59 [auto_selling_autotrader.co.uk] INFO: Starting auto_selling_autotrader.co.uk spider
2026-03-26 14:33:59 [auto_selling_autotrader.co.uk] INFO: Quick mode enabled: batching detail requests in groups of 10
2026-03-26 14:33:59 [auto_selling_autotrader.co.uk] INFO: Limiting photo downloads to 1 per item
2026-03-26 14:33:59 [auto_selling_autotrader.co.uk] INFO: _job: d0d822b6292011f18f76c264925fbcfa, SCRAPY_JOB: None
2026-03-26 14:33:59 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-26 14:33:59 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-26 14:33:59 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-26 14:33:59 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-26 14:33:59 [scrapy.extensions.telnet] INFO: Telnet Password: 7976216440b0af16
2026-03-26 14:33:59 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-26 14:33:59 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 3600,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto_selling_autotrader.co.uk/d0d822b6292011f18f76c264925fbcfa.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-26 14:33:59 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-26 14:33:59 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-26 14:33:59 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-26 14:33:59 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware for auto_selling
2026-03-26 14:33:59 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.auto_selling.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-26 14:33:59 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.post_to_azurebus_auto_selling.AzureBusPipelineAutoSelling',
 'crawlers.pipelines.save_to_cdlq_db_auto_selling.SaveToCdlqDbAutoSelling']
2026-03-26 14:33:59 [scrapy.core.engine] INFO: Spider opened
2026-03-26 14:33:59 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-26 14:33:59 [common.service_bus.service_bus_client_factory] INFO: ServiceBusClient initialized via DefaultAzureCredential for alx-production-bus.servicebus.windows.net
2026-03-26 14:33:59 [crawlers.pipelines.base_azure_bus_pipeline] INFO: [AzureBusPipeline] Connected to topic auto.sourcing-v2-quickmode
2026-03-26 14:33:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-26 14:33:59 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-26 14:33:59 [scrapy.extensions.memusage] INFO: Peak memory usage is 140MiB
2026-03-26 14:33:59 [scrapy-playwright] INFO: Starting download handler
2026-03-26 14:33:59 [scrapy-playwright] INFO: Starting download handler
2026-03-26 14:34:04 [auto_selling_autotrader.co.uk] INFO: Scraper started with retailer ID: 10021908 and multipost_profile_id: 00313984-33f8-483e-8f2e-7a88913a2950 and job_id: d0d822b6292011f18f76c264925fbcfa and url: https://www.autotrader.co.uk/dealers/f12-performance-10021908
2026-03-26 14:34:04 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 10021908, page: 1
2026-03-26 14:34:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 14:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: None) ['zyte-api']
2026-03-26 14:34:06 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-26 14:34:06 [auto_selling_autotrader.co.uk] INFO: Page: 1/2, total results: 27
2026-03-26 14:34:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-26 14:34:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603210886600%27 HTTP/1.1" 200 None
2026-03-26 14:34:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603210886600: 1
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110611925%27 HTTP/1.1" 200 None
2026-03-26 14:34:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603110611925: 1
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110594800%27 HTTP/1.1" 200 None
2026-03-26 14:34:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603110594800: 1
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603090524718%27 HTTP/1.1" 200 None
2026-03-26 14:34:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603090524718: 1
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603030355824%27 HTTP/1.1" 200 None
2026-03-26 14:34:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603030355824: 1
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603030355823%27 HTTP/1.1" 200 None
2026-03-26 14:34:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603030355823: 1
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603030355791%27 HTTP/1.1" 200 None
2026-03-26 14:34:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603030355791: 1
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602270272603%27 HTTP/1.1" 200 None
2026-03-26 14:34:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602270272603: 1
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602270257123%27 HTTP/1.1" 200 None
2026-03-26 14:34:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602270257123: 1
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602270257091%27 HTTP/1.1" 200 None
2026-03-26 14:34:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602270257091: 1
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602240182986%27 HTTP/1.1" 200 None
2026-03-26 14:34:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602240182986: 1
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602240179885%27 HTTP/1.1" 200 None
2026-03-26 14:34:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602240179885: 1
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602180016318%27 HTTP/1.1" 200 None
2026-03-26 14:34:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602180016318: 1
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602179999859%27 HTTP/1.1" 200 None
2026-03-26 14:34:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602179999859: 1
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602109825949%27 HTTP/1.1" 200 None
2026-03-26 14:34:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602109825949: 1
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602049673548%27 HTTP/1.1" 200 None
2026-03-26 14:34:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602049673548: 1
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601239375785%27 HTTP/1.1" 200 None
2026-03-26 14:34:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601239375785: 1
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601219320580%27 HTTP/1.1" 200 None
2026-03-26 14:34:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601219320580: 1
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601219320393%27 HTTP/1.1" 200 None
2026-03-26 14:34:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601219320393: 1
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601219310022%27 HTTP/1.1" 200 None
2026-03-26 14:34:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601219310022: 1
2026-03-26 14:34:06 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-26 14:34:06 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-26 14:34:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 14:34:06 [auto_selling_autotrader.co.uk] INFO: Getting next page: 2
2026-03-26 14:34:06 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 10021908, page: 2
2026-03-26 14:34:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 14:34:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 14:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 14:34:08 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:34:08 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 4488966e-314b-52cc-a803-23c6136277b3 with identifier: 202603210886600
2026-03-26 14:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4488966e-314b-52cc-a803-23c6136277b3
2026-03-26 14:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F77d4d8f466564b54976445b36be1a1e2.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/77d4d8f466564b54976445b36be1a1e2.jpg not downloaded yet
2026-03-26 14:34:08 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:34:08 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 31099a70-8732-540a-bb72-4e7831e5bfbe with identifier: 202603110611925
2026-03-26 14:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 31099a70-8732-540a-bb72-4e7831e5bfbe
2026-03-26 14:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0da9fee02d5f42a281cdcd934b656a02.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0da9fee02d5f42a281cdcd934b656a02.jpg not downloaded yet
2026-03-26 14:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 14:34:08 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:34:08 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 801bda98-caa3-5a0d-937a-ea9c3dcc43ee with identifier: 202603110594800
2026-03-26 14:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 801bda98-caa3-5a0d-937a-ea9c3dcc43ee
2026-03-26 14:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F144175deb03e4d49a7a2772ecc1be314.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/144175deb03e4d49a7a2772ecc1be314.jpg not downloaded yet
2026-03-26 14:34:08 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:34:08 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 9462f460-55cd-566d-b49f-5203fd52c3d3 with identifier: 202603090524718
2026-03-26 14:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9462f460-55cd-566d-b49f-5203fd52c3d3
2026-03-26 14:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F54bd1d7d4ed443f2a7307b941f423d95.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/54bd1d7d4ed443f2a7307b941f423d95.jpg not downloaded yet
2026-03-26 14:34:08 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:34:08 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 43e3a6a2-eab6-5b0e-82d4-a2ced01b6c97 with identifier: 202603030355824
2026-03-26 14:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 43e3a6a2-eab6-5b0e-82d4-a2ced01b6c97
2026-03-26 14:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F82bc8ce44a5947f1aecebad0cbd981ee.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/82bc8ce44a5947f1aecebad0cbd981ee.jpg not downloaded yet
2026-03-26 14:34:08 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:34:08 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ccde5ec-f7c3-5691-85ae-6dfa62ca6073 with identifier: 202603030355823
2026-03-26 14:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2ccde5ec-f7c3-5691-85ae-6dfa62ca6073
2026-03-26 14:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F21e0b2552230412aa1da14be337e3f00.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/21e0b2552230412aa1da14be337e3f00.jpg not downloaded yet
2026-03-26 14:34:08 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:34:08 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: f7551df1-7237-597c-99c6-726ffd0c2d66 with identifier: 202603030355791
2026-03-26 14:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f7551df1-7237-597c-99c6-726ffd0c2d66
2026-03-26 14:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F45bb6bd8d0db4613aaef2df5ea9b99c0.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/45bb6bd8d0db4613aaef2df5ea9b99c0.jpg not downloaded yet
2026-03-26 14:34:08 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:34:08 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 792dc901-a1a1-58b4-beb4-4a202113b7eb with identifier: 202602270272603
2026-03-26 14:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 792dc901-a1a1-58b4-beb4-4a202113b7eb
2026-03-26 14:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1abdaf01383f4a66a1b9bdec467d6ef0.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1abdaf01383f4a66a1b9bdec467d6ef0.jpg not downloaded yet
2026-03-26 14:34:08 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:34:08 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 22430611-df35-59c8-9787-85690db0ee3f with identifier: 202602240182986
2026-03-26 14:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 22430611-df35-59c8-9787-85690db0ee3f
2026-03-26 14:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F98fdc18aeb5b4095a6d2094cb008811a.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/98fdc18aeb5b4095a6d2094cb008811a.jpg not downloaded yet
2026-03-26 14:34:08 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:34:08 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e097e37a-c38d-5272-900d-e0684a011105 with identifier: 202602270257123
2026-03-26 14:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e097e37a-c38d-5272-900d-e0684a011105
2026-03-26 14:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F216b24da0ab14543848e7bbb8abff222.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/216b24da0ab14543848e7bbb8abff222.jpg not downloaded yet
2026-03-26 14:34:08 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:34:08 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a26b0843-eaf9-51a9-bee7-8e6dce645226 with identifier: 202602240179885
2026-03-26 14:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a26b0843-eaf9-51a9-bee7-8e6dce645226
2026-03-26 14:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F713325b0bcc74d60948f7df4cf7fa783.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/713325b0bcc74d60948f7df4cf7fa783.jpg not downloaded yet
2026-03-26 14:34:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:34:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e90b649d-b003-541a-94bf-00d9aad38f87 with identifier: 202602270257091
2026-03-26 14:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e90b649d-b003-541a-94bf-00d9aad38f87
2026-03-26 14:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6c404406db2e440e87c7f9957e388c7a.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6c404406db2e440e87c7f9957e388c7a.jpg not downloaded yet
2026-03-26 14:34:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:34:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 18ce1516-43b4-5bdf-a27b-fd25cf1f7c6e with identifier: 202602180016318
2026-03-26 14:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 18ce1516-43b4-5bdf-a27b-fd25cf1f7c6e
2026-03-26 14:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F043487110ed4404b910df8fad82dc94c.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/043487110ed4404b910df8fad82dc94c.jpg not downloaded yet
2026-03-26 14:34:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:34:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e61c1931-5a01-559c-9451-637c2eff0ed9 with identifier: 202602179999859
2026-03-26 14:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e61c1931-5a01-559c-9451-637c2eff0ed9
2026-03-26 14:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5056febf55d4440f980e8b766b0b46bb.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5056febf55d4440f980e8b766b0b46bb.jpg not downloaded yet
2026-03-26 14:34:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:34:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d9efbdd0-9fee-561c-82eb-55292a72ff97 with identifier: 202602109825949
2026-03-26 14:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d9efbdd0-9fee-561c-82eb-55292a72ff97
2026-03-26 14:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6d99322095db4b10b45b6bdad77332d9.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6d99322095db4b10b45b6bdad77332d9.jpg not downloaded yet
2026-03-26 14:34:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:34:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d8e6598-fe32-5c3d-b012-8af0fddad6f1 with identifier: 202602049673548
2026-03-26 14:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3d8e6598-fe32-5c3d-b012-8af0fddad6f1
2026-03-26 14:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff4abbf66ca6e48b89e1847a9e2dd96cb.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f4abbf66ca6e48b89e1847a9e2dd96cb.jpg not downloaded yet
2026-03-26 14:34:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:34:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: f9603557-d7b1-5df4-9ddf-63733eca1de0 with identifier: 202601239375785
2026-03-26 14:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f9603557-d7b1-5df4-9ddf-63733eca1de0
2026-03-26 14:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8a2161bbc0054a368bc003605843145e.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8a2161bbc0054a368bc003605843145e.jpg not downloaded yet
2026-03-26 14:34:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:34:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: cd396599-e0c8-5b89-8008-a576fcb9e04f with identifier: 202601219320580
2026-03-26 14:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cd396599-e0c8-5b89-8008-a576fcb9e04f
2026-03-26 14:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6bafd8ffb6e84608b49d6525c924743e.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6bafd8ffb6e84608b49d6525c924743e.jpg not downloaded yet
2026-03-26 14:34:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:34:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 630012f7-5b60-5dbd-baf7-ab89b93feb8c with identifier: 202601219320393
2026-03-26 14:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 630012f7-5b60-5dbd-baf7-ab89b93feb8c
2026-03-26 14:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd30dd07206de48948e216203a9627589.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d30dd07206de48948e216203a9627589.jpg not downloaded yet
2026-03-26 14:34:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:34:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: f158060e-f2ed-5f57-b0fc-6234275b67bf with identifier: 202601219310022
2026-03-26 14:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f158060e-f2ed-5f57-b0fc-6234275b67bf
2026-03-26 14:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F79e9c6942e0c499892df2f980488c2a3.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/79e9c6942e0c499892df2f980488c2a3.jpg not downloaded yet
2026-03-26 14:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/54bd1d7d4ed443f2a7307b941f423d95.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/82bc8ce44a5947f1aecebad0cbd981ee.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/0da9fee02d5f42a281cdcd934b656a02.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/21e0b2552230412aa1da14be337e3f00.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:34:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-26 14:34:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-26 14:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ad2f450>
2026-03-26 14:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:34:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-26 14:34:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2117
2026-03-26 14:34:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-26 14:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9462f460-55cd-566d-b49f-5203fd52c3d3/9462f460-55cd-566d-b49f-5203fd52c3d3_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F54bd1d7d4ed443f2a7307b941f423d95.jpg') HTTP/1.1" 204 0
2026-03-26 14:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/54bd1d7d4ed443f2a7307b941f423d95.jpg saved to cache
2026-03-26 14:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9462f460-55cd-566d-b49f-5203fd52c3d3
2026-03-26 14:34:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9462f460-55cd-566d-b49f-5203fd52c3d3 sending to next pipeline
2026-03-26 14:34:09 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 9462f460-55cd-566d-b49f-5203fd52c3d3 with identifier 202603090524718
2026-03-26 14:34:09 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: None -> <ConnectionState.START: 0>
2026-03-26 14:34:09 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.START: 0> -> <ConnectionState.HDR_SENT: 2>
2026-03-26 14:34:09 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.HDR_SENT: 2>
2026-03-26 14:34:09 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.OPEN_PIPE: 4>
2026-03-26 14:34:09 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.UNMAPPED: 0> -> <SessionState.BEGIN_SENT: 1>
2026-03-26 14:34:09 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-26 14:34:09 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-26 14:34:09 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-26 14:34:09 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-26 14:34:09 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_PIPE: 4> -> <ConnectionState.OPEN_SENT: 7>
2026-03-26 14:34:09 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_SENT: 7> -> <ConnectionState.OPENED: 9>
2026-03-26 14:34:09 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.BEGIN_SENT: 1> -> <SessionState.MAPPED: 3>
2026-03-26 14:34:09 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-26 14:34:09 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-26 14:34:09 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-26 14:34:09 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-26 14:34:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS completed opening with status: <ManagementOpenResult.OK: 1>
2026-03-26 14:34:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-26 14:34:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2023
2026-03-26 14:34:10 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-26 14:34:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774535650
2026-03-26 14:34:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774535650
2026-03-26 14:34:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS Put token result (<ManagementExecuteOperationResult.OK: 0>), status code: 202, status_description: b'Accepted'.
2026-03-26 14:34:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:10 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-26 14:34:10 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-26 14:34:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:10 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 9462f460-55cd-566d-b49f-5203fd52c3d3
2026-03-26 14:34:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/54bd1d7d4ed443f2a7307b941f423d95.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 292,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'Fantastic Lamborghini Urus just arrived into stock, finished '
                'in grey metallic paint, more details to follow, please call '
                'for more information',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '4L',
 'engine_horse_power': 641,
 'fuel_type': 'Petrol',
 'id': '9462f460-55cd-566d-b49f-5203fd52c3d3',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603090524718',
 'listing': 'directbuy',
 'location': 'Leeds, Yorkshire',
 'make': 'Lamborghini',
 'model': 'Urus',
 'odometer': 60000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9462f460-55cd-566d-b49f-5203fd52c3d3/9462f460-55cd-566d-b49f-5203fd52c3d3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91148,
             'Height': 853,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/54bd1d7d4ed443f2a7307b941f423d95.jpg',
             'Width': 1280}],
 'price': 139990,
 'price_includes_vat': True,
 'registration_date': '2019-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Lamborghini Urus 4.0 V8 BiTurbo SUV 5dr Petrol Auto 4WD Euro 6 (650 '
          'ps)',
 'transmission': 'automatic',
 'year': 2019}
2026-03-26 14:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603090524718%27 HTTP/1.1" 200 None
2026-03-26 14:34:10 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603090524718: {'created_time': 1774535650.480698, 'last_price_update_time': 1774535650.480708}
2026-03-26 14:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603090524718') HTTP/1.1" 204 0
2026-03-26 14:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/1abdaf01383f4a66a1b9bdec467d6ef0.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/98fdc18aeb5b4095a6d2094cb008811a.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/216b24da0ab14543848e7bbb8abff222.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8aee33d0>
2026-03-26 14:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43e3a6a2-eab6-5b0e-82d4-a2ced01b6c97/43e3a6a2-eab6-5b0e-82d4-a2ced01b6c97_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F82bc8ce44a5947f1aecebad0cbd981ee.jpg') HTTP/1.1" 204 0
2026-03-26 14:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/82bc8ce44a5947f1aecebad0cbd981ee.jpg saved to cache
2026-03-26 14:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 43e3a6a2-eab6-5b0e-82d4-a2ced01b6c97
2026-03-26 14:34:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 43e3a6a2-eab6-5b0e-82d4-a2ced01b6c97 sending to next pipeline
2026-03-26 14:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8b760250>
2026-03-26 14:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31099a70-8732-540a-bb72-4e7831e5bfbe/31099a70-8732-540a-bb72-4e7831e5bfbe_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0da9fee02d5f42a281cdcd934b656a02.jpg') HTTP/1.1" 204 0
2026-03-26 14:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0da9fee02d5f42a281cdcd934b656a02.jpg saved to cache
2026-03-26 14:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 31099a70-8732-540a-bb72-4e7831e5bfbe
2026-03-26 14:34:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 31099a70-8732-540a-bb72-4e7831e5bfbe sending to next pipeline
2026-03-26 14:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8b78e650>
2026-03-26 14:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ccde5ec-f7c3-5691-85ae-6dfa62ca6073/2ccde5ec-f7c3-5691-85ae-6dfa62ca6073_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F21e0b2552230412aa1da14be337e3f00.jpg') HTTP/1.1" 204 0
2026-03-26 14:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/21e0b2552230412aa1da14be337e3f00.jpg saved to cache
2026-03-26 14:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2ccde5ec-f7c3-5691-85ae-6dfa62ca6073
2026-03-26 14:34:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2ccde5ec-f7c3-5691-85ae-6dfa62ca6073 sending to next pipeline
2026-03-26 14:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/043487110ed4404b910df8fad82dc94c.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:34:11 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 43e3a6a2-eab6-5b0e-82d4-a2ced01b6c97 with identifier 202603030355824
2026-03-26 14:34:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:11 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 43e3a6a2-eab6-5b0e-82d4-a2ced01b6c97
2026-03-26 14:34:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/82bc8ce44a5947f1aecebad0cbd981ee.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 363,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'Stunning Mercedes-Benz G63 Carbon Edition, finished in '
                'Iridium silver metallic paint over a Bengal red and black '
                'contrast AMG nappa leather interior. Fantastic Carbon Edition '
                'spec includes AMG Carbon Fibre Trim, Heated AMG Performance '
                'Steering Wheel in Carbon Fibre and Dinamica Microfibre, AMG '
                'Night Package, G Manufaktur Bumpers and Flared Wheel Arches '
                'In Obsidian Black, G Manufaktur Roof Painted In Obsidian '
                'Black, 22 AMG Cross Spoke Alloys in Matt Black, Sliding '
                'Sunroof, Burmester Surround Sound System, Active Multicontour '
                'Seat Package, Instrument Panel in Nappa Leather, Red AMG '
                'Calipers, Dark Tinted Heat Insulating Glass, Heated '
                'Windscreen, MULTIBEAM LED, Stainless Steel Side Running '
                'Boards, Ambient Lighting With 64 Colours, AMG Instrument '
                'Cluster, Active Lane Keeping Assist, COMAND Online, AMG Ride '
                'Control, Active Distance Assist Distronic, Blind Spot Assist, '
                'Driving Assistance Package, Active Brake Assist, Parking '
                'Package, Apple CarPlay and Android Auto, Traffic Sign Assist, '
                '360 Camera, Interior Air Ionisation.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '4L',
 'engine_horse_power': 577,
 'fuel_type': 'Petrol',
 'id': '43e3a6a2-eab6-5b0e-82d4-a2ced01b6c97',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603030355824',
 'listing': 'directbuy',
 'location': 'Leeds, Yorkshire',
 'make': 'Mercedes-Benz',
 'model': 'G Class',
 'odometer': 17200,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 55,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43e3a6a2-eab6-5b0e-82d4-a2ced01b6c97/43e3a6a2-eab6-5b0e-82d4-a2ced01b6c97_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294395,
             'Height': 853,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/82bc8ce44a5947f1aecebad0cbd981ee.jpg',
             'Width': 1280}],
 'price': 168990,
 'price_includes_vat': True,
 'registration_date': '2023-05-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz G Class 4.0 G63 V8 BiTurbo AMG Carbon Edition SUV 5dr '
          'Petrol SpdS+9GT 4MATIC Euro 6 (s/s) (585 ps)',
 'transmission': 'automatic',
 'trim': 'AMG Carbon Edition',
 'year': 2023}
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603030355824%27 HTTP/1.1" 200 None
2026-03-26 14:34:11 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603030355824: {'created_time': 1774535651.090562, 'last_price_update_time': 1774535651.090574}
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603030355824') HTTP/1.1" 204 0
2026-03-26 14:34:11 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 31099a70-8732-540a-bb72-4e7831e5bfbe with identifier 202603110611925
2026-03-26 14:34:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:11 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 31099a70-8732-540a-bb72-4e7831e5bfbe
2026-03-26 14:34:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/0da9fee02d5f42a281cdcd934b656a02.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 331,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'Stunning Range Rover SVR, finished in Estoril blue metallic '
                'paint, Full Land Rover service history, featuring genuine '
                'Urban 23" alloy wheels, sliding panoramic roof, carbon '
                'interior trim, full carbon fibre exterior including exposed '
                'carbon fibre bonnet, carbon fibre exterior mirrors, side fins '
                'and rear boot trim, black leather interior with heated seats '
                'and heated SVR carbon steering wheel, adaptive cruise '
                'control, lane assist, reversing camera and parking sensors, '
                'meridian surround sound system, privacy glass, bluetooth '
                'connectivity, satellite navigation and more',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '5L',
 'engine_horse_power': 567,
 'fuel_type': 'Petrol',
 'id': '31099a70-8732-540a-bb72-4e7831e5bfbe',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603110611925',
 'listing': 'directbuy',
 'location': 'Leeds, Yorkshire',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 57215,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 55,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31099a70-8732-540a-bb72-4e7831e5bfbe/31099a70-8732-540a-bb72-4e7831e5bfbe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349298,
             'Height': 853,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/0da9fee02d5f42a281cdcd934b656a02.jpg',
             'Width': 1280}],
 'price': 47990,
 'price_includes_vat': True,
 'registration_date': '2021-05-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 5.0 P575 V8 GPF SVR SUV 5dr Petrol '
          'Auto 4WD Euro 6 (s/s) (575 ps)',
 'transmission': 'automatic',
 'trim': 'SVR',
 'year': 2021}
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110611925%27 HTTP/1.1" 200 None
2026-03-26 14:34:11 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603110611925: {'created_time': 1774535651.13617, 'last_price_update_time': 1774535651.136179}
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603110611925') HTTP/1.1" 204 0
2026-03-26 14:34:11 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2ccde5ec-f7c3-5691-85ae-6dfa62ca6073 with identifier 202603030355823
2026-03-26 14:34:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:11 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2ccde5ec-f7c3-5691-85ae-6dfa62ca6073
2026-03-26 14:34:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/21e0b2552230412aa1da14be337e3f00.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 211,
 'color': 'White',
 'currency': 'GBP',
 'description': 'Stunning Range Rover D350 HSE just arrived into stock, '
                'finished in white metallic paint with black leather interior. '
                'Spec includes 7 seats, fixed side steps, 23" gloss black '
                'alloy wheels, panoramic glass roof, head up display, heated '
                'steering wheel, heated and cooled seats, air suspension, 360 '
                'parking camera and sensors, adaptive cruise control, Meridian '
                'surround sound system, bluetooth connectivity, satellite '
                'navigation and more',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 345,
 'fuel_type': 'Diesel',
 'id': '2ccde5ec-f7c3-5691-85ae-6dfa62ca6073',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603030355823',
 'listing': 'directbuy',
 'location': 'Leeds, Yorkshire',
 'make': 'Land Rover',
 'model': 'Range Rover',
 'odometer': 11750,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ccde5ec-f7c3-5691-85ae-6dfa62ca6073/2ccde5ec-f7c3-5691-85ae-6dfa62ca6073_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289313,
             'Height': 853,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/21e0b2552230412aa1da14be337e3f00.jpg',
             'Width': 1280}],
 'price': 99990,
 'price_includes_vat': True,
 'registration_date': '2025-05-30',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Land Rover Range Rover D350 MHEV HSE SUV 3.0 Automatic Diesel 5dr',
 'transmission': 'automatic',
 'trim': 'HSE',
 'year': 2025}
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603030355823%27 HTTP/1.1" 200 None
2026-03-26 14:34:11 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603030355823: {'created_time': 1774535651.182543, 'last_price_update_time': 1774535651.18255}
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603030355823') HTTP/1.1" 204 0
2026-03-26 14:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/713325b0bcc74d60948f7df4cf7fa783.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/45bb6bd8d0db4613aaef2df5ea9b99c0.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:34:11 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 4488966e-314b-52cc-a803-23c6136277b3 with identifier 202603210886600
2026-03-26 14:34:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:11 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 4488966e-314b-52cc-a803-23c6136277b3
2026-03-26 14:34:11 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 202,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'Just arrived into stock we have this fantastic low mileage '
                'VAT Qualifying Land Rover Range Rover Sport D350 '
                'Autobiography, finished in the highly sought after Borasco '
                'grey paint, black leather interior, upgraded 23" alloy '
                'wheels, fixed side steps, HUD, soft close doors plus much '
                'more full Land Rover service history, call for more details',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 345,
 'fuel_type': 'Diesel',
 'id': '4488966e-314b-52cc-a803-23c6136277b3',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603210886600',
 'listing': 'directbuy',
 'location': 'Leeds, Yorkshire',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 12350,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/77d4d8f466564b54976445b36be1a1e2.jpg'],
 'photos': [],
 'price': 84990,
 'price_includes_vat': True,
 'registration_date': '2024-03-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 3.0 D350 MHEV Autobiography SUV 5dr '
          'Diesel Auto 4WD Euro 6 (s/s) (350 ps)',
 'transmission': 'automatic',
 'trim': 'Autobiography',
 'year': 2024}
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603210886600%27 HTTP/1.1" 200 None
2026-03-26 14:34:11 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603210886600: {'created_time': 1774535651.243659, 'last_price_update_time': 1774535651.243666}
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603210886600') HTTP/1.1" 204 0
2026-03-26 14:34:11 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 801bda98-caa3-5a0d-937a-ea9c3dcc43ee with identifier 202603110594800
2026-03-26 14:34:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:11 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 801bda98-caa3-5a0d-937a-ea9c3dcc43ee
2026-03-26 14:34:11 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 275,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'Incredible Stage 4.25 Litchfield tuned Nissan GT-R, finished '
                'in black metallic paint with tan leather interior. Full '
                'service history - by Middlehurst Motorsport Nissan '
                'Specialists until 2021, and serviced by Litchfield every year '
                'after that.\n'
                '\n'
                'The Stage 4.25 Power upgrade includes:\n'
                '\n'
                'Litchfield Stainless Steel Downpipes\n'
                'Litchfield 1,100cc Bosch Injectors\n'
                'Litchfield large bore performance intake kit with larger MAF '
                'housing\n'
                'Litchfield stainless steel Y-Pipe\n'
                'Litchfield rear stainless steel exhaust system (85mm for '
                'improved flow)\n'
                'Improved boost control with custom Ecutek code\n'
                'Adjustable boost using the steering wheels cruise control '
                'button\n'
                'Revised ignition control, variable valve timing and fuel '
                'maps\n'
                'Reduced fuel consumption (especially on partial throttle '
                'conditions)\n'
                'Increase in both power and torque across the whole rev range\n'
                'Litchfield Version 8 RACEROM Switchable maps for 95 Unleaded, '
                '97 Super Unleaded & 99 Octane Super Unleaded\n'
                'Litchfield Custom Traction Control settings with Live '
                'adjustment (with optional Bluetooth Interface & Phone App)\n'
                'Litchfield Torque Control for Live adjustment of power output '
                'per gear (with optional Bluetooth Interface & Phone App)\n'
                'Litchfield Adjustable Burbles / Flames from mild to wild '
                '(with optional Bluetooth Interface & Phone App)\n'
                'Litchfield Selectable Upshift Pops on full throttle gear '
                'changes\n'
                'Litchfield Safety trips for additional engine and clutch '
                'protection\n'
                'Litchfield Custom Launch Control settings when used with '
                'Gearbox Software upgrade\n'
                '\n'
                'The car also benefits from 15mm wheel spacers, Goodridge '
                'performance brake lines and various other small upgrades done '
                "throughout it's years of servicing at Litchfield.",
 'doors_number': 2,
 'emission_standard': 'Euro 6',
 'engine': '3.8L',
 'engine_horse_power': 562,
 'fuel_type': 'Petrol',
 'id': '801bda98-caa3-5a0d-937a-ea9c3dcc43ee',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603110594800',
 'listing': 'directbuy',
 'location': 'Leeds, Yorkshire',
 'make': 'Nissan',
 'model': 'GT-R',
 'odometer': 18104,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/144175deb03e4d49a7a2772ecc1be314.jpg'],
 'photos': [],
 'price': 83990,
 'price_includes_vat': True,
 'registration_date': '2018-12-06',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Nissan Gt-R 3.8 V6 Prestige Coupe 2dr Petrol Auto 4WD Euro 6 (570 '
          'ps)',
 'transmission': 'automatic',
 'trim': 'Prestige',
 'year': 2018}
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110594800%27 HTTP/1.1" 200 None
2026-03-26 14:34:11 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603110594800: {'created_time': 1774535651.292324, 'last_price_update_time': 1774535651.292334}
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603110594800') HTTP/1.1" 204 0
2026-03-26 14:34:11 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 4488966e-314b-52cc-a803-23c6136277b3 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-26 14:34:11 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 801bda98-caa3-5a0d-937a-ea9c3dcc43ee due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-26 14:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8b7f8a10>
2026-03-26 14:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_792dc901-a1a1-58b4-beb4-4a202113b7eb/792dc901-a1a1-58b4-beb4-4a202113b7eb_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1abdaf01383f4a66a1b9bdec467d6ef0.jpg') HTTP/1.1" 204 0
2026-03-26 14:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1abdaf01383f4a66a1b9bdec467d6ef0.jpg saved to cache
2026-03-26 14:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 792dc901-a1a1-58b4-beb4-4a202113b7eb
2026-03-26 14:34:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 792dc901-a1a1-58b4-beb4-4a202113b7eb sending to next pipeline
2026-03-26 14:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8b791f10>
2026-03-26 14:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22430611-df35-59c8-9787-85690db0ee3f/22430611-df35-59c8-9787-85690db0ee3f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F98fdc18aeb5b4095a6d2094cb008811a.jpg') HTTP/1.1" 204 0
2026-03-26 14:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/98fdc18aeb5b4095a6d2094cb008811a.jpg saved to cache
2026-03-26 14:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 22430611-df35-59c8-9787-85690db0ee3f
2026-03-26 14:34:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 22430611-df35-59c8-9787-85690db0ee3f sending to next pipeline
2026-03-26 14:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf915ce750>
2026-03-26 14:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e097e37a-c38d-5272-900d-e0684a011105/e097e37a-c38d-5272-900d-e0684a011105_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F216b24da0ab14543848e7bbb8abff222.jpg') HTTP/1.1" 204 0
2026-03-26 14:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/216b24da0ab14543848e7bbb8abff222.jpg saved to cache
2026-03-26 14:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e097e37a-c38d-5272-900d-e0684a011105
2026-03-26 14:34:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e097e37a-c38d-5272-900d-e0684a011105 sending to next pipeline
2026-03-26 14:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9314f910>
2026-03-26 14:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18ce1516-43b4-5bdf-a27b-fd25cf1f7c6e/18ce1516-43b4-5bdf-a27b-fd25cf1f7c6e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F043487110ed4404b910df8fad82dc94c.jpg') HTTP/1.1" 204 0
2026-03-26 14:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/043487110ed4404b910df8fad82dc94c.jpg saved to cache
2026-03-26 14:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 18ce1516-43b4-5bdf-a27b-fd25cf1f7c6e
2026-03-26 14:34:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 18ce1516-43b4-5bdf-a27b-fd25cf1f7c6e sending to next pipeline
2026-03-26 14:34:11 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 792dc901-a1a1-58b4-beb4-4a202113b7eb with identifier 202602270272603
2026-03-26 14:34:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:11 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 792dc901-a1a1-58b4-beb4-4a202113b7eb
2026-03-26 14:34:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/1abdaf01383f4a66a1b9bdec467d6ef0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 270,
 'color': 'Unknown',
 'currency': 'GBP',
 'description': 'Insane Mustang Mach 1 currently available, with over £30,000 '
                'worth of upgrades carried out by Motorsport And Performance, '
                'including Whipple Stage 2 supercharger, Steeda dual rate '
                'magneride lowering springs, Eibach camber bolts, Steeda '
                'billet aluminium vertical links, Steeda adjustable rear tow '
                'links, Steeda IRS subframe support braces, Steeda 2 point '
                'G-Trac brace, Coyote billet oil pump and crank gear, HP '
                'tuner, custom dyno tune, Mach 1 handling pack including rear '
                'roll bar, rear spoiler, front splitter, front wheel lip '
                'moulding, and 19" bird nest alloys with Michelin Pilot Sport '
                'tyres. The car also comes finished in the full Mach 1 decal '
                'kit with gloss black roof wrap stripe. For a full rundown of '
                'the modifications please see the following youtube video by '
                'MAP themselves when the upgrades were fitted - '
                'https://www.youtube.com/watch?v=fFlDa_LMn2A',
 'doors_number': 2,
 'emission_standard': 'Euro 6',
 'engine': '5L',
 'engine_horse_power': 454,
 'fuel_type': 'Petrol',
 'id': '792dc901-a1a1-58b4-beb4-4a202113b7eb',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602270272603',
 'listing': 'directbuy',
 'location': 'Leeds, Yorkshire',
 'make': 'Ford',
 'model': 'Mustang',
 'odometer': 10610,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 62,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_792dc901-a1a1-58b4-beb4-4a202113b7eb/792dc901-a1a1-58b4-beb4-4a202113b7eb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345154,
             'Height': 853,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/1abdaf01383f4a66a1b9bdec467d6ef0.jpg',
             'Width': 1280}],
 'price': 64990,
 'price_includes_vat': True,
 'registration_date': '2021-09-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Ford Mustang 5.0 V8 Mach 1 Fastback 2dr Petrol SelShift Euro 6 (460 '
          'ps)',
 'transmission': 'automatic',
 'trim': 'Mach 1',
 'year': 2021}
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602270272603%27 HTTP/1.1" 200 None
2026-03-26 14:34:11 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602270272603: {'created_time': 1774535651.744827, 'last_price_update_time': 1774535651.744837}
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602270272603') HTTP/1.1" 204 0
2026-03-26 14:34:11 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 22430611-df35-59c8-9787-85690db0ee3f with identifier 202602240182986
2026-03-26 14:34:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:11 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 22430611-df35-59c8-9787-85690db0ee3f
2026-03-26 14:34:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/98fdc18aeb5b4095a6d2094cb008811a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 165,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'Fantastic BMW X5 30d M Sport just arrived into stock, '
                'finished in Arctic grey with black vernasca leather interior. '
                'Full BMW service history, Spec includes M sport plus package, '
                '7 seats, 21" M alloy wheels, sun protection glazing, travel '
                'and comfort system, heated front seats, cruise control, rear '
                'view camera, front and rear parking sensors, adjustable air '
                'suspension, auto climate control, bluetooth connectivity, '
                'satellite navigation and more',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 261,
 'fuel_type': 'Diesel',
 'id': '22430611-df35-59c8-9787-85690db0ee3f',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602240182986',
 'listing': 'directbuy',
 'location': 'Leeds, Yorkshire',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 28715,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 57,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22430611-df35-59c8-9787-85690db0ee3f/22430611-df35-59c8-9787-85690db0ee3f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 293648,
             'Height': 853,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/98fdc18aeb5b4095a6d2094cb008811a.jpg',
             'Width': 1280}],
 'price': 39450,
 'price_includes_vat': True,
 'registration_date': '2019-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X5 3.0 30d M Sport SUV 5dr Diesel Auto xDrive Euro 6 (s/s) (265 '
          'ps)',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602240182986%27 HTTP/1.1" 200 None
2026-03-26 14:34:11 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602240182986: {'created_time': 1774535651.805873, 'last_price_update_time': 1774535651.805881}
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602240182986') HTTP/1.1" 204 0
2026-03-26 14:34:11 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e097e37a-c38d-5272-900d-e0684a011105 with identifier 202602270257123
2026-03-26 14:34:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:11 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e097e37a-c38d-5272-900d-e0684a011105
2026-03-26 14:34:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/216b24da0ab14543848e7bbb8abff222.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 248,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'Fantastic Toyota Hilux GR Sport, finished in grey metallic '
                'paint, with full Toyota service history, towbar, JBL sound '
                'system, front and rear parking sensors, rear view camera, '
                'heated front seats, heated outer rear seats, intelligent '
                'adaptive cruise control, 17" alloy wheels, privacy glass, GR '
                'sport exterior styling, plus much more',
 'doors_number': 4,
 'emission_standard': 'Euro 6',
 'engine': '2.8L',
 'engine_horse_power': 201,
 'fuel_type': 'Diesel',
 'id': 'e097e37a-c38d-5272-900d-e0684a011105',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602270257123',
 'listing': 'directbuy',
 'location': 'Leeds, Yorkshire',
 'make': 'Toyota',
 'model': 'Hilux',
 'odometer': 14250,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 61,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e097e37a-c38d-5272-900d-e0684a011105/e097e37a-c38d-5272-900d-e0684a011105_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254483,
             'Height': 853,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/216b24da0ab14543848e7bbb8abff222.jpg',
             'Width': 1280}],
 'price': 39990,
 'price_includes_vat': True,
 'registration_date': '2023-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Hilux 2.8 D-4D GR SPORT Pickup Double Cab 4dr Diesel Auto '
          '4WD Euro 6 (s/s) (204 ps)',
 'transmission': 'automatic',
 'trim': 'GR SPORT',
 'year': 2023}
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602270257123%27 HTTP/1.1" 200 None
2026-03-26 14:34:11 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602270257123: {'created_time': 1774535651.853659, 'last_price_update_time': 1774535651.853666}
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602270257123') HTTP/1.1" 204 0
2026-03-26 14:34:11 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 18ce1516-43b4-5bdf-a27b-fd25cf1f7c6e with identifier 202602180016318
2026-03-26 14:34:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:11 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 18ce1516-43b4-5bdf-a27b-fd25cf1f7c6e
2026-03-26 14:34:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/043487110ed4404b910df8fad82dc94c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 338,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'Brand new Magno G63 available now - VAT Qualifying - please '
                'call for more information',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '4L',
 'engine_horse_power': 597,
 'fuel_type': 'Petrol Hybrid',
 'id': '18ce1516-43b4-5bdf-a27b-fd25cf1f7c6e',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602180016318',
 'listing': 'directbuy',
 'location': 'Leeds, Yorkshire',
 'make': 'Mercedes-Benz',
 'model': 'G Class',
 'odometer': 30,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 58,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18ce1516-43b4-5bdf-a27b-fd25cf1f7c6e/18ce1516-43b4-5bdf-a27b-fd25cf1f7c6e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301143,
             'Height': 853,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/043487110ed4404b910df8fad82dc94c.jpg',
             'Width': 1280}],
 'price': 234990,
 'price_includes_vat': True,
 'registration_date': '2026-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz G Class 4.0 G63 V8 BiTurbo MHEV AMG Magno Edition SUV '
          '5dr Petrol Hybrid SpdS+9GT 4WD Euro 6 (s/s) (605 ps)',
 'transmission': 'automatic',
 'trim': 'AMG Magno Edition',
 'year': 2026}
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602180016318%27 HTTP/1.1" 200 None
2026-03-26 14:34:11 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602180016318: {'created_time': 1774535651.911213, 'last_price_update_time': 1774535651.911221}
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602180016318') HTTP/1.1" 204 0
2026-03-26 14:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/d30dd07206de48948e216203a9627589.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/6d99322095db4b10b45b6bdad77332d9.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/79e9c6942e0c499892df2f980488c2a3.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf92d21890>
2026-03-26 14:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a26b0843-eaf9-51a9-bee7-8e6dce645226/a26b0843-eaf9-51a9-bee7-8e6dce645226_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F713325b0bcc74d60948f7df4cf7fa783.jpg') HTTP/1.1" 204 0
2026-03-26 14:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/713325b0bcc74d60948f7df4cf7fa783.jpg saved to cache
2026-03-26 14:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a26b0843-eaf9-51a9-bee7-8e6dce645226
2026-03-26 14:34:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a26b0843-eaf9-51a9-bee7-8e6dce645226 sending to next pipeline
2026-03-26 14:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9155e690>
2026-03-26 14:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7551df1-7237-597c-99c6-726ffd0c2d66/f7551df1-7237-597c-99c6-726ffd0c2d66_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F45bb6bd8d0db4613aaef2df5ea9b99c0.jpg') HTTP/1.1" 204 0
2026-03-26 14:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/45bb6bd8d0db4613aaef2df5ea9b99c0.jpg saved to cache
2026-03-26 14:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f7551df1-7237-597c-99c6-726ffd0c2d66
2026-03-26 14:34:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f7551df1-7237-597c-99c6-726ffd0c2d66 sending to next pipeline
2026-03-26 14:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/8a2161bbc0054a368bc003605843145e.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:34:12 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a26b0843-eaf9-51a9-bee7-8e6dce645226 with identifier 202602240179885
2026-03-26 14:34:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:12 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a26b0843-eaf9-51a9-bee7-8e6dce645226
2026-03-26 14:34:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/713325b0bcc74d60948f7df4cf7fa783.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 246,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'Stunning Porsche 992 Carrera 4 GTS, finished in silver '
                'metallic paint with a black leather interior, fantastic spec '
                'with factory optional extras including electric glass sliding '
                'roof, exterior black high gloss package, 18 way adaptive '
                'sports seats plus, BOSE surround sound system, tinted LED '
                'headlights with matrix beam including PDLS+, lane change '
                'assist, extended interior package in matt carbon fibre, front '
                'and rear park assist with reversing camera, privacy glass, '
                'light design package, high gloss black side window trims, rev '
                'counter dial in crayon, electric folding exterior mirrors, '
                'air ioniser, heated GT sport steering wheel in leather, '
                'Porsche logo in high gloss black, 911 logo painted in '
                'exterior colour, Porsche logo LED door courtesy lights, and '
                'exclusive design fuel cap. This all comes alongside the '
                'standard GTS spec which includes switchable sports exhaust, '
                'leather and alcantara GTS interior package, cruise control, '
                'PASM sports chassis, rear axle steering, heated seats, and '
                'much more.',
 'doors_number': 2,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 473,
 'fuel_type': 'Petrol',
 'id': 'a26b0843-eaf9-51a9-bee7-8e6dce645226',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602240179885',
 'listing': 'directbuy',
 'location': 'Leeds, Yorkshire',
 'make': 'Porsche',
 'model': '911',
 'odometer': 5900,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 57,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a26b0843-eaf9-51a9-bee7-8e6dce645226/a26b0843-eaf9-51a9-bee7-8e6dce645226_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 366525,
             'Height': 853,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/713325b0bcc74d60948f7df4cf7fa783.jpg',
             'Width': 1280}],
 'price': 114990,
 'price_includes_vat': True,
 'registration_date': '2023-01-20',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Porsche 911 3.0T 992 Carrera 4 GTS Coupe 2dr Petrol PDK 4WD Euro 6 '
          '(s/s) (480 ps)',
 'transmission': 'automatic',
 'trim': '992 Carrera 4 GTS',
 'year': 2023}
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602240179885%27 HTTP/1.1" 200 None
2026-03-26 14:34:12 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602240179885: {'created_time': 1774535652.162924, 'last_price_update_time': 1774535652.162931}
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602240179885') HTTP/1.1" 204 0
2026-03-26 14:34:12 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: f7551df1-7237-597c-99c6-726ffd0c2d66 with identifier 202603030355791
2026-03-26 14:34:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:12 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item f7551df1-7237-597c-99c6-726ffd0c2d66
2026-03-26 14:34:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/45bb6bd8d0db4613aaef2df5ea9b99c0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 373,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'Just arrived into stock is this amazing Mercedes Benz G63 '
                'finished in metallic black with full black leather interior. '
                'Genuine Urban kit and wheels, Miltek exhaust system, full '
                'Mercedes Benz service history, factory spec includes heated '
                'and cooled front seats with massage function, 22" forged '
                'satin black alloys, sunroof, 360 degree parking cameras and '
                'sensors, adaptive cruise control, blind spot assist, privacy '
                'glass, switchable AMG exhaust, gloss red AMG calipers, '
                'bluetooth connectivity, satellite navigation and more',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '4L',
 'engine_horse_power': 577,
 'fuel_type': 'Petrol',
 'id': 'f7551df1-7237-597c-99c6-726ffd0c2d66',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603030355791',
 'listing': 'directbuy',
 'location': 'Leeds, Yorkshire',
 'make': 'Mercedes-Benz',
 'model': 'G Class',
 'odometer': 35805,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 62,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7551df1-7237-597c-99c6-726ffd0c2d66/f7551df1-7237-597c-99c6-726ffd0c2d66_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271967,
             'Height': 853,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/45bb6bd8d0db4613aaef2df5ea9b99c0.jpg',
             'Width': 1280}],
 'price': 141990,
 'price_includes_vat': True,
 'registration_date': '2021-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz G Class 4.0 G63 V8 BiTurbo AMG SUV 5dr Petrol '
          'SpdS+9GT 4MATIC Euro 6 (s/s) (585 ps)',
 'transmission': 'automatic',
 'trim': 'AMG',
 'year': 2021}
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603030355791%27 HTTP/1.1" 200 None
2026-03-26 14:34:12 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603030355791: {'created_time': 1774535652.229523, 'last_price_update_time': 1774535652.229531}
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603030355791') HTTP/1.1" 204 0
2026-03-26 14:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/f4abbf66ca6e48b89e1847a9e2dd96cb.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/6bafd8ffb6e84608b49d6525c924743e.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf901faf10>
2026-03-26 14:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_630012f7-5b60-5dbd-baf7-ab89b93feb8c/630012f7-5b60-5dbd-baf7-ab89b93feb8c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd30dd07206de48948e216203a9627589.jpg') HTTP/1.1" 204 0
2026-03-26 14:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d30dd07206de48948e216203a9627589.jpg saved to cache
2026-03-26 14:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 630012f7-5b60-5dbd-baf7-ab89b93feb8c
2026-03-26 14:34:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 630012f7-5b60-5dbd-baf7-ab89b93feb8c sending to next pipeline
2026-03-26 14:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8b748d90>
2026-03-26 14:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9efbdd0-9fee-561c-82eb-55292a72ff97/d9efbdd0-9fee-561c-82eb-55292a72ff97_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6d99322095db4b10b45b6bdad77332d9.jpg') HTTP/1.1" 204 0
2026-03-26 14:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6d99322095db4b10b45b6bdad77332d9.jpg saved to cache
2026-03-26 14:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d9efbdd0-9fee-561c-82eb-55292a72ff97
2026-03-26 14:34:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d9efbdd0-9fee-561c-82eb-55292a72ff97 sending to next pipeline
2026-03-26 14:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8b732bd0>
2026-03-26 14:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f158060e-f2ed-5f57-b0fc-6234275b67bf/f158060e-f2ed-5f57-b0fc-6234275b67bf_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F79e9c6942e0c499892df2f980488c2a3.jpg') HTTP/1.1" 204 0
2026-03-26 14:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/79e9c6942e0c499892df2f980488c2a3.jpg saved to cache
2026-03-26 14:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f158060e-f2ed-5f57-b0fc-6234275b67bf
2026-03-26 14:34:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f158060e-f2ed-5f57-b0fc-6234275b67bf sending to next pipeline
2026-03-26 14:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf915a0d10>
2026-03-26 14:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9603557-d7b1-5df4-9ddf-63733eca1de0/f9603557-d7b1-5df4-9ddf-63733eca1de0_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8a2161bbc0054a368bc003605843145e.jpg') HTTP/1.1" 204 0
2026-03-26 14:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8a2161bbc0054a368bc003605843145e.jpg saved to cache
2026-03-26 14:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f9603557-d7b1-5df4-9ddf-63733eca1de0
2026-03-26 14:34:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f9603557-d7b1-5df4-9ddf-63733eca1de0 sending to next pipeline
2026-03-26 14:34:12 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 630012f7-5b60-5dbd-baf7-ab89b93feb8c with identifier 202601219320393
2026-03-26 14:34:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:12 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 630012f7-5b60-5dbd-baf7-ab89b93feb8c
2026-03-26 14:34:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/d30dd07206de48948e216203a9627589.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 213,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'Fantastic VAT Qualifying Range Rover D350 LWB 7 seat now '
                'available, finished in black metallic paint, featuring '
                'deployable side steps, 23" gloss black alloy wheels, shadow '
                'exterior pack, privacy glass, SV bespoke mats, panoramic '
                'glass sliding roof, head up display, 360 degree surround '
                'camera, parking sensors, heated leather steering wheel, '
                'heated and cooled massage seats, cruise control and lane '
                'assist, traffic sign recognition, wireless charging, apple '
                'car play, bluetooth connectivity, satellite navigation and '
                'more',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 345,
 'fuel_type': 'Diesel',
 'id': '630012f7-5b60-5dbd-baf7-ab89b93feb8c',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601219320393',
 'listing': 'directbuy',
 'location': 'Leeds, Yorkshire',
 'make': 'Land Rover',
 'model': 'Range Rover',
 'odometer': 63100,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 57,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_630012f7-5b60-5dbd-baf7-ab89b93feb8c/630012f7-5b60-5dbd-baf7-ab89b93feb8c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309911,
             'Height': 853,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/d30dd07206de48948e216203a9627589.jpg',
             'Width': 1280}],
 'price': 79990,
 'price_includes_vat': True,
 'registration_date': '2022-09-15',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Land Rover Range Rover 3.0 D350 MHEV Autobiography SUV 5dr Diesel '
          'Auto 4WD Euro 6 (s/s) (LWB, 7Seat) (350 ps)',
 'transmission': 'automatic',
 'trim': 'Autobiography',
 'year': 2022}
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601219320393%27 HTTP/1.1" 200 None
2026-03-26 14:34:12 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601219320393: {'created_time': 1774535652.663245, 'last_price_update_time': 1774535652.663256}
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601219320393') HTTP/1.1" 204 0
2026-03-26 14:34:12 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d9efbdd0-9fee-561c-82eb-55292a72ff97 with identifier 202602109825949
2026-03-26 14:34:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:12 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d9efbdd0-9fee-561c-82eb-55292a72ff97
2026-03-26 14:34:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/6d99322095db4b10b45b6bdad77332d9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 232,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'Fantastic Ford Ranger Wildtrak just arrived into stock, '
                'finished in grey metallic paint, featuring heated leather '
                'seats, heated leather steering wheel, adaptive cruise '
                'control, 360 parking camera and sensors, 18" alloy wheels in '
                'grey metallic paint with all season tyres, LED headlights, '
                'heated windscreen, digital dash, apple car play, bluetooth '
                'connectivity, satellite navigation and more',
 'doors_number': 4,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 202,
 'fuel_type': 'Diesel',
 'id': 'd9efbdd0-9fee-561c-82eb-55292a72ff97',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602109825949',
 'listing': 'directbuy',
 'location': 'Leeds, Yorkshire',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 6875,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9efbdd0-9fee-561c-82eb-55292a72ff97/d9efbdd0-9fee-561c-82eb-55292a72ff97_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264681,
             'Height': 853,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/6d99322095db4b10b45b6bdad77332d9.jpg',
             'Width': 1280}],
 'price': 39990,
 'price_includes_vat': True,
 'registration_date': '2025-09-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TD EcoBlue Wildtrak Pickup Double Cab 4dr Diesel '
          'Auto 4WD Euro 6 (s/s) (205 ps)',
 'transmission': 'automatic',
 'trim': 'Wildtrak',
 'year': 2025}
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602109825949%27 HTTP/1.1" 200 None
2026-03-26 14:34:12 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602109825949: {'created_time': 1774535652.712624, 'last_price_update_time': 1774535652.712635}
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602109825949') HTTP/1.1" 204 0
2026-03-26 14:34:12 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: f158060e-f2ed-5f57-b0fc-6234275b67bf with identifier 202601219310022
2026-03-26 14:34:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:12 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item f158060e-f2ed-5f57-b0fc-6234275b67bf
2026-03-26 14:34:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/79e9c6942e0c499892df2f980488c2a3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 185,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'Stunning Audi S3 Black Edition, finished in grey metallic '
                'paint with black leather interior, this car features B&O '
                'surround sound system, heated and quilted leather front '
                'seats, reversing camera, parking sensors, Audi Virtual '
                'Cockpit, automatic climate control, cruise control, LED '
                'headlights and tail lights, Apple Car Play, bluetooth '
                'connectivity, satellite navigation and more',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 306,
 'fuel_type': 'Petrol',
 'id': 'f158060e-f2ed-5f57-b0fc-6234275b67bf',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601219310022',
 'listing': 'directbuy',
 'location': 'Leeds, Yorkshire',
 'make': 'Audi',
 'model': 'S3',
 'odometer': 15925,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 51,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f158060e-f2ed-5f57-b0fc-6234275b67bf/f158060e-f2ed-5f57-b0fc-6234275b67bf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285238,
             'Height': 853,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/79e9c6942e0c499892df2f980488c2a3.jpg',
             'Width': 1280}],
 'price': 34490,
 'price_includes_vat': True,
 'registration_date': '2024-03-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi S3 2.0 TFSI Black Edition Sportback 5dr Petrol S Tronic '
          'quattro Euro 6 (s/s) (310 ps)',
 'transmission': 'automatic',
 'trim': 'Black Edition',
 'year': 2024}
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601219310022%27 HTTP/1.1" 200 None
2026-03-26 14:34:12 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601219310022: {'created_time': 1774535652.770309, 'last_price_update_time': 1774535652.770319}
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601219310022') HTTP/1.1" 204 0
2026-03-26 14:34:12 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: f9603557-d7b1-5df4-9ddf-63733eca1de0 with identifier 202601239375785
2026-03-26 14:34:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:12 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item f9603557-d7b1-5df4-9ddf-63733eca1de0
2026-03-26 14:34:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/8a2161bbc0054a368bc003605843145e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 373,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'Fantastic Mercedes G63 AMG, finished in a satin grey wrap, '
                'black exclusive leather interior, carbon fibre steering '
                'wheel, carbon fibre interior trim, heated and cooled massage '
                'seats, 22" forged satin black alloys, sunroof, 360 degree '
                'parking cameras and sensors, adaptive cruise control, blind '
                'spot assist, privacy glass, switchable AMG exhaust, gloss red '
                'AMG calipers, bluetooth connectivity, satellite navigation '
                'and more',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '4L',
 'engine_horse_power': 577,
 'fuel_type': 'Petrol',
 'id': 'f9603557-d7b1-5df4-9ddf-63733eca1de0',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601239375785',
 'listing': 'directbuy',
 'location': 'Leeds, Yorkshire',
 'make': 'Mercedes-Benz',
 'model': 'G Class',
 'odometer': 44850,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 57,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9603557-d7b1-5df4-9ddf-63733eca1de0/f9603557-d7b1-5df4-9ddf-63733eca1de0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275319,
             'Height': 853,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/8a2161bbc0054a368bc003605843145e.jpg',
             'Width': 1280}],
 'price': 133990,
 'price_includes_vat': True,
 'registration_date': '2022-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz G Class 4.0 G63 V8 BiTurbo AMG SUV 5dr Petrol '
          'SpdS+9GT 4MATIC Euro 6 (s/s) (585 ps)',
 'transmission': 'automatic',
 'trim': 'AMG',
 'year': 2022}
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601239375785%27 HTTP/1.1" 200 None
2026-03-26 14:34:12 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601239375785: {'created_time': 1774535652.826581, 'last_price_update_time': 1774535652.826595}
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601239375785') HTTP/1.1" 204 0
2026-03-26 14:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf915b0610>
2026-03-26 14:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d8e6598-fe32-5c3d-b012-8af0fddad6f1/3d8e6598-fe32-5c3d-b012-8af0fddad6f1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff4abbf66ca6e48b89e1847a9e2dd96cb.jpg') HTTP/1.1" 204 0
2026-03-26 14:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f4abbf66ca6e48b89e1847a9e2dd96cb.jpg saved to cache
2026-03-26 14:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3d8e6598-fe32-5c3d-b012-8af0fddad6f1
2026-03-26 14:34:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3d8e6598-fe32-5c3d-b012-8af0fddad6f1 sending to next pipeline
2026-03-26 14:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9151e610>
2026-03-26 14:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd396599-e0c8-5b89-8008-a576fcb9e04f/cd396599-e0c8-5b89-8008-a576fcb9e04f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6bafd8ffb6e84608b49d6525c924743e.jpg') HTTP/1.1" 204 0
2026-03-26 14:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6bafd8ffb6e84608b49d6525c924743e.jpg saved to cache
2026-03-26 14:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cd396599-e0c8-5b89-8008-a576fcb9e04f
2026-03-26 14:34:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cd396599-e0c8-5b89-8008-a576fcb9e04f sending to next pipeline
2026-03-26 14:34:13 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 3d8e6598-fe32-5c3d-b012-8af0fddad6f1 with identifier 202602049673548
2026-03-26 14:34:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:13 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 3d8e6598-fe32-5c3d-b012-8af0fddad6f1
2026-03-26 14:34:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/f4abbf66ca6e48b89e1847a9e2dd96cb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 219,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'Just arrived into stock, stunning Mercedes-Benz AMG GT S, '
                'finished in black metallic paint, red and black contrast '
                'interior, featuring panoramic glass roof, heated electric '
                'adjustable seats, reversing camera, front and rear parking '
                'sensors, cruise control, switchable AMG exhaust system, '
                'bluetooth connectivity, satellite navigation and more',
 'doors_number': 2,
 'emission_standard': 'Euro 6',
 'engine': '4L',
 'engine_horse_power': 503,
 'fuel_type': 'Petrol',
 'id': '3d8e6598-fe32-5c3d-b012-8af0fddad6f1',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602049673548',
 'listing': 'directbuy',
 'location': 'Leeds, Yorkshire',
 'make': 'Mercedes-Benz',
 'model': 'AMG GT',
 'odometer': 53356,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 40,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d8e6598-fe32-5c3d-b012-8af0fddad6f1/3d8e6598-fe32-5c3d-b012-8af0fddad6f1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274428,
             'Height': 853,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/f4abbf66ca6e48b89e1847a9e2dd96cb.jpg',
             'Width': 1280}],
 'price': 49990,
 'price_includes_vat': True,
 'registration_date': '2015-04-27',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mercedes-Benz Amg Gt 4.0 V8 BiTurbo S Coupe 2dr Petrol SpdS DCT '
          'Euro 6 (s/s) (510 ps)',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2015}
2026-03-26 14:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602049673548%27 HTTP/1.1" 200 None
2026-03-26 14:34:13 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602049673548: {'created_time': 1774535653.069895, 'last_price_update_time': 1774535653.069907}
2026-03-26 14:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602049673548') HTTP/1.1" 204 0
2026-03-26 14:34:13 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: cd396599-e0c8-5b89-8008-a576fcb9e04f with identifier 202601219320580
2026-03-26 14:34:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:13 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item cd396599-e0c8-5b89-8008-a576fcb9e04f
2026-03-26 14:34:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/6bafd8ffb6e84608b49d6525c924743e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'Mercedes-Benz EQV 300e Sport just arrived into stock, '
                'finished in silver metallic paint with black leather '
                'interior, 2 front + 5 rear seats, rear 3 seat bench and two '
                'armchairs, please call for more information',
 'doors_number': 5,
 'engine_horse_power': 201,
 'fuel_type': 'Electric',
 'id': 'cd396599-e0c8-5b89-8008-a576fcb9e04f',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601219320580',
 'listing': 'directbuy',
 'location': 'Leeds, Yorkshire',
 'make': 'Mercedes-Benz',
 'model': 'EQV',
 'odometer': 32950,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 59,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd396599-e0c8-5b89-8008-a576fcb9e04f/cd396599-e0c8-5b89-8008-a576fcb9e04f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275517,
             'Height': 853,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/6bafd8ffb6e84608b49d6525c924743e.jpg',
             'Width': 1280}],
 'price': 37990,
 'price_includes_vat': True,
 'registration_date': '2022-03-25',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Mercedes-Benz EQV 300e 90kWh Sport MPV 5dr Electric Auto (204 ps)',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2022}
2026-03-26 14:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601219320580%27 HTTP/1.1" 200 None
2026-03-26 14:34:13 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601219320580: {'created_time': 1774535653.120921, 'last_price_update_time': 1774535653.120931}
2026-03-26 14:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601219320580') HTTP/1.1" 204 0
2026-03-26 14:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/6c404406db2e440e87c7f9957e388c7a.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/5056febf55d4440f980e8b766b0b46bb.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:34:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:34:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf91990250>
2026-03-26 14:34:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:34:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e90b649d-b003-541a-94bf-00d9aad38f87/e90b649d-b003-541a-94bf-00d9aad38f87_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6c404406db2e440e87c7f9957e388c7a.jpg') HTTP/1.1" 204 0
2026-03-26 14:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6c404406db2e440e87c7f9957e388c7a.jpg saved to cache
2026-03-26 14:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e90b649d-b003-541a-94bf-00d9aad38f87
2026-03-26 14:34:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e90b649d-b003-541a-94bf-00d9aad38f87 sending to next pipeline
2026-03-26 14:34:13 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e90b649d-b003-541a-94bf-00d9aad38f87 with identifier 202602270257091
2026-03-26 14:34:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:13 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e90b649d-b003-541a-94bf-00d9aad38f87
2026-03-26 14:34:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/6c404406db2e440e87c7f9957e388c7a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 196,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'Stunning Range Rover D300 SE, finished in black metallic '
                'paint with black leather interior, specification includes '
                'panoramic sliding glass roof, exterior shadow pack, heated '
                'leather steering wheel, heated front seats, 360 camera and '
                'parking sensors, adaptive cruise control, blind spot assist, '
                'bluetooth connectivity, Apple Carplay, satellite navigation '
                'and more',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 296,
 'fuel_type': 'Diesel',
 'id': 'e90b649d-b003-541a-94bf-00d9aad38f87',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602270257091',
 'listing': 'directbuy',
 'location': 'Leeds, Yorkshire',
 'make': 'Land Rover',
 'model': 'Range Rover',
 'odometer': 5000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 48,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e90b649d-b003-541a-94bf-00d9aad38f87/e90b649d-b003-541a-94bf-00d9aad38f87_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267573,
             'Height': 853,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/6c404406db2e440e87c7f9957e388c7a.jpg',
             'Width': 1280}],
 'price': 95990,
 'price_includes_vat': True,
 'registration_date': '2025-09-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover 3.0 D300 MHEV SE SUV 5dr Diesel Auto 4WD '
          'Euro 6 (s/s) (300 ps)',
 'transmission': 'automatic',
 'trim': 'SE',
 'year': 2025}
2026-03-26 14:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602270257091%27 HTTP/1.1" 200 None
2026-03-26 14:34:13 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602270257091: {'created_time': 1774535653.36054, 'last_price_update_time': 1774535653.36055}
2026-03-26 14:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602270257091') HTTP/1.1" 204 0
2026-03-26 14:34:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:34:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8b73f550>
2026-03-26 14:34:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:34:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e61c1931-5a01-559c-9451-637c2eff0ed9/e61c1931-5a01-559c-9451-637c2eff0ed9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5056febf55d4440f980e8b766b0b46bb.jpg') HTTP/1.1" 204 0
2026-03-26 14:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5056febf55d4440f980e8b766b0b46bb.jpg saved to cache
2026-03-26 14:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e61c1931-5a01-559c-9451-637c2eff0ed9
2026-03-26 14:34:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e61c1931-5a01-559c-9451-637c2eff0ed9 sending to next pipeline
2026-03-26 14:34:13 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e61c1931-5a01-559c-9451-637c2eff0ed9 with identifier 202602179999859
2026-03-26 14:34:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:13 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e61c1931-5a01-559c-9451-637c2eff0ed9
2026-03-26 14:34:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/5056febf55d4440f980e8b766b0b46bb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 369,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'Stunning Magno Edition G63 just arrived into stock, black '
                'magno paint with black and white exclusive leather interior. '
                'Featuring heated carbon fibre and microfibre AMG steering '
                'wheel, carbon fibre interior trim, heated and cooled massage '
                'seats, 22" forged satin black alloys, sunroof, 360 degree '
                'parking cameras and sensors, adaptive cruise control, blind '
                'spot assist, privacy glass, switchable AMG exhaust, gloss red '
                'AMG calipers, bluetooth connectivity, satellite navigation '
                'and more',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '4L',
 'engine_horse_power': 577,
 'fuel_type': 'Petrol',
 'id': 'e61c1931-5a01-559c-9451-637c2eff0ed9',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602179999859',
 'listing': 'directbuy',
 'location': 'Leeds, Yorkshire',
 'make': 'Mercedes-Benz',
 'model': 'G Class',
 'odometer': 25500,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 57,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e61c1931-5a01-559c-9451-637c2eff0ed9/e61c1931-5a01-559c-9451-637c2eff0ed9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279305,
             'Height': 853,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/5056febf55d4440f980e8b766b0b46bb.jpg',
             'Width': 1280}],
 'price': 171990,
 'price_includes_vat': True,
 'registration_date': '2024-06-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz G Class 4.0 G63 V8 BiTurbo AMG Magno Edition SUV 5dr '
          'Petrol SpdS+9GT 4MATIC Euro 6 (s/s) (585 ps)',
 'transmission': 'automatic',
 'trim': 'AMG Magno Edition',
 'year': 2024}
2026-03-26 14:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602179999859%27 HTTP/1.1" 200 None
2026-03-26 14:34:13 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602179999859: {'created_time': 1774535653.580926, 'last_price_update_time': 1774535653.580933}
2026-03-26 14:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602179999859') HTTP/1.1" 204 0
2026-03-26 14:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 14:34:15 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-26 14:34:15 [auto_selling_autotrader.co.uk] INFO: Page: 2/2, total results: 27
2026-03-26 14:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601089009677%27 HTTP/1.1" 200 None
2026-03-26 14:34:15 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601089009677: 1
2026-03-26 14:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512178670320%27 HTTP/1.1" 200 None
2026-03-26 14:34:15 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512178670320: 1
2026-03-26 14:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512058406178%27 HTTP/1.1" 200 None
2026-03-26 14:34:15 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512058406178: 1
2026-03-26 14:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511047650195%27 HTTP/1.1" 200 None
2026-03-26 14:34:15 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511047650195: 1
2026-03-26 14:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510317553686%27 HTTP/1.1" 200 None
2026-03-26 14:34:15 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202510317553686: 1
2026-03-26 14:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202503200375677%27 HTTP/1.1" 200 None
2026-03-26 14:34:15 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202503200375677: 1
2026-03-26 14:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202412207444621%27 HTTP/1.1" 200 None
2026-03-26 14:34:15 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202412207444621: 1
2026-03-26 14:34:15 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 7 detail requests (batch 1)
2026-03-26 14:34:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 14:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 14:34:24 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:34:24 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 49c56354-287f-5f92-9b98-ccef83175386 with identifier: 202601089009677
2026-03-26 14:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 49c56354-287f-5f92-9b98-ccef83175386
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F200b9bc284b74824a936adb7b9910ab5.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/200b9bc284b74824a936adb7b9910ab5.jpg not downloaded yet
2026-03-26 14:34:24 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:34:24 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b2ec5418-4048-57b9-b5b7-f830b90c3766 with identifier: 202512178670320
2026-03-26 14:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b2ec5418-4048-57b9-b5b7-f830b90c3766
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F960e838338434986889eb05a96a31220.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/960e838338434986889eb05a96a31220.jpg not downloaded yet
2026-03-26 14:34:24 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:34:24 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d627fe1-9f14-5460-a7d4-45406ecea3d3 with identifier: 202512058406178
2026-03-26 14:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9d627fe1-9f14-5460-a7d4-45406ecea3d3
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F336e4329890c468082c0c511a0e01ac5.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/336e4329890c468082c0c511a0e01ac5.jpg not downloaded yet
2026-03-26 14:34:24 [common.utils.decorators] ERROR: DefaultOnExceptionError in _extract_engine_horse_power: Unknown power unit: None
Traceback (most recent call last):
  File "/usr/src/app/common/utils/decorators.py", line 16, in wrapper
    return func(self, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/autotrader_details_extractor.py", line 337, in _extract_engine_horse_power
    raise ValueError("Unknown power unit: %s" % unit)
ValueError: Unknown power unit: None
2026-03-26 14:34:24 [common.utils.decorators] ERROR: Payload: {"id": "202511047650195", "stockItemId": "8a42c3e29a34d100019a4f9776c61bcc", "isAuction": false, "hoursUsed": null, "serviceHistory": null, "title": "Lamborghini Urus V8 4.0 Estate Automatic Petrol 0dr", "excludePreviousOwners": false, "advertisedLocations": ["at_cars", "at_profile", "at_profile_cars", "at_stock_cars", "retailer_websites", "trade_advertiser_stock", "uvl"], "dueAtSeller": null, "motExpiry": "2026-01-06T00:00:00Z", "motInsurance": null, "lastServiceOdometerReadingMiles": null, "lastServiceDate": null, "warrantyMonthsOnPurchase": null, "twelveMonthsMotIncluded": false, "preReg": false, "heading": {"title": "Lamborghini Urus", "subtitle": "V8 4.0 Estate Automatic Petrol", "__typename": "Heading"}, "attentionGrabber": "AKRAPOVIC|LAMBO WARRANTY", "rrp": null, "price": 174990, "priceGBX": 17499000, "priceExcludingFees": 174990, "priceExcludingFeesGBX": 17499000, "suppliedPrice": 174990, "suppliedPriceGBX": 17499000, "priceOnApplication": false, "plusVatIndicated": false, "vatStatus": "NO_VAT", "saving": null, "noAdminFees": true, "adminFee": null, "adminFeeInfoDescription": null, "dateOfRegistration": "2022-03-01", "homeDeliveryRegionCodes": ["AB", "AL", "B", "BA", "BB", "BD", "BH", "BL", "BN", "BR", "BS", "BT", "CA", "CB", "CF", "CH", "CM", "CO", "CR", "CT", "CV", "CW", "DA", "DD", "DE", "DG", "DH", "DL", "DN", "DT", "DY", "E", "EC", "EH", "EN", "EX", "FK", "FY", "G", "GL", "GU", "GY", "HA", "HD", "HG", "HP", "HR", "HS", "HU", "HX", "IG", "IM", "IP", "ISLANDS", "IV", "JE", "KA", "KT", "KW", "KY", "L", "LA", "LD", "LE", "LL", "LN", "LS", "LU", "M", "ME", "MK", "ML", "N", "NE", "NG", "NN", "NP", "NR", "NW", "OL", "OX", "PA", "PE", "PH", "PL", "PO", "PR", "RG", "RH", "RM", "S", "SA", "SCILLY_ISLES", "SE", "SG", "SK", "SL", "SM", "SN", "SO", "SP", "SR", "SS", "ST", "SW", "SY", "TA", "TD", "TF", "TN", "TQ", "TR", "TS", "TW", "UB", "W", "WA", "WC", "WD", "WF", "WN", "WR", "WS", "WV", "YO", "ZE"], "priceExcludingVat": 174990, "vatToBePaidUpfront": 0, "capabilities": {"marketExtensionHomeDelivery": null, "marketExtensionClickAndCollect": null, "marketExtensionCentrallyHeld": null, "marketExtensionOem": null, "digitalRetailing": {"enabled": false, "__typename": "DigitalRetailingCapability"}, "__typename": "Capabilities"}, "registration": "L****MO", "generation": {"generationId": "", "name": "coming soon", "review": {"expertReviewSummary": null, "__typename": "GenerationReviewData"}, "__typename": "Generation"}, "hasShowroomProductCode": false, "isPartExAvailable": true, "isFinanceAvailable": true, "isFinanceFullApplicationAvailable": false, "financeProvider": "DEALER", "financeDefaults": {"term": "48", "mileage": "10000", "depositAmount": "17499", "__typename": "FinanceDefaults"}, "hasFinanceInformation": true, "retailerId": "10021908", "privateAdvertiser": null, "advertiserSegment": "Independent", "dealer": {"dealerId": "10021908", "description": "", "distance": null, "stockLevels": {"atStockCounts": {"car": 27, "van": 4, "__typename": "AtStockCounts"}, "__typename": "DealerStockLevels"}, "assignedNumber": {"number": "+447451283796", "__typename": "AssignedNumber"}, "atAwards": [{"year": "2020", "category": "HIGHLY_RATED", "__typename": "ATAward"}, {"year": "2023", "category": "HIGHLY_RATED", "__typename": "ATAward"}], "branding": {"accreditations": [], "brands": [{"name": "RAC Warranties", "imageUrl": "https://m.atcdn.co.uk/service-partner-logo/racWarranties.jpg", "__typename": "Brand"}, {"name": "Warranty Wise warranty", "imageUrl": "https://m.atcdn.co.uk/service-partner-logo/warrantyWise.jpg", "__typename": "Brand"}, {"name": "Close Brothers Motor Finance", "imageUrl": "https://m.atcdn.co.uk/service-partner-logo/closeMotors.jpg", "__typename": "Brand"}], "__typename": "DealerBranding"}, "capabilities": {"instantMessagingChat": {"enabled": true, "provider": "VisitorChat", "__typename": "InstantMessagingChatCapability"}, "instantMessagingText": {"enabled": true, "provider": "VisitorChat", "overrideSmsNumber": "+447451283796", "__typename": "InstantMessagingTextCapability"}, "__typename": "Capabilities"}, "reviews": {"overallReviewRating": "4.6", "__typename": "Reviews"}, "location": {"addressOne": "F12 Performance", "addressTwo": "APEX WAY", "town": "Leeds", "county": "Yorkshire", "postcode": "LS11 5LN", "latLong": "53.786173,-1.544368", "__typename": "Location"}, "marketing": {"profile": null, "strapline": null, "__typename": "Marketing"}, "media": {"email": "yes", "dealerWebsite": {"href": "https://www.f12performance.co.uk/", "__typename": "Link"}, "phoneNumber1": "(0113) 427 7906", "phoneNumber2": "(07537) 164661", "protectedNumber": false, "__typename": "DealerMedia"}, "name": "F12 Performance", "servicesOffered": {"sellerPromise": null, "services": null, "products": ["APXV", "AT18FINANCECUST", "AT18SELLCUST", "ATCRTLCHK", "ATCVVAL", "ATMOVES", "CHATVISITOR", "CODRIVER", "DFIN", "DVID", "FCS", "FPBARGAIN", "FPBONUS", "FPS", "ISP4VC", "ISSCUST", "ISS_PRODCAT", "PPI_4_ENHANCED", "PROFILE", "RTLCHKPLUS", "STEX", "STOCKMANAGER", "VCHECKS", "VEHICLELOOKUP", "WATC", "WAV", "WDEW", "WDPS", "WDSV", "WIMT", "WKSP", "WLGE", "WMOS", "WMPS", "WSL"], "safeSelling": null, "videoWalkAround": {"bulletPoints": ["View the vehicle from your home", "Arrange a time to suit you", "Ask our experts any questions"], "paragraphs": ["F1 Performance has an outstanding 5 Star service, therefore we will always go the extra mile for our customers to keep them comfortable and satisfied in their transaction."], "__typename": "ServiceOffered"}, "nccApproved": false, "isHomeDeliveryProductEnabled": false, "isPartExAvailable": true, "hasSafeSelling": false, "hasHomeDelivery": true, "hasVideoWalkAround": true, "__typename": "ServicesOffered"}, "__typename": "Dealer"}, "video": null, "spin": null, "imageList": {"nextCursor": null, "size": 61, "images": [{"url": "https://m.atcdn.co.uk/a/media/{resize}/f61d2ce9bd6448958e829bb9c18470cf.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/b4de7a16789c4461afd1e6614e807415.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/96812e184ce842ecbac0b0527cc3f27f.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/79112063e8524bd1ace43db04a4cd102.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/67a6e276404f4290a77f456cb5a7cc18.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/4b88f5a71cb54e70ad91d1bd6e4c8789.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Side Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/69b543bb17ef40edac0ac5ca2b2403e7.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/fc360b6c547545ef84f3bd8de5eef472.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/e66f410d2df54f708a81c0498cb21648.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/bf4a25e3ca274f9e81f79c5339940f74.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Side Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/cce3b165992b4a788106779d597eb5bd.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/8c0caf41165b43ccad14c6cbb757ba43.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f2a7b61e4698408abe65bda62f604846.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Driver", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/8695cea20fe04895bff020f41e2aa898.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/b4de7a16789c4461afd1e6614e807415.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/153fa5b9986c4271bd8033abd4067632.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/96812e184ce842ecbac0b0527cc3f27f.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/8fd7363a1969408cb28978d958e6378b.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Steering Wheel", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d97949883e034572a768614105e892cf.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Steering Wheel", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/5de11dfea7a44e68aed0d46f6c9edad2.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/31998c8dbc064bc4af3e18d79e39502d.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Front Passenger", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/e8af8dfa3b6143a9adb5c84526a5bbd1.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/2a162af45dbf4871966243440b345f1b.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Roof", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/96066837bf644780a92e081ded2c128e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Lights Front", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/7d788bcdec5c42929b98b1e8a53dacde.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Lights Front", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/966890bb1f1d45e1be3acae107b9f485.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/1049e75b6b0149ccba04513265ecc570.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Wheel", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/22fca3fe1ad64b3889490aa80563b563.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Wheel", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/b4bbe81706c344fcb25371db76c0d643.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/a1e7e0b4a29e4f78a2447ff2f4ecd04b.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/5049c24ec92c4ada9bd6616d84a4b83e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/19fb3c5526604cb6a4a9a5a38f3689e7.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Door Handle Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/79112063e8524bd1ace43db04a4cd102.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/0c05d98540bc400b874ef8a2698e2099.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/a7212c66347a43cfbd272d825e3733ac.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Wing Mirror", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/4dbaf8e7a2844cd595e0f905dda9d767.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Lights Rear", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/54b3fb6adf1a4088ae4583807e250cb4.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/12dc3807f06e43d1a2105291e3ab3d54.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Driver", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/7659275c1bfb4fd2921863b9f58c972d.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/aca7e05c6dce47e3b9cebf6a73345ae9.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Front Passenger", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/5e44f075b5fe43b1b055bc229b08d0bd.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/9209fa9cff5e4b4da63100a2f437410e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/debf3c5aa8fe45ffa2846d3d30bec28d.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/63692505de754a30a024360c0f75348c.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f7a7b1b59753416fb81ff64ec5331e5a.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/dfc7549f842a4f07ab730e749bd7c7a3.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Misc Controls", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/fe8bbd06a97842d59ba80f65912452db.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/5fff332f1d2441f0a0b7defe210dd655.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Misc Controls", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/e443a5824c864524956f748f7cc6928b.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/21735265c1524a2888be002d6d0ecc61.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/c738a31d288e469a8277b9088e0cfa36.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Promotional Material", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/70100f53dd794134b922fe26aa8ffbcd.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/b1e4b49a2df64edea9d93d904af7417e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Promotional Material", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/fa37583e097c4f32927e1f59f3f62988.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/dd59e43cac0e45f9a94760415d9b176c.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/1a42f1405aa44a589b8ac7a7af418dda.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/67a6e276404f4290a77f456cb5a7cc18.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/4b88f5a71cb54e70ad91d1bd6e4c8789.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Side Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/69b543bb17ef40edac0ac5ca2b2403e7.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/fc360b6c547545ef84f3bd8de5eef472.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/8c0caf41165b43ccad14c6cbb757ba43.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}], "__typename": "ImageList"}, "priceIndicatorRating": "NOANALYSIS", "priceIndicatorRatingLabel": "", "priceDeviation": null, "mileageDeviation": null, "mileage": {"mileage": 24600, "unit": "MILE", "__typename": "Mileage"}, "plate": "22", "year": 2022, "vehicleCheckId": "a8dc5cc574464dafb5dcf10ca2b33393", "vehicleCheckStatus": "PASSED", "vehicleCheckSummary": {"type": "FULL", "title": "Passed with advisory", "performed": "2026-01-11", "writeOffCategory": null, "checks": [{"key": "STOLEN", "failed": false, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "SCRAPPED", "failed": false, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "WRITE_OFF_CATEGORY", "failed": false, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "IMPORTED", "failed": false, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "EXPORTED", "failed": false, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "HIGH_RISK", "failed": false, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "MILEAGE_DISCREPANCY", "failed": false, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "COLOUR_CHANGED", "failed": false, "advisory": false, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "PRIVATE_FINANCE", "failed": true, "advisory": true, "critical": true, "warning": false, "__typename": "VehicleCheck"}, {"key": "TRADE_FINANCE", "failed": false, "advisory": false, "critical": false, "warning": false, "__typename": "VehicleCheck"}, {"key": "REGISTRATION_CHANGED", "failed": true, "advisory": false, "critical": true, "warning": true, "__typename": "VehicleCheck"}], "__typename": "VehicleCheckSummary"}, "sellerName": "F12 Performance", "sellerType": "Trade", "sellerProducts": ["APXV", "AT18FINANCECUST", "AT18SELLCUST", "ATCRTLCHK", "ATCVVAL", "ATMOVES", "CHATVISITOR", "CODRIVER", "DFIN", "DVID", "FCS", "FPBARGAIN", "FPBONUS", "FPS", "ISP4VC", "ISSCUST", "ISS_PRODCAT", "PPI_4_ENHANCED", "PROFILE", "RTLCHKPLUS", "STEX", "STOCKMANAGER", "VCHECKS", "VEHICLELOOKUP", "WATC", "WAV", "WDEW", "WDPS", "WDSV", "WIMT", "WKSP", "WLGE", "WMOS", "WMPS", "WSL"], "sellerLocation": "LEEDS", "sellerLocationDistance": null, "sellerContact": {"phoneNumberOne": "(0113) 427 7906", "phoneNumberTwo": "(07537) 164661", "protectedNumber": null, "byEmail": true, "__typename": "SellerContact"}, "description": "Stunning Lamborghini Urus, with extended Lamborghini warranty until March 2026, recently fitted brand new set of tyres, finished in black metallic paint, black leather interior with orange contrast stitching, featuring Akrapovic exhaust system, gloss black exterior pack including rear diffuser and door trims, panoramic glass sliding roof, head up display, heated steering wheel, carbon fibre wrapped wingmirrors, adaptive cruise control, 360 surround parking camera and sensors, bluetooth connectivity, satellite navigation and more", "colour": "Black", "manufacturerApproved": false, "insuranceWriteOffCategory": null, "owners": null, "keys": null, "vehicleCondition": null, "specification": {"driverPosition": "Right Hand Drive", "isCrossover": false, "operatingType": null, "emissionClass": "Euro 6", "co2Emissions": {"co2Emission": 325, "unit": "g/km", "__typename": "Co2Emissions"}, "topSpeed": {"topSpeed": null, "__typename": "Speed"}, "minimumKerbWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "endLayout": null, "trailerAxleNumber": null, "bedroomLayout": null, "grossVehicleWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "capacityWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "liftingCapacity": {"weight": null, "unit": null, "__typename": "LiftingCapacity"}, "operatingWidth": {"width": null, "unit": null, "__typename": "OperatingWidth"}, "maxReach": {"length": null, "unit": null, "__typename": "MaxReach"}, "wheelbase": null, "berth": null, "bedrooms": null, "engine": {"power": {"enginePower": null, "unit": null, "__typename": "Power"}, "sizeLitres": 4, "sizeCC": 3996, "manufacturerEngineSize": 4, "__typename": "Engine"}, "exteriorWidth": {"width": null, "unit": null, "__typename": "ExteriorWidth"}, "exteriorLength": {"length": null, "unit": null, "__typename": "ExteriorLength"}, "exteriorHeight": {"height": null, "unit": null, "__typename": "ExteriorHeight"}, "capacityWidth": {"width": null, "unit": null, "__typename": "CapacityWidth"}, "capacityLength": {"length": null, "unit": null, "__typename": "CapacityLength"}, "capacityHeight": {"height": null, "unit": null, "__typename": "CapacityHeight"}, "seats": 5, "axleConfig": null, "ulezCompliant": true, "doors": 0, "bodyType": "SUV", "cabType": "Unlisted", "rawBodyType": "SUV", "fuel": "Petrol", "transmission": "Automatic", "style": null, "subStyle": null, "make": "Lamborghini", "model": "Urus", "trim": null, "optionalFeatures": null, "standardFeatures": null, "features": [], "battery": null, "techData": null, "annualTax": {"standardRate": 195, "__typename": "AnnualTax"}, "oemDrivetrain": null, "bikeLicenceType": null, "derivativeId": null, "frameSizeCM": null, "frameMaterial": null, "frameStyle": null, "suspensionType": null, "gearShifter": null, "brakeType": null, "motorMake": null, "chargeTimeMinutes": null, "numberOfGears": null, "tyreDiameterInches": null, "driveTrain": "Four Wheel Drive", "torque": null, "range": null, "interiorDescription": null, "exteriorDescription": "Black exterior colour", "__typename": "Specification"}, "stockType": "physical-stock", "condition": "Used", "finance": null, "locationArea": null, "reservation": {"status": null, "eligibility": "NOT_ELIGIBLE", "feeCurrency": "GBP", "feeInFractionalUnits": 0, "__typename": "AdvertReservation"}, "__typename": "Advert"}
2026-03-26 14:34:24 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:34:24 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 02b96390-b87f-5350-aa03-9f08ec3a0808 with identifier: 202511047650195
2026-03-26 14:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 02b96390-b87f-5350-aa03-9f08ec3a0808
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff61d2ce9bd6448958e829bb9c18470cf.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f61d2ce9bd6448958e829bb9c18470cf.jpg not downloaded yet
2026-03-26 14:34:24 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:34:24 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: bfeaa460-2806-58e6-8104-5ecb778f7526 with identifier: 202510317553686
2026-03-26 14:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bfeaa460-2806-58e6-8104-5ecb778f7526
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4054abad3e204b8798a9321087649b10.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4054abad3e204b8798a9321087649b10.jpg not downloaded yet
2026-03-26 14:34:24 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:34:24 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ce9f113-466e-5364-b27f-64a7bc91bf1d with identifier: 202503200375677
2026-03-26 14:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6ce9f113-466e-5364-b27f-64a7bc91bf1d
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7b5806f50ce9413c9fe4edeaf69c49ec.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7b5806f50ce9413c9fe4edeaf69c49ec.jpg not downloaded yet
2026-03-26 14:34:24 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:34:24 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c0edf088-fedc-5514-a9af-e412596d5880 with identifier: 202412207444621
2026-03-26 14:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c0edf088-fedc-5514-a9af-e412596d5880
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F141cd196dabe4951abdfe310237c8483.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/141cd196dabe4951abdfe310237c8483.jpg not downloaded yet
2026-03-26 14:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/960e838338434986889eb05a96a31220.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/336e4329890c468082c0c511a0e01ac5.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/141cd196dabe4951abdfe310237c8483.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/4054abad3e204b8798a9321087649b10.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf915b14d0>
2026-03-26 14:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2ec5418-4048-57b9-b5b7-f830b90c3766/b2ec5418-4048-57b9-b5b7-f830b90c3766_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F960e838338434986889eb05a96a31220.jpg') HTTP/1.1" 204 0
2026-03-26 14:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/960e838338434986889eb05a96a31220.jpg saved to cache
2026-03-26 14:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2ec5418-4048-57b9-b5b7-f830b90c3766
2026-03-26 14:34:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b2ec5418-4048-57b9-b5b7-f830b90c3766 sending to next pipeline
2026-03-26 14:34:24 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b2ec5418-4048-57b9-b5b7-f830b90c3766 with identifier 202512178670320
2026-03-26 14:34:24 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:24 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:24 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b2ec5418-4048-57b9-b5b7-f830b90c3766
2026-03-26 14:34:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/960e838338434986889eb05a96a31220.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 51,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'Stunning Lamborghini Urus SE just arrived into stock, '
                'finished in black metallic paint with black leather interior, '
                'featuring panoramic glass sliding roof, head up display, B&O '
                'surround sound system, 23" gloss black alloys, shiny black '
                'exterior pack, ANIMA with off road modes, heated and cooled '
                'massage seats, surround camera and parking sensors, privacy '
                'glass, bluetooth connectivity, satellite navigation and more',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '4L',
 'engine_horse_power': 789,
 'fuel_type': 'Petrol Plug-in Hybrid',
 'id': 'b2ec5418-4048-57b9-b5b7-f830b90c3766',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512178670320',
 'listing': 'directbuy',
 'location': 'Leeds, Yorkshire',
 'make': 'Lamborghini',
 'model': 'Urus',
 'odometer': 6828,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2ec5418-4048-57b9-b5b7-f830b90c3766/b2ec5418-4048-57b9-b5b7-f830b90c3766_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278776,
             'Height': 853,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/960e838338434986889eb05a96a31220.jpg',
             'Width': 1280}],
 'price': 252990,
 'price_includes_vat': True,
 'registration_date': '2025-09-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Lamborghini Urus 4.0 V8 BiTurbo 25.9kWh SE SUV 5dr Petrol Plug-in '
          'Hybrid Auto 4WD Euro 6 (800 ps)',
 'transmission': 'automatic',
 'trim': 'SE',
 'year': 2025}
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512178670320%27 HTTP/1.1" 200 None
2026-03-26 14:34:24 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512178670320: {'created_time': 1774535664.569254, 'last_price_update_time': 1774535664.569262}
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512178670320') HTTP/1.1" 204 0
2026-03-26 14:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/f61d2ce9bd6448958e829bb9c18470cf.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/200b9bc284b74824a936adb7b9910ab5.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf915b0c10>
2026-03-26 14:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d627fe1-9f14-5460-a7d4-45406ecea3d3/9d627fe1-9f14-5460-a7d4-45406ecea3d3_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F336e4329890c468082c0c511a0e01ac5.jpg') HTTP/1.1" 204 0
2026-03-26 14:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/336e4329890c468082c0c511a0e01ac5.jpg saved to cache
2026-03-26 14:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d627fe1-9f14-5460-a7d4-45406ecea3d3
2026-03-26 14:34:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d627fe1-9f14-5460-a7d4-45406ecea3d3 sending to next pipeline
2026-03-26 14:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9315afd0>
2026-03-26 14:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0edf088-fedc-5514-a9af-e412596d5880/c0edf088-fedc-5514-a9af-e412596d5880_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F141cd196dabe4951abdfe310237c8483.jpg') HTTP/1.1" 204 0
2026-03-26 14:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/141cd196dabe4951abdfe310237c8483.jpg saved to cache
2026-03-26 14:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c0edf088-fedc-5514-a9af-e412596d5880
2026-03-26 14:34:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c0edf088-fedc-5514-a9af-e412596d5880 sending to next pipeline
2026-03-26 14:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf915b0690>
2026-03-26 14:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfeaa460-2806-58e6-8104-5ecb778f7526/bfeaa460-2806-58e6-8104-5ecb778f7526_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4054abad3e204b8798a9321087649b10.jpg') HTTP/1.1" 204 0
2026-03-26 14:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4054abad3e204b8798a9321087649b10.jpg saved to cache
2026-03-26 14:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bfeaa460-2806-58e6-8104-5ecb778f7526
2026-03-26 14:34:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bfeaa460-2806-58e6-8104-5ecb778f7526 sending to next pipeline
2026-03-26 14:34:24 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 9d627fe1-9f14-5460-a7d4-45406ecea3d3 with identifier 202512058406178
2026-03-26 14:34:24 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:24 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:24 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 9d627fe1-9f14-5460-a7d4-45406ecea3d3
2026-03-26 14:34:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/336e4329890c468082c0c511a0e01ac5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 229,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'Fantastic BMW M3 Competition xDrive, finished in the highly '
                'desireable Brooklyn grey metallic paint, the car presents as '
                'new with less than 500 miles recorded. Specification includes '
                'technology package, head up display, M carbon fibre interior '
                'trim finisher, BMW individual fiona red leather interior, '
                'heated steering wheel, high beam assist, lane assist, blind '
                'spot assist, cruise control, bluetooth connectivity, Apple '
                'Car Play and much more',
 'doors_number': 4,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 523,
 'fuel_type': 'Petrol',
 'id': '9d627fe1-9f14-5460-a7d4-45406ecea3d3',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512058406178',
 'listing': 'directbuy',
 'location': 'Leeds, Yorkshire',
 'make': 'BMW',
 'model': 'M3',
 'odometer': 800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d627fe1-9f14-5460-a7d4-45406ecea3d3/9d627fe1-9f14-5460-a7d4-45406ecea3d3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289944,
             'Height': 853,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/336e4329890c468082c0c511a0e01ac5.jpg',
             'Width': 1280}],
 'price': 75990,
 'price_includes_vat': True,
 'registration_date': '2025-09-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW M3 3.0 BiTurbo Competition Saloon 4dr Petrol Steptronic M '
          'xDrive Euro 6 (s/s) (530 ps)',
 'transmission': 'automatic',
 'trim': 'Competition',
 'year': 2025}
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512058406178%27 HTTP/1.1" 200 None
2026-03-26 14:34:24 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512058406178: {'created_time': 1774535664.83518, 'last_price_update_time': 1774535664.835189}
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512058406178') HTTP/1.1" 204 0
2026-03-26 14:34:24 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c0edf088-fedc-5514-a9af-e412596d5880 with identifier 202412207444621
2026-03-26 14:34:24 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:24 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:24 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c0edf088-fedc-5514-a9af-e412596d5880
2026-03-26 14:34:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/141cd196dabe4951abdfe310237c8483.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 227,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'Brand new Land Rover Defender 110 now available, brand new '
                'VAT qualifying, finished in Santorini black metallic paint, '
                'featuring full Urban style kit including 22" satin black '
                'alloy wheels, wider wheel arches, side storage box, side '
                'ladders, spare wheel cover, front bumper scoops, bonnet '
                'trims, side steps, mud flaps, rear lip spoiler, and front '
                'grill LED light trim. This is ontop of an excellent '
                'specification including air suspension pack, panoramic glass '
                'sliding roof, towing pack, front fog lights, bluetooth '
                'connectivity, satellite navigation, apple car play, and more',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 345,
 'fuel_type': 'Diesel',
 'id': 'c0edf088-fedc-5514-a9af-e412596d5880',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202412207444621',
 'listing': 'directbuy',
 'location': 'Leeds, Yorkshire',
 'make': 'Land Rover',
 'model': 'Defender 110',
 'odometer': 1700,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 57,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0edf088-fedc-5514-a9af-e412596d5880/c0edf088-fedc-5514-a9af-e412596d5880_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316537,
             'Height': 853,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/141cd196dabe4951abdfe310237c8483.jpg',
             'Width': 1280}],
 'price': 79990,
 'price_includes_vat': True,
 'registration_date': '2024-12-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Defender 110 3.0 D350 MHEV X-Dynamic SE SUV 5dr Diesel '
          'Auto 4WD Euro 6 (s/s) (350 ps)',
 'transmission': 'automatic',
 'trim': 'X-Dynamic SE',
 'year': 2024}
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202412207444621%27 HTTP/1.1" 200 None
2026-03-26 14:34:24 [auto_selling_autotrader.co.uk] INFO: Saving data for 202412207444621: {'created_time': 1774535664.884103, 'last_price_update_time': 1774535664.884114}
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202412207444621') HTTP/1.1" 204 0
2026-03-26 14:34:24 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: bfeaa460-2806-58e6-8104-5ecb778f7526 with identifier 202510317553686
2026-03-26 14:34:24 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:24 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:24 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item bfeaa460-2806-58e6-8104-5ecb778f7526
2026-03-26 14:34:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/4054abad3e204b8798a9321087649b10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 51,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'Stunning Lamborghini Urus SE, finished in Nero Helene over '
                'black and red contrast leather interior. Full PPF in ‘Wicked '
                'Thundercloud’ black metallic with blue and purple fleck, '
                'applied by Topaz Detailing. Fantastic specification with a '
                'list price of over £270k, this includes panoramic glass '
                'sliding roof, Bang & Olufsen advanced 3D audio system, 23" '
                'Galanthus alloy wheels with diamond cut finish, full high '
                'gloss black style package, performante trim on leather seats, '
                'ambient light package, sport heated steering wheel with '
                'contrast stitching, gloss red brake calipers, matt black '
                'exhaust tailpipes, Lamborghini ANIMA with off road modes, '
                'black anodised treatment for aluminium inserts, heated front '
                'and rear seats, and much more',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '4L',
 'engine_horse_power': 789,
 'fuel_type': 'Petrol Plug-in Hybrid',
 'id': 'bfeaa460-2806-58e6-8104-5ecb778f7526',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510317553686',
 'listing': 'directbuy',
 'location': 'Leeds, Yorkshire',
 'make': 'Lamborghini',
 'model': 'Urus',
 'odometer': 2400,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfeaa460-2806-58e6-8104-5ecb778f7526/bfeaa460-2806-58e6-8104-5ecb778f7526_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274230,
             'Height': 853,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/4054abad3e204b8798a9321087649b10.jpg',
             'Width': 1280}],
 'price': 247990,
 'price_includes_vat': True,
 'registration_date': '2025-05-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Lamborghini Urus 4.0 V8 BiTurbo 25.9kWh SE SUV 5dr Petrol Plug-in '
          'Hybrid Auto 4WD Euro 6 (800 ps)',
 'transmission': 'automatic',
 'trim': 'SE',
 'year': 2025}
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510317553686%27 HTTP/1.1" 200 None
2026-03-26 14:34:24 [auto_selling_autotrader.co.uk] INFO: Saving data for 202510317553686: {'created_time': 1774535664.936609, 'last_price_update_time': 1774535664.936619}
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510317553686') HTTP/1.1" 204 0
2026-03-26 14:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/7b5806f50ce9413c9fe4edeaf69c49ec.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9197a650>
2026-03-26 14:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02b96390-b87f-5350-aa03-9f08ec3a0808/02b96390-b87f-5350-aa03-9f08ec3a0808_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff61d2ce9bd6448958e829bb9c18470cf.jpg') HTTP/1.1" 204 0
2026-03-26 14:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f61d2ce9bd6448958e829bb9c18470cf.jpg saved to cache
2026-03-26 14:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 02b96390-b87f-5350-aa03-9f08ec3a0808
2026-03-26 14:34:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 02b96390-b87f-5350-aa03-9f08ec3a0808 sending to next pipeline
2026-03-26 14:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8b74ad10>
2026-03-26 14:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49c56354-287f-5f92-9b98-ccef83175386/49c56354-287f-5f92-9b98-ccef83175386_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F200b9bc284b74824a936adb7b9910ab5.jpg') HTTP/1.1" 204 0
2026-03-26 14:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/200b9bc284b74824a936adb7b9910ab5.jpg saved to cache
2026-03-26 14:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 49c56354-287f-5f92-9b98-ccef83175386
2026-03-26 14:34:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 49c56354-287f-5f92-9b98-ccef83175386 sending to next pipeline
2026-03-26 14:34:25 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 02b96390-b87f-5350-aa03-9f08ec3a0808 with identifier 202511047650195
2026-03-26 14:34:25 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:25 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:25 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 02b96390-b87f-5350-aa03-9f08ec3a0808
2026-03-26 14:34:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/f61d2ce9bd6448958e829bb9c18470cf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 325,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'Stunning Lamborghini Urus, with extended Lamborghini warranty '
                'until March 2026, recently fitted brand new set of tyres, '
                'finished in black metallic paint, black leather interior with '
                'orange contrast stitching, featuring Akrapovic exhaust '
                'system, gloss black exterior pack including rear diffuser and '
                'door trims, panoramic glass sliding roof, head up display, '
                'heated steering wheel, carbon fibre wrapped wingmirrors, '
                'adaptive cruise control, 360 surround parking camera and '
                'sensors, bluetooth connectivity, satellite navigation and '
                'more',
 'doors_number': 0,
 'emission_standard': 'Euro 6',
 'engine': '4L',
 'fuel_type': 'Petrol',
 'id': '02b96390-b87f-5350-aa03-9f08ec3a0808',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511047650195',
 'listing': 'directbuy',
 'location': 'Leeds, Yorkshire',
 'make': 'Lamborghini',
 'model': 'Urus',
 'odometer': 24600,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 61,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02b96390-b87f-5350-aa03-9f08ec3a0808/02b96390-b87f-5350-aa03-9f08ec3a0808_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325029,
             'Height': 853,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/f61d2ce9bd6448958e829bb9c18470cf.jpg',
             'Width': 1280}],
 'price': 174990,
 'price_includes_vat': True,
 'registration_date': '2022-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Lamborghini Urus V8 4.0 Estate Automatic Petrol 0dr',
 'transmission': 'automatic',
 'year': 2022}
2026-03-26 14:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511047650195%27 HTTP/1.1" 200 None
2026-03-26 14:34:25 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511047650195: {'created_time': 1774535665.135756, 'last_price_update_time': 1774535665.135764}
2026-03-26 14:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511047650195') HTTP/1.1" 204 0
2026-03-26 14:34:25 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 49c56354-287f-5f92-9b98-ccef83175386 with identifier 202601089009677
2026-03-26 14:34:25 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:25 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:25 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 49c56354-287f-5f92-9b98-ccef83175386
2026-03-26 14:34:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/200b9bc284b74824a936adb7b9910ab5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 222,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'Just arrived into stock, stunning 1 owner Discovery '
                'Commercial, V A T qualifying finished in black paint with '
                'black leather interior, full exterior black pack, electric '
                'folding tow bar, black exterior pack, heated steering wheel, '
                'heated and cooled seats, air suspension, 360 parking camera '
                'and sensors, adaptive cruise control, Meridian surround sound '
                'system, bluetooth connectivity, satellite navigation and more',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 345,
 'fuel_type': 'Diesel',
 'id': '49c56354-287f-5f92-9b98-ccef83175386',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601089009677',
 'listing': 'directbuy',
 'location': 'Leeds, Yorkshire',
 'make': 'Land Rover',
 'model': 'Discovery',
 'odometer': 20500,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 50,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c56354-287f-5f92-9b98-ccef83175386/49c56354-287f-5f92-9b98-ccef83175386_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274029,
             'Height': 853,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/200b9bc284b74824a936adb7b9910ab5.jpg',
             'Width': 1280}],
 'price': 62990,
 'price_includes_vat': True,
 'registration_date': '2024-10-30',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Land Rover Discovery 3.0 D350 MHEV Dynamic HSE SUV 5dr Diesel Auto '
          '4WD Euro 6 (s/s) (350 ps)',
 'transmission': 'automatic',
 'trim': 'Dynamic HSE',
 'year': 2024}
2026-03-26 14:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601089009677%27 HTTP/1.1" 200 None
2026-03-26 14:34:25 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601089009677: {'created_time': 1774535665.200322, 'last_price_update_time': 1774535665.20033}
2026-03-26 14:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601089009677') HTTP/1.1" 204 0
2026-03-26 14:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8b757010>
2026-03-26 14:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ce9f113-466e-5364-b27f-64a7bc91bf1d/6ce9f113-466e-5364-b27f-64a7bc91bf1d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7b5806f50ce9413c9fe4edeaf69c49ec.jpg') HTTP/1.1" 204 0
2026-03-26 14:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7b5806f50ce9413c9fe4edeaf69c49ec.jpg saved to cache
2026-03-26 14:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6ce9f113-466e-5364-b27f-64a7bc91bf1d
2026-03-26 14:34:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6ce9f113-466e-5364-b27f-64a7bc91bf1d sending to next pipeline
2026-03-26 14:34:25 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 6ce9f113-466e-5364-b27f-64a7bc91bf1d with identifier 202503200375677
2026-03-26 14:34:25 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:25 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:25 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 6ce9f113-466e-5364-b27f-64a7bc91bf1d
2026-03-26 14:34:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/7b5806f50ce9413c9fe4edeaf69c49ec.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 237,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'Stunning VAT qualifying Porsche 992.2 Carrera, brand new '
                'delivery miles, finished in Vanadium grey metallic paint over '
                'red and black two tone leather, excellent specification '
                'includes the rare Porsche factory fitted Aerokit option in '
                'high gloss black, panoramic glass sliding sunroof, sports '
                'exhaust system with silver tailpipes, HD matrix LED '
                'headlights, 20" front 21" rear Carrera classic alloy wheels, '
                'sports chrono package, BOSE surround sound system, sports '
                'seats plus with 4 way electrical adjustment, power steering '
                'plus, wheel centres with full colour Porsche crest, Porsche '
                'LED door courtesy lights, windscreen with grey top tint, and '
                'more.',
 'doors_number': 2,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 389,
 'fuel_type': 'Petrol',
 'id': '6ce9f113-466e-5364-b27f-64a7bc91bf1d',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202503200375677',
 'listing': 'directbuy',
 'location': 'Leeds, Yorkshire',
 'make': 'Porsche',
 'model': '911',
 'odometer': 20,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 61,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ce9f113-466e-5364-b27f-64a7bc91bf1d/6ce9f113-466e-5364-b27f-64a7bc91bf1d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306415,
             'Height': 853,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/7b5806f50ce9413c9fe4edeaf69c49ec.jpg',
             'Width': 1280}],
 'price': 100990,
 'price_includes_vat': True,
 'registration_date': '2024-11-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Porsche 911 3.0T 992 Carrera Coupe 2dr Petrol PDK Euro 6 (s/s) (394 '
          'ps)',
 'transmission': 'automatic',
 'trim': '992 Carrera',
 'year': 2024}
2026-03-26 14:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202503200375677%27 HTTP/1.1" 200 None
2026-03-26 14:34:25 [auto_selling_autotrader.co.uk] INFO: Saving data for 202503200375677: {'created_time': 1774535665.368496, 'last_price_update_time': 1774535665.368504}
2026-03-26 14:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202503200375677') HTTP/1.1" 204 0
2026-03-26 14:34:25 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-26 14:34:25 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close cursor: 'SaveToCdlqDbAutoSelling' object has no attribute 'cursor'
2026-03-26 14:34:25 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close connection: 'SaveToCdlqDbAutoSelling' object has no attribute 'conn'
2026-03-26 14:34:25 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:25 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:34:25 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process scrape complete CloudEvent for item d0d822b6292011f18f76c264925fbcfa
2026-03-26 14:34:25 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 14:34:25 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 14:34:25 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 14:34:25 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 14:34:25 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 14:34:25 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.MAPPED: 3> -> <SessionState.END_SENT: 4>
2026-03-26 14:34:25 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPENED: 9> -> <ConnectionState.CLOSE_SENT: 11>
2026-03-26 14:34:25 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.CLOSE_SENT: 11> -> <ConnectionState.END: 13>
2026-03-26 14:34:25 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.END_SENT: 4> -> <SessionState.DISCARDING: 6>
2026-03-26 14:34:25 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 14:34:25 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 14:34:25 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 14:34:25 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 14:34:25 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 14:34:25 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: [AzureBusPipeline] connection closed
2026-03-26 14:34:25 [auto_selling_autotrader.co.uk] INFO: auto_selling_autotrader.co.uk Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 7, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2026-03-26 14:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20last_price_update_time%20lt%201773239666 HTTP/1.1" 200 None
2026-03-26 14:34:26 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (27 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto_selling_autotrader.co.uk/d0d822b6292011f18f76c264925fbcfa.jl
2026-03-26 14:34:26 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/exception_count': 2,
 'downloader/exception_type_count/scrapy.core.downloader.handlers.http11.TunnelError': 2,
 'downloader/request_bytes': 220644,
 'downloader/request_count': 32,
 'downloader/request_method_count/GET': 27,
 'downloader/request_method_count/POST': 5,
 'downloader/response_bytes': 8604016,
 'downloader/response_count': 30,
 'downloader/response_status_count/200': 30,
 'elapsed_time_seconds': 26.619867,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 26, 14, 34, 26, 493697, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 27,
 'log_count/DEBUG': 488,
 'log_count/ERROR': 2,
 'log_count/INFO': 432,
 'memusage/max': 146845696,
 'memusage/startup': 146845696,
 'photo_download_count': 25,
 'request_depth_max': 3,
 'response_received_count': 5,
 'scheduler/dequeued': 32,
 'scheduler/dequeued/memory': 32,
 'scheduler/enqueued': 32,
 'scheduler/enqueued/memory': 32,
 'scrape_type/new': 27,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 5,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 4.226278893370181,
 'scrapy-zyte-api/mean_response_seconds': 4.403694330155849,
 'scrapy-zyte-api/processed': 5,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 5,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 4,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 5,
 'scrapy-zyte-api/request_args/httpRequestBody': 5,
 'scrapy-zyte-api/request_args/httpRequestMethod': 5,
 'scrapy-zyte-api/request_args/httpResponseBody': 5,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 5,
 'scrapy-zyte-api/request_args/url': 5,
 'scrapy-zyte-api/status_codes/200': 5,
 'scrapy-zyte-api/success': 5,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2026, 3, 26, 14, 33, 59, 873830, tzinfo=datetime.timezone.utc)}
2026-03-26 14:34:26 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-26 14:34:26 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fdf94255b10>
2026-03-26 14:34:26 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fdf93158490>