PROJECT (sourcing_v2)
SPIDER (auto_selling_autotrader.co.uk)
2026-03-30 15:15:12 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 15:15:12 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 15:15:12 [auto_selling_autotrader.co.uk] INFO: Starting auto_selling_autotrader.co.uk spider
2026-03-30 15:15:12 [auto_selling_autotrader.co.uk] INFO: Quick mode enabled: batching detail requests in groups of 10
2026-03-30 15:15:12 [auto_selling_autotrader.co.uk] INFO: _job: 4ad108d42c1f11f18e133aacc95538c6, SCRAPY_JOB: None
2026-03-30 15:15:12 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 15:15:12 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 15:15:12 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 15:15:12 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 15:15:12 [scrapy.extensions.telnet] INFO: Telnet Password: 3ec23a1a535c08dc
2026-03-30 15:15:12 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-30 15:15:12 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 3600,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto_selling_autotrader.co.uk/4ad108d42c1f11f18e133aacc95538c6.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-30 15:15:12 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 15:15:12 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 15:15:12 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 15:15:12 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware for auto_selling
2026-03-30 15:15:12 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.auto_selling.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 15:15:12 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.post_to_azurebus_auto_selling.AzureBusPipelineAutoSelling',
'crawlers.pipelines.save_to_cdlq_db_auto_selling.SaveToCdlqDbAutoSelling']
2026-03-30 15:15:12 [scrapy.core.engine] INFO: Spider opened
2026-03-30 15:15:12 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-30 15:15:12 [common.service_bus.service_bus_client_factory] INFO: ServiceBusClient initialized via DefaultAzureCredential for alx-production-bus.servicebus.windows.net
2026-03-30 15:15:12 [crawlers.pipelines.base_azure_bus_pipeline] INFO: [AzureBusPipeline] Connected to topic auto.sourcing-v2
2026-03-30 15:15:12 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 15:15:12 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-30 15:15:12 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-30 15:15:12 [scrapy-playwright] INFO: Starting download handler
2026-03-30 15:15:12 [scrapy-playwright] INFO: Starting download handler
2026-03-30 15:15:17 [auto_selling_autotrader.co.uk] INFO: Scraper started with retailer ID: 10032600 and multipost_profile_id: 3ae8a9fb-e062-486a-b5f3-2955e6569ef4 and job_id: 4ad108d42c1f11f18e133aacc95538c6 and url: https://www.autotrader.co.uk/cars/retailer/stock?advertising-location=at_cars&advertising-location=at_profile_cars&onesearchad=Used&onesearchad=Nearly%20New&onesearchad=New&postcode=OX3%209JY&retailerId=10032600&sort=price-asc
2026-03-30 15:15:17 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 10032600, page: 1
2026-03-30 15:15:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:15:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: None) ['zyte-api']
2026-03-30 15:15:19 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-30 15:15:19 [auto_selling_autotrader.co.uk] INFO: Page: 1/1, total results: 9
2026-03-30 15:15:19 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-30 15:15:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 15:15:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-30 15:15:19 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 15:15:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 15:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603271056229%27 HTTP/1.1" 200 None
2026-03-30 15:15:19 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603271056229: 1
2026-03-30 15:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603261027512%27 HTTP/1.1" 200 None
2026-03-30 15:15:19 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603261027512: 1
2026-03-30 15:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603010306923%27 HTTP/1.1" 200 None
2026-03-30 15:15:19 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603010306923: 1
2026-03-30 15:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602169962661%27 HTTP/1.1" 200 None
2026-03-30 15:15:19 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602169962661: 1
2026-03-30 15:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508185538805%27 HTTP/1.1" 200 None
2026-03-30 15:15:19 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202508185538805: 1
2026-03-30 15:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202506243810554%27 HTTP/1.1" 200 None
2026-03-30 15:15:19 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202506243810554: 1
2026-03-30 15:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202504111246555%27 HTTP/1.1" 200 None
2026-03-30 15:15:19 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202504111246555: 1
2026-03-30 15:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202412167310859%27 HTTP/1.1" 200 None
2026-03-30 15:15:19 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202412167310859: 1
2026-03-30 15:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202303235539990%27 HTTP/1.1" 200 None
2026-03-30 15:15:19 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202303235539990: 1
2026-03-30 15:15:19 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 9 detail requests (batch 1)
2026-03-30 15:15:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:15:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-30 15:15:21 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:15:21 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d07e1d3-11e8-5eb5-ba40-4c819d838c78 with identifier: 202603271056229
2026-03-30 15:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6d07e1d3-11e8-5eb5-ba40-4c819d838c78
2026-03-30 15:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9952659518454602b46edf7eb34822dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9952659518454602b46edf7eb34822dd.jpg already downloaded
2026-03-30 15:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Feaf1a0b27c97418cabcd7bc9c745782d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/eaf1a0b27c97418cabcd7bc9c745782d.jpg already downloaded
2026-03-30 15:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdef2d41b7f444fc29e8c96b0b4a76b71.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/def2d41b7f444fc29e8c96b0b4a76b71.jpg already downloaded
2026-03-30 15:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3af0408c2fd24a1e90b64ebb199a1034.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3af0408c2fd24a1e90b64ebb199a1034.jpg already downloaded
2026-03-30 15:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F56ddcda5615c4146a26ede557b638e03.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/56ddcda5615c4146a26ede557b638e03.jpg already downloaded
2026-03-30 15:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcdfea97b2fd04a00b82b27f4508d8425.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cdfea97b2fd04a00b82b27f4508d8425.jpg already downloaded
2026-03-30 15:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb1bfebe944cb4d8c9856f22c6f14cd9b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b1bfebe944cb4d8c9856f22c6f14cd9b.jpg already downloaded
2026-03-30 15:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F59b050709f7d487989e41e025c386eb3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/59b050709f7d487989e41e025c386eb3.jpg already downloaded
2026-03-30 15:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fefcce7ee666d447fa80640092e146a4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/efcce7ee666d447fa80640092e146a4f.jpg already downloaded
2026-03-30 15:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffbcf61ce2a4a4c20a60ccacd268fe21f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fbcf61ce2a4a4c20a60ccacd268fe21f.jpg already downloaded
2026-03-30 15:15:21 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 6d07e1d3-11e8-5eb5-ba40-4c819d838c78 with identifier 202603271056229
2026-03-30 15:15:21 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: None -> <ConnectionState.START: 0>
2026-03-30 15:15:21 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.START: 0> -> <ConnectionState.HDR_SENT: 2>
2026-03-30 15:15:21 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.HDR_SENT: 2>
2026-03-30 15:15:21 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.OPEN_PIPE: 4>
2026-03-30 15:15:21 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.UNMAPPED: 0> -> <SessionState.BEGIN_SENT: 1>
2026-03-30 15:15:21 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:15:21 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:15:21 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:15:21 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:15:21 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_PIPE: 4> -> <ConnectionState.OPEN_SENT: 7>
2026-03-30 15:15:21 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_SENT: 7> -> <ConnectionState.OPENED: 9>
2026-03-30 15:15:21 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.BEGIN_SENT: 1> -> <SessionState.MAPPED: 3>
2026-03-30 15:15:21 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:15:21 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:15:21 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:15:21 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:15:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS completed opening with status: <ManagementOpenResult.OK: 1>
2026-03-30 15:15:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 15:15:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2011
2026-03-30 15:15:21 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 15:15:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774883721
2026-03-30 15:15:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774883721
2026-03-30 15:15:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS Put token result (<ManagementExecuteOperationResult.OK: 0>), status code: 202, status_description: b'Accepted'.
2026-03-30 15:15:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:21 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:15:21 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:15:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:22 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 6d07e1d3-11e8-5eb5-ba40-4c819d838c78
2026-03-30 15:15:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 158,
'color': 'Grey',
'currency': 'GBP',
'description': 'Brooklyns Motors would like to present to you, this '
'exceptional JCW, The 2018 MINI John Cooper Works (JCW) '
'Countryman is a high-performance, all-wheel-drive subcompact '
'crossover, featuring a 2.0L turbocharged 4-cylinder engine '
'with 228 hp and 258 lb-ft of torque. It boasts sporty '
'handling, standard Brembo brakes, sport suspension, and a '
'0-62 mph time of 6.5 seconds, blending SUV practicality with '
'classic "go-kart" driving dynamics, Key Features and '
'Specifications: Panoramic Glass Roof, Heads up Display, '
'Multifunction Steering Wheel, Paddle Shift, Harmon Kardon '
'Surround Sound, Bluetooth Audio, Bluetooth Phone Prep, Heated '
'JCW Sports Seats Package, Keyless Entry, Park Assist, Rear '
'Privacy Glass, Engine/Performance: 2.0-liter turbocharged '
'4-cylinder (228 hp/258 lb-ft torque), Transmission, Available '
'with a 6-speed manual or 8-speed automatic transmission, '
'Drivetrain: ALL4 All-Wheel Drive system.\n'
'Handling: Sport suspension (stiff), electronic differential '
'lock (front), and optional adaptive suspension, Design: JCW '
'aero kit, LED headlights, twin exhaust pipes, and rear '
'spoiler, Interior: JCW sport seats, sport steering wheel, '
'and\n'
'versatile seating with sliding/folding rear seats, Driving '
'Modes: Three modes—Green, Mid, and Sport—that adjust throttle '
'response and steering, Full Mini Bmw Service History, Mot, 2x '
'Keys, Competitive finance rates available, Warranty '
'information on request.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 228,
'fuel_type': 'Petrol',
'id': '6d07e1d3-11e8-5eb5-ba40-4c819d838c78',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603271056229',
'listing': 'directbuy',
'location': 'Broxbourne, Hertfordshire',
'make': 'MINI',
'model': 'Countryman',
'odometer': 53000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 42,
'photo_urls': ['https://m.atcdn.co.uk/a/media/9952659518454602b46edf7eb34822dd.jpg',
'https://m.atcdn.co.uk/a/media/eaf1a0b27c97418cabcd7bc9c745782d.jpg',
'https://m.atcdn.co.uk/a/media/def2d41b7f444fc29e8c96b0b4a76b71.jpg',
'https://m.atcdn.co.uk/a/media/3af0408c2fd24a1e90b64ebb199a1034.jpg',
'https://m.atcdn.co.uk/a/media/56ddcda5615c4146a26ede557b638e03.jpg',
'https://m.atcdn.co.uk/a/media/cdfea97b2fd04a00b82b27f4508d8425.jpg',
'https://m.atcdn.co.uk/a/media/b1bfebe944cb4d8c9856f22c6f14cd9b.jpg',
'https://m.atcdn.co.uk/a/media/59b050709f7d487989e41e025c386eb3.jpg',
'https://m.atcdn.co.uk/a/media/efcce7ee666d447fa80640092e146a4f.jpg',
'https://m.atcdn.co.uk/a/media/fbcf61ce2a4a4c20a60ccacd268fe21f.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d07e1d3-11e8-5eb5-ba40-4c819d838c78/6d07e1d3-11e8-5eb5-ba40-4c819d838c78_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 453644,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9952659518454602b46edf7eb34822dd.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d07e1d3-11e8-5eb5-ba40-4c819d838c78/6d07e1d3-11e8-5eb5-ba40-4c819d838c78_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 452062,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/eaf1a0b27c97418cabcd7bc9c745782d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d07e1d3-11e8-5eb5-ba40-4c819d838c78/6d07e1d3-11e8-5eb5-ba40-4c819d838c78_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365410,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/def2d41b7f444fc29e8c96b0b4a76b71.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d07e1d3-11e8-5eb5-ba40-4c819d838c78/6d07e1d3-11e8-5eb5-ba40-4c819d838c78_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 479498,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3af0408c2fd24a1e90b64ebb199a1034.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d07e1d3-11e8-5eb5-ba40-4c819d838c78/6d07e1d3-11e8-5eb5-ba40-4c819d838c78_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 505603,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/56ddcda5615c4146a26ede557b638e03.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d07e1d3-11e8-5eb5-ba40-4c819d838c78/6d07e1d3-11e8-5eb5-ba40-4c819d838c78_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 383548,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cdfea97b2fd04a00b82b27f4508d8425.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d07e1d3-11e8-5eb5-ba40-4c819d838c78/6d07e1d3-11e8-5eb5-ba40-4c819d838c78_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382158,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b1bfebe944cb4d8c9856f22c6f14cd9b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d07e1d3-11e8-5eb5-ba40-4c819d838c78/6d07e1d3-11e8-5eb5-ba40-4c819d838c78_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 392427,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/59b050709f7d487989e41e025c386eb3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d07e1d3-11e8-5eb5-ba40-4c819d838c78/6d07e1d3-11e8-5eb5-ba40-4c819d838c78_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 429593,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/efcce7ee666d447fa80640092e146a4f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d07e1d3-11e8-5eb5-ba40-4c819d838c78/6d07e1d3-11e8-5eb5-ba40-4c819d838c78_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380166,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fbcf61ce2a4a4c20a60ccacd268fe21f.jpg',
'Width': 2048}],
'price': 19250,
'price_includes_vat': True,
'registration_date': '2018-08-30',
'seats_number': 5,
'seller_name': None,
'title': 'MINI Countryman 2.0 John Cooper Works Auto ALL4 Euro 6 (s/s) 5dr',
'transmission': 'automatic',
'trim': 'John Cooper Works',
'year': 2018}
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603271056229%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603271056229: {'created_time': 1774883722.058546, 'last_price_update_time': 1774883722.058559}
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603271056229') HTTP/1.1" 204 0
2026-03-30 15:15:22 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:15:22 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 5655ab09-c8f6-5607-8978-277684af557d with identifier: 202603261027512
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5655ab09-c8f6-5607-8978-277684af557d
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0761f70e2f5843739e19ff0ca7e2016d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0761f70e2f5843739e19ff0ca7e2016d.jpg already downloaded
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F427f6749ac534ba3a91c60d6f81792cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/427f6749ac534ba3a91c60d6f81792cd.jpg already downloaded
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc24b9e6e7f734cdf827e594cf82a441c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c24b9e6e7f734cdf827e594cf82a441c.jpg already downloaded
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd40cd1c0b6014104b6f8fe1a5a784013.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d40cd1c0b6014104b6f8fe1a5a784013.jpg already downloaded
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3591e0ae0a90439993a5fba882b69602.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3591e0ae0a90439993a5fba882b69602.jpg already downloaded
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe366c9329bed4d2fa5059d82af525fcc.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e366c9329bed4d2fa5059d82af525fcc.jpg already downloaded
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F579d204c72564cf99cd0e1412d9f7846.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/579d204c72564cf99cd0e1412d9f7846.jpg already downloaded
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F48bb54990d2d4180886167f8b1b9febe.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/48bb54990d2d4180886167f8b1b9febe.jpg already downloaded
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5e256fa4d2554b298fd35fa5562fba83.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5e256fa4d2554b298fd35fa5562fba83.jpg already downloaded
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7bb7a0a8d19d409d914a8ed366d91f6a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7bb7a0a8d19d409d914a8ed366d91f6a.jpg already downloaded
2026-03-30 15:15:22 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 5655ab09-c8f6-5607-8978-277684af557d with identifier 202603261027512
2026-03-30 15:15:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:22 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 5655ab09-c8f6-5607-8978-277684af557d
2026-03-30 15:15:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 170,
'color': 'Black',
'currency': 'GBP',
'description': 'Brooklyns Motors would like to present to you, this extremely '
'rear 300 Sport Jaguar F-Pace, Key Features and '
'Specifications: Engine & Performance: The 300 Sport is often '
'recognized by its powerful 3.0L V6 diesel (D300) or '
'high-output 2.0L 4-cylinder petrol (P300), both producing 296 '
'BHP, Exterior Styling: Features a distinctive "300 Sport" '
'badge on the front grille and rear tailgate, dark satin grey '
'details on the grille, window surrounds, side vents, and '
'mirror caps.\n'
'Interior Details: Includes ebony perforated grained leather '
'seats with yellow contrast stitching, "300 Sport" branded '
'steering wheel and carpet mats, and 300 Sport embossed on the '
'headrests, Technology & Comfort: Equipped with Touch Pro '
'Navigation, a 12.3-inch interactive driver display, a '
'Meridian sound system, and 14-way or 18-way electric front '
'seats, Added Options: Panoramic roof, Adaptive Dynamics, '
'power tailgate, and reversing camera are often included, 2 x '
'keys, 2 previous owners from new, Full land rover service '
'history recently serviced, Competitive Finance rates '
'available, Warranty information on request.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '3L',
'engine_horse_power': 296,
'fuel_type': 'Diesel',
'id': '5655ab09-c8f6-5607-8978-277684af557d',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603261027512',
'listing': 'directbuy',
'location': 'Broxbourne, Hertfordshire',
'make': 'Jaguar',
'model': 'F-PACE',
'odometer': 43000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 41,
'photo_urls': ['https://m.atcdn.co.uk/a/media/0761f70e2f5843739e19ff0ca7e2016d.jpg',
'https://m.atcdn.co.uk/a/media/427f6749ac534ba3a91c60d6f81792cd.jpg',
'https://m.atcdn.co.uk/a/media/c24b9e6e7f734cdf827e594cf82a441c.jpg',
'https://m.atcdn.co.uk/a/media/d40cd1c0b6014104b6f8fe1a5a784013.jpg',
'https://m.atcdn.co.uk/a/media/3591e0ae0a90439993a5fba882b69602.jpg',
'https://m.atcdn.co.uk/a/media/e366c9329bed4d2fa5059d82af525fcc.jpg',
'https://m.atcdn.co.uk/a/media/579d204c72564cf99cd0e1412d9f7846.jpg',
'https://m.atcdn.co.uk/a/media/48bb54990d2d4180886167f8b1b9febe.jpg',
'https://m.atcdn.co.uk/a/media/5e256fa4d2554b298fd35fa5562fba83.jpg',
'https://m.atcdn.co.uk/a/media/7bb7a0a8d19d409d914a8ed366d91f6a.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5655ab09-c8f6-5607-8978-277684af557d/5655ab09-c8f6-5607-8978-277684af557d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 547159,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0761f70e2f5843739e19ff0ca7e2016d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5655ab09-c8f6-5607-8978-277684af557d/5655ab09-c8f6-5607-8978-277684af557d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 541807,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/427f6749ac534ba3a91c60d6f81792cd.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5655ab09-c8f6-5607-8978-277684af557d/5655ab09-c8f6-5607-8978-277684af557d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 543309,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c24b9e6e7f734cdf827e594cf82a441c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5655ab09-c8f6-5607-8978-277684af557d/5655ab09-c8f6-5607-8978-277684af557d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 433061,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d40cd1c0b6014104b6f8fe1a5a784013.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5655ab09-c8f6-5607-8978-277684af557d/5655ab09-c8f6-5607-8978-277684af557d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438558,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3591e0ae0a90439993a5fba882b69602.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5655ab09-c8f6-5607-8978-277684af557d/5655ab09-c8f6-5607-8978-277684af557d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 611074,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e366c9329bed4d2fa5059d82af525fcc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5655ab09-c8f6-5607-8978-277684af557d/5655ab09-c8f6-5607-8978-277684af557d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 609956,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/579d204c72564cf99cd0e1412d9f7846.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5655ab09-c8f6-5607-8978-277684af557d/5655ab09-c8f6-5607-8978-277684af557d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 557502,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/48bb54990d2d4180886167f8b1b9febe.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5655ab09-c8f6-5607-8978-277684af557d/5655ab09-c8f6-5607-8978-277684af557d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 543729,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5e256fa4d2554b298fd35fa5562fba83.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5655ab09-c8f6-5607-8978-277684af557d/5655ab09-c8f6-5607-8978-277684af557d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 560561,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7bb7a0a8d19d409d914a8ed366d91f6a.jpg',
'Width': 2048}],
'price': 29989,
'price_includes_vat': True,
'registration_date': '2020-03-02',
'seats_number': 5,
'seller_name': None,
'title': 'Jaguar F-Pace 3.0 D300 V6 300 Sport Auto AWD Euro 6 (s/s) 5dr',
'transmission': 'automatic',
'trim': '300 Sport',
'year': 2020}
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603261027512%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603261027512: {'created_time': 1774883722.276088, 'last_price_update_time': 1774883722.276101}
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603261027512') HTTP/1.1" 204 0
2026-03-30 15:15:22 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:15:22 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 362e0809-2849-59dc-9368-ead3cbfbbf8a with identifier: 202603010306923
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 362e0809-2849-59dc-9368-ead3cbfbbf8a
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8e093cd11a0445db913b5cb087fc6ca2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8e093cd11a0445db913b5cb087fc6ca2.jpg already downloaded
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe69ec96c58cb438687bd3fe35eefe7ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e69ec96c58cb438687bd3fe35eefe7ba.jpg already downloaded
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbbbdae3249eb44269589aec458f66102.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bbbdae3249eb44269589aec458f66102.jpg already downloaded
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6a9cff38c5574216bd0f7e1e481c1319.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6a9cff38c5574216bd0f7e1e481c1319.jpg already downloaded
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F25a5fef3a5924f15b5d3614311545ff2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/25a5fef3a5924f15b5d3614311545ff2.jpg already downloaded
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc036f04267cd4c889a30071bdab0425d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c036f04267cd4c889a30071bdab0425d.jpg already downloaded
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc9b342dd2dd94ed9bdb1eec5d6c7efb7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c9b342dd2dd94ed9bdb1eec5d6c7efb7.jpg already downloaded
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc9b342dd2dd94ed9bdb1eec5d6c7efb7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c9b342dd2dd94ed9bdb1eec5d6c7efb7.jpg already downloaded
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe086c060f46a429caf3004bceb1dc35d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e086c060f46a429caf3004bceb1dc35d.jpg already downloaded
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa393d06e06df4f6da4a1d6cefc7362cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a393d06e06df4f6da4a1d6cefc7362cb.jpg already downloaded
2026-03-30 15:15:22 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 362e0809-2849-59dc-9368-ead3cbfbbf8a with identifier 202603010306923
2026-03-30 15:15:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:22 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 362e0809-2849-59dc-9368-ead3cbfbbf8a
2026-03-30 15:15:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 370,
'color': 'Black',
'currency': 'GBP',
'description': 'Brooklyns motors would like to present to you this amazing '
'Rolls Royce product, the Cullinan, This vehicle is '
'Vat-qualifying, for business owners this is a financial '
'advantage, the Specification is unique to this particular '
'model, we have the Diamond Black exterior finish with the '
'interior colour in Mandarin, mixed with Black Pipping, the '
'seats are Electric, Memory, Heated + Massaging to support and '
'compliment you on your journeys, we have the Star light '
'option with the shooting stars, this option had been made '
'available to the later models. Cullinan features a '
'high-resolution, full-color Head-Up Display (HUD) that '
'projects critical driving data, including speed, navigation '
'directions, and active cruise control alerts, directly onto '
"the windshield. It is part of the SUV's advanced "
'driver-assistance systems, designed for safety and '
'convenience, Cullinan features an advanced infotainment '
'system with a high-resolution touchscreen, 3D mapping, and '
'real-time traffic information (RTTI). It includes Apple '
'CarPlay, voice-activated controls, and a console-mounted '
'Spirit of Ecstasy rotary controller. The system also '
'integrates with the Rolls-Royce Connect app for sending '
'destinations directly to the car. Adaptive Cruise Control '
'with Stop & Go, often paired with advanced driver assistance '
'systems like lane departure warning and night vision. The '
'system maintains set speeds and distances from vehicles '
'ahead, including, navigation-linked speed adjustments, '
'sophisticated, power-operated "coach doors" (rear-hinged in '
'the back) that can open and close automatically via button, '
'handle sensors, or, for the driver, by holding the interior '
'door handle. They include soft-close technology and '
'integrated umbrellas, 2x Keys, Ghost Security, Full Rolls '
'Royce service history, Manufactures Warranty Remaining, '
'Competitive Finance rates available.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '6.75L',
'engine_horse_power': 563,
'fuel_type': 'Petrol',
'id': '362e0809-2849-59dc-9368-ead3cbfbbf8a',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603010306923',
'listing': 'directbuy',
'location': 'Broxbourne, Hertfordshire',
'make': 'Rolls-Royce',
'model': 'Cullinan',
'odometer': 19000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 39,
'photo_urls': ['https://m.atcdn.co.uk/a/media/8e093cd11a0445db913b5cb087fc6ca2.jpg',
'https://m.atcdn.co.uk/a/media/e69ec96c58cb438687bd3fe35eefe7ba.jpg',
'https://m.atcdn.co.uk/a/media/bbbdae3249eb44269589aec458f66102.jpg',
'https://m.atcdn.co.uk/a/media/6a9cff38c5574216bd0f7e1e481c1319.jpg',
'https://m.atcdn.co.uk/a/media/25a5fef3a5924f15b5d3614311545ff2.jpg',
'https://m.atcdn.co.uk/a/media/c036f04267cd4c889a30071bdab0425d.jpg',
'https://m.atcdn.co.uk/a/media/c9b342dd2dd94ed9bdb1eec5d6c7efb7.jpg',
'https://m.atcdn.co.uk/a/media/c9b342dd2dd94ed9bdb1eec5d6c7efb7.jpg',
'https://m.atcdn.co.uk/a/media/e086c060f46a429caf3004bceb1dc35d.jpg',
'https://m.atcdn.co.uk/a/media/a393d06e06df4f6da4a1d6cefc7362cb.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_362e0809-2849-59dc-9368-ead3cbfbbf8a/362e0809-2849-59dc-9368-ead3cbfbbf8a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 465727,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e69ec96c58cb438687bd3fe35eefe7ba.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_362e0809-2849-59dc-9368-ead3cbfbbf8a/362e0809-2849-59dc-9368-ead3cbfbbf8a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 460530,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6a9cff38c5574216bd0f7e1e481c1319.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_362e0809-2849-59dc-9368-ead3cbfbbf8a/362e0809-2849-59dc-9368-ead3cbfbbf8a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 421709,
'Height': 1152,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8e093cd11a0445db913b5cb087fc6ca2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_362e0809-2849-59dc-9368-ead3cbfbbf8a/362e0809-2849-59dc-9368-ead3cbfbbf8a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 434098,
'Height': 1152,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bbbdae3249eb44269589aec458f66102.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_362e0809-2849-59dc-9368-ead3cbfbbf8a/362e0809-2849-59dc-9368-ead3cbfbbf8a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423770,
'Height': 1152,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/25a5fef3a5924f15b5d3614311545ff2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_362e0809-2849-59dc-9368-ead3cbfbbf8a/362e0809-2849-59dc-9368-ead3cbfbbf8a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 403071,
'Height': 1152,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c036f04267cd4c889a30071bdab0425d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_362e0809-2849-59dc-9368-ead3cbfbbf8a/362e0809-2849-59dc-9368-ead3cbfbbf8a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 419540,
'Height': 1152,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c9b342dd2dd94ed9bdb1eec5d6c7efb7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_362e0809-2849-59dc-9368-ead3cbfbbf8a/362e0809-2849-59dc-9368-ead3cbfbbf8a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 419540,
'Height': 1152,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c9b342dd2dd94ed9bdb1eec5d6c7efb7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_362e0809-2849-59dc-9368-ead3cbfbbf8a/362e0809-2849-59dc-9368-ead3cbfbbf8a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 433445,
'Height': 1152,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e086c060f46a429caf3004bceb1dc35d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_362e0809-2849-59dc-9368-ead3cbfbbf8a/362e0809-2849-59dc-9368-ead3cbfbbf8a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 394507,
'Height': 1152,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a393d06e06df4f6da4a1d6cefc7362cb.jpg',
'Width': 2048}],
'price': 249989,
'price_includes_vat': True,
'registration_date': '2022-06-17',
'seats_number': 5,
'seller_name': None,
'title': 'Rolls-Royce Cullinan 6.75 V12 Auto 4WD Euro 6 5dr',
'transmission': 'automatic',
'year': 2022}
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603010306923%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603010306923: {'created_time': 1774883722.493124, 'last_price_update_time': 1774883722.493135}
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603010306923') HTTP/1.1" 204 0
2026-03-30 15:15:22 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:15:22 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 6185286c-9c56-5d81-b5e1-35ac17804f88 with identifier: 202602169962661
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6185286c-9c56-5d81-b5e1-35ac17804f88
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F17384dc062394619bc4ebd4110fe66bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/17384dc062394619bc4ebd4110fe66bd.jpg already downloaded
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff34f299e52a748629c884737293f9ea6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f34f299e52a748629c884737293f9ea6.jpg already downloaded
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F34518e92393f4fd6b2b73b0c41998546.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/34518e92393f4fd6b2b73b0c41998546.jpg already downloaded
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb02b198eaa704c9f8ea625deb21334c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b02b198eaa704c9f8ea625deb21334c0.jpg already downloaded
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F092cbb357980453ba62674f5c757399f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/092cbb357980453ba62674f5c757399f.jpg already downloaded
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3bee61c87b964df1916e5b508ec2bce0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3bee61c87b964df1916e5b508ec2bce0.jpg already downloaded
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F43e1125fd33c48fc9357479b893443ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/43e1125fd33c48fc9357479b893443ea.jpg already downloaded
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff3b0b1ffabb84d948e5fe9d814e384d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f3b0b1ffabb84d948e5fe9d814e384d2.jpg already downloaded
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F738a3c59dd4f4a3686020da110847af1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/738a3c59dd4f4a3686020da110847af1.jpg already downloaded
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4bf7c50e9fe143fc92ee96123da4720c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4bf7c50e9fe143fc92ee96123da4720c.jpg already downloaded
2026-03-30 15:15:22 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 6185286c-9c56-5d81-b5e1-35ac17804f88 with identifier 202602169962661
2026-03-30 15:15:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:22 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 6185286c-9c56-5d81-b5e1-35ac17804f88
2026-03-30 15:15:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 249,
'color': 'Grey',
'currency': 'GBP',
'description': 'Brooklyns Motors would like to present to you, this Beautiful '
'570s Spyder with a full Mclaren service '
'history, '
'this vehicle is currently going through our advertising '
'process, so please feel free to contact us at your '
'convenience, thank you.',
'doors_number': 2,
'emission_standard': 'Euro 6',
'engine': '3.8L',
'engine_horse_power': 562,
'fuel_type': 'Petrol',
'id': '6185286c-9c56-5d81-b5e1-35ac17804f88',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602169962661',
'listing': 'directbuy',
'location': 'Broxbourne, Hertfordshire',
'make': 'McLaren',
'model': '570S',
'odometer': 27000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 41,
'photo_urls': ['https://m.atcdn.co.uk/a/media/17384dc062394619bc4ebd4110fe66bd.jpg',
'https://m.atcdn.co.uk/a/media/f34f299e52a748629c884737293f9ea6.jpg',
'https://m.atcdn.co.uk/a/media/34518e92393f4fd6b2b73b0c41998546.jpg',
'https://m.atcdn.co.uk/a/media/b02b198eaa704c9f8ea625deb21334c0.jpg',
'https://m.atcdn.co.uk/a/media/092cbb357980453ba62674f5c757399f.jpg',
'https://m.atcdn.co.uk/a/media/3bee61c87b964df1916e5b508ec2bce0.jpg',
'https://m.atcdn.co.uk/a/media/43e1125fd33c48fc9357479b893443ea.jpg',
'https://m.atcdn.co.uk/a/media/f3b0b1ffabb84d948e5fe9d814e384d2.jpg',
'https://m.atcdn.co.uk/a/media/738a3c59dd4f4a3686020da110847af1.jpg',
'https://m.atcdn.co.uk/a/media/4bf7c50e9fe143fc92ee96123da4720c.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6185286c-9c56-5d81-b5e1-35ac17804f88/6185286c-9c56-5d81-b5e1-35ac17804f88_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 839170,
'Height': 2048,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/17384dc062394619bc4ebd4110fe66bd.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6185286c-9c56-5d81-b5e1-35ac17804f88/6185286c-9c56-5d81-b5e1-35ac17804f88_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 849300,
'Height': 2048,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f34f299e52a748629c884737293f9ea6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6185286c-9c56-5d81-b5e1-35ac17804f88/6185286c-9c56-5d81-b5e1-35ac17804f88_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 614832,
'Height': 2048,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/34518e92393f4fd6b2b73b0c41998546.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6185286c-9c56-5d81-b5e1-35ac17804f88/6185286c-9c56-5d81-b5e1-35ac17804f88_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 561946,
'Height': 2048,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b02b198eaa704c9f8ea625deb21334c0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6185286c-9c56-5d81-b5e1-35ac17804f88/6185286c-9c56-5d81-b5e1-35ac17804f88_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 598321,
'Height': 2048,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/092cbb357980453ba62674f5c757399f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6185286c-9c56-5d81-b5e1-35ac17804f88/6185286c-9c56-5d81-b5e1-35ac17804f88_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 991083,
'Height': 2048,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3bee61c87b964df1916e5b508ec2bce0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6185286c-9c56-5d81-b5e1-35ac17804f88/6185286c-9c56-5d81-b5e1-35ac17804f88_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1012890,
'Height': 2048,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/43e1125fd33c48fc9357479b893443ea.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6185286c-9c56-5d81-b5e1-35ac17804f88/6185286c-9c56-5d81-b5e1-35ac17804f88_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 644656,
'Height': 2048,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f3b0b1ffabb84d948e5fe9d814e384d2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6185286c-9c56-5d81-b5e1-35ac17804f88/6185286c-9c56-5d81-b5e1-35ac17804f88_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 614386,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/738a3c59dd4f4a3686020da110847af1.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6185286c-9c56-5d81-b5e1-35ac17804f88/6185286c-9c56-5d81-b5e1-35ac17804f88_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 573148,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4bf7c50e9fe143fc92ee96123da4720c.jpg',
'Width': 2048}],
'price': 89898,
'price_includes_vat': True,
'registration_date': '2017-12-15',
'seats_number': 2,
'seller_name': None,
'title': 'McLaren 570S 3.8T V8 Spider SSG Euro 6 (s/s) 2dr',
'transmission': 'automatic',
'year': 2017}
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602169962661%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602169962661: {'created_time': 1774883722.731434, 'last_price_update_time': 1774883722.731448}
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602169962661') HTTP/1.1" 204 0
2026-03-30 15:15:22 [common.utils.decorators] ERROR: DefaultOnExceptionError in _extract_co2_emission_value: 'NoneType' object is not subscriptable
Traceback (most recent call last):
File "/usr/src/app/common/utils/decorators.py", line 16, in wrapper
return func(self, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/autotrader_details_extractor.py", line 390, in _extract_co2_emission_value
return data["specification"]["co2Emissions"]["co2Emission"]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^
TypeError: 'NoneType' object is not subscriptable
2026-03-30 15:15:22 [common.utils.decorators] ERROR: Payload: {"id": "202508185538805", "stockItemId": "8a4206e198bd6ae20198bd82996c506f", "isAuction": false, "hoursUsed": null, "serviceHistory": null, "title": "Dodge RAM 1500 AWD TRX Hennessey Mammoth 900 6.0 4dr", "excludePreviousOwners": false, "advertisedLocations": ["at_cars", "at_profile", "at_profile_cars", "at_stock_cars", "retailer_websites", "trade_advertiser_stock"], "dueAtSeller": null, "motExpiry": null, "motInsurance": null, "lastServiceOdometerReadingMiles": null, "lastServiceDate": null, "warrantyMonthsOnPurchase": null, "twelveMonthsMotIncluded": false, "preReg": false, "heading": {"title": "Dodge RAM", "subtitle": "1500 AWD TRX Hennessey Mammoth 900 4dr", "__typename": "Heading"}, "attentionGrabber": "RHD TRX HENNESSEY MAMMOTH 900", "rrp": null, "price": 149989, "priceGBX": 14998900, "priceExcludingFees": 149989, "priceExcludingFeesGBX": 14998900, "suppliedPrice": 149989, "suppliedPriceGBX": 14998900, "priceOnApplication": false, "plusVatIndicated": false, "vatStatus": "NO_VAT", "saving": null, "noAdminFees": true, "adminFee": null, "adminFeeInfoDescription": null, "dateOfRegistration": "2021-01-01", "homeDeliveryRegionCodes": null, "priceExcludingVat": 149989, "vatToBePaidUpfront": 0, "capabilities": {"marketExtensionHomeDelivery": null, "marketExtensionClickAndCollect": null, "marketExtensionCentrallyHeld": null, "marketExtensionOem": null, "digitalRetailing": {"enabled": false, "__typename": "DigitalRetailingCapability"}, "__typename": "Capabilities"}, "registration": null, "generation": {"generationId": "", "name": "coming soon", "review": {"expertReviewSummary": null, "__typename": "GenerationReviewData"}, "__typename": "Generation"}, "hasShowroomProductCode": false, "isPartExAvailable": true, "isFinanceAvailable": false, "isFinanceFullApplicationAvailable": false, "financeProvider": null, "financeDefaults": null, "hasFinanceInformation": false, "retailerId": "10032600", "privateAdvertiser": null, "advertiserSegment": "Independent", "dealer": {"dealerId": "10032600", "description": "", "distance": null, "stockLevels": {"atStockCounts": {"car": 8, "van": null, "__typename": "AtStockCounts"}, "__typename": "DealerStockLevels"}, "assignedNumber": null, "atAwards": [], "branding": {"accreditations": [], "brands": [], "__typename": "DealerBranding"}, "capabilities": {"instantMessagingChat": null, "instantMessagingText": null, "__typename": "Capabilities"}, "reviews": {"overallReviewRating": "5.0", "__typename": "Reviews"}, "location": {"addressOne": "Broxbournebury Mansion, White Stubbs Lane", "addressTwo": null, "town": "Broxbourne", "county": "Hertfordshire", "postcode": "EN10 7PY", "latLong": "51.7462744,-0.0415535", "__typename": "Location"}, "marketing": {"profile": null, "strapline": null, "__typename": "Marketing"}, "media": {"email": "yes", "dealerWebsite": {"href": "http://www.brooklynsmotors.co.uk", "__typename": "Link"}, "phoneNumber1": "(07537) 164503", "phoneNumber2": "(01992) 843067", "protectedNumber": false, "__typename": "DealerMedia"}, "name": "BROOKYLNS", "servicesOffered": {"sellerPromise": null, "services": null, "products": ["APXV", "AT18FINANCECUST", "AT18SELLCUST", "ATCRTLCHK", "ATCVVAL", "ATMOVES", "BOOST", "CODRIVER", "DIGITALRETAIL", "DVID", "FCS", "FPBARGAIN", "FPBONUS", "FPS", "FULLRESERVATIONS", "ISP3", "ISSCUST", "ISS_PRODCAT", "PFIN", "PPI_3_STANDARD", "PROFILE", "RTLCHKPLUS", "STEX", "STOCKMANAGER", "VEHICLELOOKUP", "WATC", "WAV", "WDEW", "WDSV", "WIMT", "WKSP", "WLGE", "WMOS", "WMPS", "WSL"], "safeSelling": null, "videoWalkAround": null, "nccApproved": false, "isHomeDeliveryProductEnabled": false, "isPartExAvailable": true, "hasSafeSelling": false, "hasHomeDelivery": false, "hasVideoWalkAround": false, "__typename": "ServicesOffered"}, "__typename": "Dealer"}, "video": null, "spin": null, "imageList": {"nextCursor": null, "size": 62, "images": [{"url": "https://m.atcdn.co.uk/a/media/{resize}/65ca751b433f42718b54d2cacc88fdd2.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/62488675de8d405c8937cc5a6d541c40.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/e36e7daac1144902be3b26a97a7ca8f5.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f985fb43ed68450f9feee54e734e5ae3.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d0dfb12d4bbe420aa9fc9d2ccb2bf302.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d0fa54aecd2a4acabc27b19e3684812a.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/2eac123cc6444a968fdec39c0e6c54e2.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/fc4add8ebb9941668ce6049f9e86b36e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/8ebd4d90d8ec431e8d6b8150dd1f09a5.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d3d00205da8c467bb12046fde8bb23fd.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/7f8f2e293bc24bcfbdcba79b6038b8a1.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/41708ff6a9834ea6981ebc728dcf4762.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f6ee72700ecd4f68a2dbb15a868d454a.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/12b080b628454bb7a4b413070b43c990.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/0c9bb4891ed3469f8cb1e95ca1a02c5a.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/ddde5044e6ce4545822c5bf6c0e2e407.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/91f7221df0ba4721bc0209767cf774e6.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/191ecc864df64e5492c7cff2ef8316aa.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/45f9a85f3a244920966e1fcfc5daabe1.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/0d276ca64611489ba272afb15d2c8100.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/fc215498863f45df9a5c3cbf9c6ede8e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d0918db7bdc84c0daf741064ec464c8d.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d2bc165e3653447d97c4e23947fccd77.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/4e1a46620359449f981c1409328635a2.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/828e50460b8945e2963645f0c7f998d6.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Door Interior", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/686a03f566024caa9e98fb7803aae48b.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Driver", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/48f878445a154fe0b64a04bb2bc12162.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Steering Wheel", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/3f954651be414ecda3b3cbea10656f00.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Driver", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/940ce437308a4327872f74d39df2250f.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Driver", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/e624b12ce8314ace8411baf1a824d894.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/dd99d66f8ea4478b931bac9ed8bc6ca6.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/c7592083bb014e94baf86dafa31986f1.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/ceee1eb40f8a4970aa00bb85d27c027e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Misc Controls", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/0ae2235c65364ee6a55ad72387c56a00.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/706b9fd35f9641c1adfd40999ebde3cf.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Front Passenger", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f505f3c2f1dd423397e2d4954899a6ac.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Front Passenger", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/cbc93e79578e404a92a10c109faa54e9.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/acee58c0a6864e49baf493afb1fc2377.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/539b84d37e5a4235a9a2e984e3484d8c.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f18c6d08f30449639b75bb36f48aa3ba.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/2eceb93f911146e98e1fbe83bb858744.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/7d5e8c3844924ee2accbdaac1cd43145.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f3586f500b9844378973391b5e712f5a.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Door Interior", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d2b49d119aee4854870bc167d020ce09.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/7f3213432d9340cdb05fbc33926fd0e4.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/4ce698197c3047c09fd3a8e819f3e68b.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/98365be82337449cae33abab503bdd2e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/27559db4f69e492ca17d18c750783940.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Door Interior", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/adc43b3d4b364ed8a192f7c3967e491a.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/aa6d1024a7864d6a9683deefb98c993f.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/df817ddf08c9427bad3fe896c22c85f9.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/ec32650b921440309adb7c4c824f2f08.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f3be0664096f4c789978073362149fdc.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Wheel", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/a23be2fbe8194dd28a274bb88a5b7910.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Wheel", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/099a6fda252c4b078d7c8fae79ef36b7.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Wheel", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/af8a05e3203f4f0dbff50ca607f44848.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/b5584f1df0374086ba7914391fb9c6e1.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/0a33712a251741dd9ede824f8b379dca.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Boot", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/97bb3ec8c4c44bbcb08a434dccc2d4e1.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Boot", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/41708ff6a9834ea6981ebc728dcf4762.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d0918db7bdc84c0daf741064ec464c8d.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/fc215498863f45df9a5c3cbf9c6ede8e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Badge Exterior", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}], "__typename": "ImageList"}, "priceIndicatorRating": "NOANALYSIS", "priceIndicatorRatingLabel": "", "priceDeviation": null, "mileageDeviation": null, "mileage": {"mileage": 7000, "unit": "MILE", "__typename": "Mileage"}, "plate": "70", "year": 2021, "vehicleCheckId": null, "vehicleCheckStatus": "UNAVAILABLE", "vehicleCheckSummary": {"type": "MISSING", "title": "Unavailable", "performed": null, "writeOffCategory": null, "checks": [], "__typename": "VehicleCheckSummary"}, "sellerName": "BROOKYLNS", "sellerType": "Trade", "sellerProducts": ["APXV", "AT18FINANCECUST", "AT18SELLCUST", "ATCRTLCHK", "ATCVVAL", "ATMOVES", "BOOST", "CODRIVER", "DIGITALRETAIL", "DVID", "FCS", "FPBARGAIN", "FPBONUS", "FPS", "FULLRESERVATIONS", "ISP3", "ISSCUST", "ISS_PRODCAT", "PFIN", "PPI_3_STANDARD", "PROFILE", "RTLCHKPLUS", "STEX", "STOCKMANAGER", "VEHICLELOOKUP", "WATC", "WAV", "WDEW", "WDSV", "WIMT", "WKSP", "WLGE", "WMOS", "WMPS", "WSL"], "sellerLocation": "BROXBOURNE", "sellerLocationDistance": null, "sellerContact": {"phoneNumberOne": "(07537) 164503", "phoneNumberTwo": "(01992) 843067", "protectedNumber": null, "byEmail": true, "__typename": "SellerContact"}, "description": "Brooklyns Motors would like to present to you this 1 of 1 RHD Dodge Ram Truck TRX + Hennessey Engine Up Grade, The MAMMOTH 900 BHP, Specification as follows: TRX Level 2 Equipment Group, Multifunction Heated Steering Wheel with Paddle Shift, Leather + Alcantara + Carbon Fibre Insert, Heads Up Display, Black leather Electric Heated Seats, Ventilated Seats, TRX Embroidaries, Hennessy Embroideries, Interior Carbon Fibre Inlays, Alcantara Finish, Touch Screen Navigation System, Harmon/Kardon Premium Sound, Bluetooth Audio, Bluetooth Phone Prep, Remote-Proximity Keyless Entry, Electric Panoramic Glass Roof, Electric Blind, Privacy Glass, Dual A/c Climate Control, Electric Folding Mirrors, Electric Rear Roll Cover, Electric Mopar Side Steps, MAMMOTH off Road Kit - Custom Front Bumper, Custom Rear Bumper, LED Lights in Front Bumper, LED Centre High Mounted Stop Lamp, Trailer-Tow Group + Light Check + Tyre Monitoring System, Bed Utility Group, 2 x keys, Ghost Security System, Diamond Black Crystal Pearl-Coat Exterior Paint, 20-Inch Hennessy 10 Spoke Saturn Finish Alloys with 35-Inch Off Road Tyres, Competitive Finance Rates available, 10 Months Warranty-Wise Warranty Remaining.", "colour": "Black", "manufacturerApproved": false, "insuranceWriteOffCategory": null, "owners": null, "keys": 2, "vehicleCondition": null, "specification": {"driverPosition": "RHD", "isCrossover": false, "operatingType": null, "emissionClass": null, "co2Emissions": null, "topSpeed": {"topSpeed": null, "__typename": "Speed"}, "minimumKerbWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "endLayout": null, "trailerAxleNumber": null, "bedroomLayout": null, "grossVehicleWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "capacityWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "liftingCapacity": {"weight": null, "unit": null, "__typename": "LiftingCapacity"}, "operatingWidth": {"width": null, "unit": null, "__typename": "OperatingWidth"}, "maxReach": {"length": null, "unit": null, "__typename": "MaxReach"}, "wheelbase": null, "berth": null, "bedrooms": null, "engine": {"power": {"enginePower": 900, "unit": "BHP", "__typename": "Power"}, "sizeLitres": null, "sizeCC": 6, "manufacturerEngineSize": 0, "__typename": "Engine"}, "exteriorWidth": {"width": null, "unit": null, "__typename": "ExteriorWidth"}, "exteriorLength": {"length": null, "unit": null, "__typename": "ExteriorLength"}, "exteriorHeight": {"height": null, "unit": null, "__typename": "ExteriorHeight"}, "capacityWidth": {"width": null, "unit": null, "__typename": "CapacityWidth"}, "capacityLength": {"length": null, "unit": null, "__typename": "CapacityLength"}, "capacityHeight": {"height": null, "unit": null, "__typename": "CapacityHeight"}, "seats": null, "axleConfig": null, "ulezCompliant": false, "doors": 4, "bodyType": "Pickup", "cabType": "Unlisted", "rawBodyType": "Pickup", "fuel": "Petrol", "transmission": "Automatic", "style": null, "subStyle": null, "make": "Dodge", "model": "RAM", "trim": null, "optionalFeatures": null, "standardFeatures": null, "features": [], "battery": null, "techData": null, "annualTax": {"standardRate": 195, "__typename": "AnnualTax"}, "oemDrivetrain": null, "bikeLicenceType": null, "derivativeId": null, "frameSizeCM": null, "frameMaterial": null, "frameStyle": null, "suspensionType": null, "gearShifter": null, "brakeType": null, "motorMake": null, "chargeTimeMinutes": null, "numberOfGears": null, "tyreDiameterInches": null, "driveTrain": null, "torque": null, "range": null, "interiorDescription": "Black interior colour", "exteriorDescription": "Black exterior colour", "__typename": "Specification"}, "stockType": "physical-stock", "condition": "Used", "finance": null, "locationArea": null, "reservation": {"status": null, "eligibility": "ELIGIBLE", "feeCurrency": "GBP", "feeInFractionalUnits": 9900, "__typename": "AdvertReservation"}, "__typename": "Advert"}
2026-03-30 15:15:22 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:15:22 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 78eecaa6-b287-5a17-9e67-52f51bab104a with identifier: 202508185538805
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 78eecaa6-b287-5a17-9e67-52f51bab104a
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F65ca751b433f42718b54d2cacc88fdd2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/65ca751b433f42718b54d2cacc88fdd2.jpg already downloaded
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F62488675de8d405c8937cc5a6d541c40.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/62488675de8d405c8937cc5a6d541c40.jpg already downloaded
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe36e7daac1144902be3b26a97a7ca8f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e36e7daac1144902be3b26a97a7ca8f5.jpg already downloaded
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff985fb43ed68450f9feee54e734e5ae3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f985fb43ed68450f9feee54e734e5ae3.jpg already downloaded
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd0dfb12d4bbe420aa9fc9d2ccb2bf302.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d0dfb12d4bbe420aa9fc9d2ccb2bf302.jpg already downloaded
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd0fa54aecd2a4acabc27b19e3684812a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d0fa54aecd2a4acabc27b19e3684812a.jpg already downloaded
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2eac123cc6444a968fdec39c0e6c54e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2eac123cc6444a968fdec39c0e6c54e2.jpg already downloaded
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffc4add8ebb9941668ce6049f9e86b36e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fc4add8ebb9941668ce6049f9e86b36e.jpg already downloaded
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8ebd4d90d8ec431e8d6b8150dd1f09a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8ebd4d90d8ec431e8d6b8150dd1f09a5.jpg already downloaded
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd3d00205da8c467bb12046fde8bb23fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d3d00205da8c467bb12046fde8bb23fd.jpg already downloaded
2026-03-30 15:15:22 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 78eecaa6-b287-5a17-9e67-52f51bab104a with identifier 202508185538805
2026-03-30 15:15:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:22 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 78eecaa6-b287-5a17-9e67-52f51bab104a
2026-03-30 15:15:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'color': 'Black',
'currency': 'GBP',
'description': 'Brooklyns Motors would like to present to you this 1 of 1 RHD '
'Dodge Ram Truck TRX + Hennessey Engine Up Grade, The MAMMOTH '
'900 BHP, Specification as follows: TRX Level 2 Equipment '
'Group, Multifunction Heated Steering Wheel with Paddle Shift, '
'Leather + Alcantara + Carbon Fibre Insert, Heads Up Display, '
'Black leather Electric Heated Seats, Ventilated Seats, TRX '
'Embroidaries, Hennessy Embroideries, Interior Carbon Fibre '
'Inlays, Alcantara Finish, Touch Screen Navigation System, '
'Harmon/Kardon Premium Sound, Bluetooth Audio, Bluetooth Phone '
'Prep, Remote-Proximity Keyless Entry, Electric Panoramic '
'Glass Roof, Electric Blind, Privacy Glass, Dual A/c Climate '
'Control, Electric Folding Mirrors, Electric Rear Roll Cover, '
'Electric Mopar Side Steps, MAMMOTH off Road Kit - Custom '
'Front Bumper, Custom Rear Bumper, LED Lights in Front Bumper, '
'LED Centre High Mounted Stop Lamp, Trailer-Tow Group + Light '
'Check + Tyre Monitoring System, Bed Utility Group, 2 x keys, '
'Ghost Security System, Diamond Black Crystal Pearl-Coat '
'Exterior Paint, 20-Inch Hennessy 10 Spoke Saturn Finish '
'Alloys with 35-Inch Off Road Tyres, Competitive Finance Rates '
'available, 10 Months Warranty-Wise Warranty Remaining.',
'doors_number': 4,
'engine_horse_power': 900,
'fuel_type': 'Petrol',
'id': '78eecaa6-b287-5a17-9e67-52f51bab104a',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202508185538805',
'listing': 'directbuy',
'location': 'Broxbourne, Hertfordshire',
'make': 'Dodge',
'model': 'RAM',
'odometer': 7000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 62,
'photo_urls': ['https://m.atcdn.co.uk/a/media/65ca751b433f42718b54d2cacc88fdd2.jpg',
'https://m.atcdn.co.uk/a/media/62488675de8d405c8937cc5a6d541c40.jpg',
'https://m.atcdn.co.uk/a/media/e36e7daac1144902be3b26a97a7ca8f5.jpg',
'https://m.atcdn.co.uk/a/media/f985fb43ed68450f9feee54e734e5ae3.jpg',
'https://m.atcdn.co.uk/a/media/d0dfb12d4bbe420aa9fc9d2ccb2bf302.jpg',
'https://m.atcdn.co.uk/a/media/d0fa54aecd2a4acabc27b19e3684812a.jpg',
'https://m.atcdn.co.uk/a/media/2eac123cc6444a968fdec39c0e6c54e2.jpg',
'https://m.atcdn.co.uk/a/media/fc4add8ebb9941668ce6049f9e86b36e.jpg',
'https://m.atcdn.co.uk/a/media/8ebd4d90d8ec431e8d6b8150dd1f09a5.jpg',
'https://m.atcdn.co.uk/a/media/d3d00205da8c467bb12046fde8bb23fd.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78eecaa6-b287-5a17-9e67-52f51bab104a/78eecaa6-b287-5a17-9e67-52f51bab104a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 159090,
'Height': 801,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/65ca751b433f42718b54d2cacc88fdd2.jpg',
'Width': 1125},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78eecaa6-b287-5a17-9e67-52f51bab104a/78eecaa6-b287-5a17-9e67-52f51bab104a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 625804,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/62488675de8d405c8937cc5a6d541c40.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78eecaa6-b287-5a17-9e67-52f51bab104a/78eecaa6-b287-5a17-9e67-52f51bab104a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 619188,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e36e7daac1144902be3b26a97a7ca8f5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78eecaa6-b287-5a17-9e67-52f51bab104a/78eecaa6-b287-5a17-9e67-52f51bab104a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 576770,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f985fb43ed68450f9feee54e734e5ae3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78eecaa6-b287-5a17-9e67-52f51bab104a/78eecaa6-b287-5a17-9e67-52f51bab104a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 546326,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d0dfb12d4bbe420aa9fc9d2ccb2bf302.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78eecaa6-b287-5a17-9e67-52f51bab104a/78eecaa6-b287-5a17-9e67-52f51bab104a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320318,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d0fa54aecd2a4acabc27b19e3684812a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78eecaa6-b287-5a17-9e67-52f51bab104a/78eecaa6-b287-5a17-9e67-52f51bab104a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 149716,
'Height': 713,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2eac123cc6444a968fdec39c0e6c54e2.jpg',
'Width': 1013},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78eecaa6-b287-5a17-9e67-52f51bab104a/78eecaa6-b287-5a17-9e67-52f51bab104a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 419496,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fc4add8ebb9941668ce6049f9e86b36e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78eecaa6-b287-5a17-9e67-52f51bab104a/78eecaa6-b287-5a17-9e67-52f51bab104a_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 414958,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8ebd4d90d8ec431e8d6b8150dd1f09a5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78eecaa6-b287-5a17-9e67-52f51bab104a/78eecaa6-b287-5a17-9e67-52f51bab104a_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 462669,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d3d00205da8c467bb12046fde8bb23fd.jpg',
'Width': 2048}],
'price': 149989,
'price_includes_vat': True,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'Dodge RAM 1500 AWD TRX Hennessey Mammoth 900 6.0 4dr',
'transmission': 'automatic',
'year': 2021}
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508185538805%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [auto_selling_autotrader.co.uk] INFO: Saving data for 202508185538805: {'created_time': 1774883722.949487, 'last_price_update_time': 1774883722.949498}
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202508185538805') HTTP/1.1" 204 0
2026-03-30 15:15:22 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:15:22 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ddd3c26a-d1b3-580b-a78a-ada5fdd626cc with identifier: 202506243810554
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ddd3c26a-d1b3-580b-a78a-ada5fdd626cc
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F11c11a48969f4642a7c79369cf18bd5a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/11c11a48969f4642a7c79369cf18bd5a.jpg already downloaded
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F98d51b59897545d9b1590390e444c0be.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/98d51b59897545d9b1590390e444c0be.jpg already downloaded
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2fbd1173e71a4b9994f3e82350f9e372.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2fbd1173e71a4b9994f3e82350f9e372.jpg already downloaded
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F654b2ffdadb4411dbae6a1aa9574eccf.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/654b2ffdadb4411dbae6a1aa9574eccf.jpg already downloaded
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6bca3c87e0ee4ebebf125021c57cfe49.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6bca3c87e0ee4ebebf125021c57cfe49.jpg already downloaded
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa57493fb9de044ca801c75561632b490.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a57493fb9de044ca801c75561632b490.jpg already downloaded
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0a5b545bfd6740cf9aeaf34369425e36.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0a5b545bfd6740cf9aeaf34369425e36.jpg already downloaded
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd3f82a35d1a34d8bb2a018f4fe0e4e10.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d3f82a35d1a34d8bb2a018f4fe0e4e10.jpg already downloaded
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F52d4c04c53474b08b3d5af86b3d36b54.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/52d4c04c53474b08b3d5af86b3d36b54.jpg already downloaded
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5943163b616e4d75a407beee7da72142.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5943163b616e4d75a407beee7da72142.jpg already downloaded
2026-03-30 15:15:23 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ddd3c26a-d1b3-580b-a78a-ada5fdd626cc with identifier 202506243810554
2026-03-30 15:15:23 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:23 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:23 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ddd3c26a-d1b3-580b-a78a-ada5fdd626cc
2026-03-30 15:15:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 310,
'color': 'Grey',
'currency': 'GBP',
'description': 'Brooklyns Motors would like to present to you this absolutely '
'stunning Audi R8 V10 Spyder S Tronic Quattro, Finished in '
'this rear Colour Susuzki Grey, This Vehicle has a Full Audi '
'Manufactures Service History, Recently Service By Audi '
'Hatfield with no expense Spared, Specification as Follows: '
'Audi MMI Navigation System, Bluetooth Phone Prep, Bluetooth '
'Audio, Bang & Olufsen Surround Sound, DAB Radio, Usb Port, '
'Aux-in, Electric Heated Nappa Leather, Cross Stitch Seats '
'with White Stitching, Multifunction Steering Wheel, Paddle '
'Shift, Electric Folding Mirrors, Power Soft Top with Wind '
'Deflector & Electric Rear Glass, Dual A/c Climate Control, '
'Auto Lights, Led Xenon Lights, Adaptive Rear Spoiler, '
"Magnetic Ride, Sports Button, Sports Exhaust, 2x Keys, 19'' y "
'Spoke Alloys finished in Saturn Black, Competitive Finance '
'Rates Available Warranty information on Request.',
'doors_number': 2,
'emission_standard': 'Euro 5',
'engine': '5.2L',
'engine_horse_power': 518,
'fuel_type': 'Petrol',
'id': 'ddd3c26a-d1b3-580b-a78a-ada5fdd626cc',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202506243810554',
'listing': 'directbuy',
'location': 'Broxbourne, Hertfordshire',
'make': 'Audi',
'model': 'R8',
'odometer': 34000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photo_urls': ['https://m.atcdn.co.uk/a/media/11c11a48969f4642a7c79369cf18bd5a.jpg',
'https://m.atcdn.co.uk/a/media/98d51b59897545d9b1590390e444c0be.jpg',
'https://m.atcdn.co.uk/a/media/2fbd1173e71a4b9994f3e82350f9e372.jpg',
'https://m.atcdn.co.uk/a/media/654b2ffdadb4411dbae6a1aa9574eccf.jpg',
'https://m.atcdn.co.uk/a/media/6bca3c87e0ee4ebebf125021c57cfe49.jpg',
'https://m.atcdn.co.uk/a/media/a57493fb9de044ca801c75561632b490.jpg',
'https://m.atcdn.co.uk/a/media/0a5b545bfd6740cf9aeaf34369425e36.jpg',
'https://m.atcdn.co.uk/a/media/d3f82a35d1a34d8bb2a018f4fe0e4e10.jpg',
'https://m.atcdn.co.uk/a/media/52d4c04c53474b08b3d5af86b3d36b54.jpg',
'https://m.atcdn.co.uk/a/media/5943163b616e4d75a407beee7da72142.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddd3c26a-d1b3-580b-a78a-ada5fdd626cc/ddd3c26a-d1b3-580b-a78a-ada5fdd626cc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 594159,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/11c11a48969f4642a7c79369cf18bd5a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddd3c26a-d1b3-580b-a78a-ada5fdd626cc/ddd3c26a-d1b3-580b-a78a-ada5fdd626cc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 646138,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/98d51b59897545d9b1590390e444c0be.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddd3c26a-d1b3-580b-a78a-ada5fdd626cc/ddd3c26a-d1b3-580b-a78a-ada5fdd626cc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 711264,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2fbd1173e71a4b9994f3e82350f9e372.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddd3c26a-d1b3-580b-a78a-ada5fdd626cc/ddd3c26a-d1b3-580b-a78a-ada5fdd626cc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 719427,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/654b2ffdadb4411dbae6a1aa9574eccf.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddd3c26a-d1b3-580b-a78a-ada5fdd626cc/ddd3c26a-d1b3-580b-a78a-ada5fdd626cc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 515774,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6bca3c87e0ee4ebebf125021c57cfe49.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddd3c26a-d1b3-580b-a78a-ada5fdd626cc/ddd3c26a-d1b3-580b-a78a-ada5fdd626cc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 620146,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a57493fb9de044ca801c75561632b490.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddd3c26a-d1b3-580b-a78a-ada5fdd626cc/ddd3c26a-d1b3-580b-a78a-ada5fdd626cc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 469519,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0a5b545bfd6740cf9aeaf34369425e36.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddd3c26a-d1b3-580b-a78a-ada5fdd626cc/ddd3c26a-d1b3-580b-a78a-ada5fdd626cc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 543335,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d3f82a35d1a34d8bb2a018f4fe0e4e10.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddd3c26a-d1b3-580b-a78a-ada5fdd626cc/ddd3c26a-d1b3-580b-a78a-ada5fdd626cc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 454046,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/52d4c04c53474b08b3d5af86b3d36b54.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddd3c26a-d1b3-580b-a78a-ada5fdd626cc/ddd3c26a-d1b3-580b-a78a-ada5fdd626cc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 372358,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5943163b616e4d75a407beee7da72142.jpg',
'Width': 2048}],
'price': 55800,
'price_includes_vat': True,
'registration_date': '2015-04-01',
'seats_number': 2,
'seller_name': None,
'title': 'Audi R8 5.2 FSI V10 Spyder S Tronic quattro Euro 5 2dr',
'transmission': 'automatic',
'year': 2015}
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202506243810554%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [auto_selling_autotrader.co.uk] INFO: Saving data for 202506243810554: {'created_time': 1774883723.18463, 'last_price_update_time': 1774883723.184642}
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202506243810554') HTTP/1.1" 204 0
2026-03-30 15:15:23 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:15:23 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: f7a06361-6f24-597f-8e48-bbcffd3d01e9 with identifier: 202504111246555
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f7a06361-6f24-597f-8e48-bbcffd3d01e9
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0536acee5ab04dbe895102cb4eaec7ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0536acee5ab04dbe895102cb4eaec7ab.jpg already downloaded
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F51a863d6e4174cec87cf472d3bc8cffc.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/51a863d6e4174cec87cf472d3bc8cffc.jpg already downloaded
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc1f278e507fb4fbaa8184067a1ad8a30.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c1f278e507fb4fbaa8184067a1ad8a30.jpg already downloaded
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2b2379a7aa174abe9cbaf3abde676393.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2b2379a7aa174abe9cbaf3abde676393.jpg already downloaded
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Faa2e81cba13b460ea6c3ba58d3d1a623.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/aa2e81cba13b460ea6c3ba58d3d1a623.jpg already downloaded
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb194cdeeb0b947f9aeeedc80b4293b86.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b194cdeeb0b947f9aeeedc80b4293b86.jpg already downloaded
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdf020fc13b314d7cbf9b343f3e5427be.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/df020fc13b314d7cbf9b343f3e5427be.jpg already downloaded
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe61a061e199b494d9a13f8d42193bf55.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e61a061e199b494d9a13f8d42193bf55.jpg already downloaded
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd947958138d4421d89289d95dbd60e8a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d947958138d4421d89289d95dbd60e8a.jpg already downloaded
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F050107dda5b34d04ae6d2a28ea7ba82a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/050107dda5b34d04ae6d2a28ea7ba82a.jpg already downloaded
2026-03-30 15:15:23 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: f7a06361-6f24-597f-8e48-bbcffd3d01e9 with identifier 202504111246555
2026-03-30 15:15:23 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:23 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:23 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item f7a06361-6f24-597f-8e48-bbcffd3d01e9
2026-03-30 15:15:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'Red',
'currency': 'GBP',
'description': 'Brooklyns Motors would like to present this very high '
'specification Tesla Model S 75D Dual Motor AWD, 3 Stage '
'Multi-Coat Red (PPMR) with upgraded Ultra White Interior, '
'Enhanced Autopilot with Auto Steer, Auto Lane Change, Auto '
'Summon, Auto Park and Navigate on AutoPilot, Carbon Fibre '
'Décor, Sub Zero Cold Weather Pack with Heated Seats all '
'around, Heated Steering Wheel and Wipers, Bio-Defense Mode, '
'Premium Connectivity, Bluetooth Connectivity, Bluetooth phone '
'prep, Panoramic glass roof, CCS charging Upgrade, Premium '
'white electric leather seats, Wireless Phone Charging Dock, '
'Battery and Drive Unit Warranty until 28/09/2025 19" '
'Slipstream Alloys, Centre Arm Rest with sliding Rest for cup '
'holders, 2x keys, 1 Owner vehicle, Competitive Finance Rates '
'Available, Warranty Information on Request., Red, 1 owner, '
'£17,447',
'doors_number': 5,
'engine_horse_power': 328,
'fuel_type': 'Electric',
'id': 'f7a06361-6f24-597f-8e48-bbcffd3d01e9',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202504111246555',
'listing': 'directbuy',
'location': 'Broxbourne, Hertfordshire',
'make': 'Tesla',
'model': 'Model S',
'odometer': 82000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 37,
'photo_urls': ['https://m.atcdn.co.uk/a/media/0536acee5ab04dbe895102cb4eaec7ab.jpg',
'https://m.atcdn.co.uk/a/media/51a863d6e4174cec87cf472d3bc8cffc.jpg',
'https://m.atcdn.co.uk/a/media/c1f278e507fb4fbaa8184067a1ad8a30.jpg',
'https://m.atcdn.co.uk/a/media/2b2379a7aa174abe9cbaf3abde676393.jpg',
'https://m.atcdn.co.uk/a/media/aa2e81cba13b460ea6c3ba58d3d1a623.jpg',
'https://m.atcdn.co.uk/a/media/b194cdeeb0b947f9aeeedc80b4293b86.jpg',
'https://m.atcdn.co.uk/a/media/df020fc13b314d7cbf9b343f3e5427be.jpg',
'https://m.atcdn.co.uk/a/media/e61a061e199b494d9a13f8d42193bf55.jpg',
'https://m.atcdn.co.uk/a/media/d947958138d4421d89289d95dbd60e8a.jpg',
'https://m.atcdn.co.uk/a/media/050107dda5b34d04ae6d2a28ea7ba82a.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7a06361-6f24-597f-8e48-bbcffd3d01e9/f7a06361-6f24-597f-8e48-bbcffd3d01e9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 609589,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0536acee5ab04dbe895102cb4eaec7ab.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7a06361-6f24-597f-8e48-bbcffd3d01e9/f7a06361-6f24-597f-8e48-bbcffd3d01e9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 662713,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/51a863d6e4174cec87cf472d3bc8cffc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7a06361-6f24-597f-8e48-bbcffd3d01e9/f7a06361-6f24-597f-8e48-bbcffd3d01e9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 670336,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c1f278e507fb4fbaa8184067a1ad8a30.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7a06361-6f24-597f-8e48-bbcffd3d01e9/f7a06361-6f24-597f-8e48-bbcffd3d01e9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 666944,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2b2379a7aa174abe9cbaf3abde676393.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7a06361-6f24-597f-8e48-bbcffd3d01e9/f7a06361-6f24-597f-8e48-bbcffd3d01e9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 384340,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/aa2e81cba13b460ea6c3ba58d3d1a623.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7a06361-6f24-597f-8e48-bbcffd3d01e9/f7a06361-6f24-597f-8e48-bbcffd3d01e9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 523161,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b194cdeeb0b947f9aeeedc80b4293b86.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7a06361-6f24-597f-8e48-bbcffd3d01e9/f7a06361-6f24-597f-8e48-bbcffd3d01e9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 530821,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/df020fc13b314d7cbf9b343f3e5427be.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7a06361-6f24-597f-8e48-bbcffd3d01e9/f7a06361-6f24-597f-8e48-bbcffd3d01e9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 464975,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e61a061e199b494d9a13f8d42193bf55.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7a06361-6f24-597f-8e48-bbcffd3d01e9/f7a06361-6f24-597f-8e48-bbcffd3d01e9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 476710,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d947958138d4421d89289d95dbd60e8a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7a06361-6f24-597f-8e48-bbcffd3d01e9/f7a06361-6f24-597f-8e48-bbcffd3d01e9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 663047,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/050107dda5b34d04ae6d2a28ea7ba82a.jpg',
'Width': 2048}],
'price': 18000,
'price_includes_vat': True,
'registration_date': '2017-09-27',
'seats_number': 5,
'seller_name': None,
'title': 'Tesla Model S 75D (Dual Motor) Auto 4WD 5dr',
'transmission': 'automatic',
'year': 2017}
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202504111246555%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [auto_selling_autotrader.co.uk] INFO: Saving data for 202504111246555: {'created_time': 1774883723.412003, 'last_price_update_time': 1774883723.412013}
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202504111246555') HTTP/1.1" 204 0
2026-03-30 15:15:23 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:15:23 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: f7005b86-d854-5234-8457-6d74e2e5490f with identifier: 202412167310859
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f7005b86-d854-5234-8457-6d74e2e5490f
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd684fdbbbbaf42cb91dd24370eb77961.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d684fdbbbbaf42cb91dd24370eb77961.jpg already downloaded
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe238058a557240b0ac5d872457999b0d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e238058a557240b0ac5d872457999b0d.jpg already downloaded
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc46665855474458a96e3bcca97215dfb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c46665855474458a96e3bcca97215dfb.jpg already downloaded
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff96dd6ed083c4ef29c7bbdd9cf406c5f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f96dd6ed083c4ef29c7bbdd9cf406c5f.jpg already downloaded
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9e4c405fcc294484a52859386e0a96e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9e4c405fcc294484a52859386e0a96e7.jpg already downloaded
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F175ecda3f4b1420580e9065c8d2e4de7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/175ecda3f4b1420580e9065c8d2e4de7.jpg already downloaded
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F93d1eb07873f4da1b9e5868aeab1cdd2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/93d1eb07873f4da1b9e5868aeab1cdd2.jpg already downloaded
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F274818064ada4100872477ffbb381506.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/274818064ada4100872477ffbb381506.jpg already downloaded
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F927c8483ac0945a18b77cc7cb9358dba.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/927c8483ac0945a18b77cc7cb9358dba.jpg already downloaded
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4082dafba9de499a8d5d86f05de82d67.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4082dafba9de499a8d5d86f05de82d67.jpg already downloaded
2026-03-30 15:15:23 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: f7005b86-d854-5234-8457-6d74e2e5490f with identifier 202412167310859
2026-03-30 15:15:23 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:23 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:23 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item f7005b86-d854-5234-8457-6d74e2e5490f
2026-03-30 15:15:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'Red',
'currency': 'GBP',
'description': 'Brooklyns Motors would like to present this very high '
'specification 6 seater Tesla Model X, 3 Stage Multi-Coat Red '
'(PPMR), Autopilot, Sub Zero Cold Weather Pack with Heated '
'Seats all around, Heated Steering Wheel and Wipers, MCU2 '
'Netflix, Youtube & Disney+ Channel, Premium Upgrades Package, '
'Bio-Defense Mode, Premium Connectivity, Bluetooth '
'Connectivity, Bluetooth phone prep, Smart Air Suspension with '
'location memory, CCS charging Upgrade, Premium cream electric '
'leather seats, Wireless Phone Charging Dock, Battery and '
'Drive Unit Warranty until 23/03/2029, 19" Turbine Alloys '
'Satin Black, Centre Arm Rest with sliding Rest for cup '
'holders, Ambient lighting, 2x keys, 1 Owner vehicle, Full '
'Tesla Service History, Competitive Finance Rates Available, '
'Warranty Information on Request.',
'doors_number': 5,
'engine_horse_power': 417,
'fuel_type': 'Electric',
'id': 'f7005b86-d854-5234-8457-6d74e2e5490f',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202412167310859',
'listing': 'directbuy',
'location': 'Broxbourne, Hertfordshire',
'make': 'Tesla',
'model': 'Model X',
'odometer': 69000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 33,
'photo_urls': ['https://m.atcdn.co.uk/a/media/d684fdbbbbaf42cb91dd24370eb77961.jpg',
'https://m.atcdn.co.uk/a/media/e238058a557240b0ac5d872457999b0d.jpg',
'https://m.atcdn.co.uk/a/media/c46665855474458a96e3bcca97215dfb.jpg',
'https://m.atcdn.co.uk/a/media/f96dd6ed083c4ef29c7bbdd9cf406c5f.jpg',
'https://m.atcdn.co.uk/a/media/9e4c405fcc294484a52859386e0a96e7.jpg',
'https://m.atcdn.co.uk/a/media/175ecda3f4b1420580e9065c8d2e4de7.jpg',
'https://m.atcdn.co.uk/a/media/93d1eb07873f4da1b9e5868aeab1cdd2.jpg',
'https://m.atcdn.co.uk/a/media/274818064ada4100872477ffbb381506.jpg',
'https://m.atcdn.co.uk/a/media/927c8483ac0945a18b77cc7cb9358dba.jpg',
'https://m.atcdn.co.uk/a/media/4082dafba9de499a8d5d86f05de82d67.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7005b86-d854-5234-8457-6d74e2e5490f/f7005b86-d854-5234-8457-6d74e2e5490f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 626793,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d684fdbbbbaf42cb91dd24370eb77961.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7005b86-d854-5234-8457-6d74e2e5490f/f7005b86-d854-5234-8457-6d74e2e5490f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 699494,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e238058a557240b0ac5d872457999b0d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7005b86-d854-5234-8457-6d74e2e5490f/f7005b86-d854-5234-8457-6d74e2e5490f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 649576,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c46665855474458a96e3bcca97215dfb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7005b86-d854-5234-8457-6d74e2e5490f/f7005b86-d854-5234-8457-6d74e2e5490f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 683529,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f96dd6ed083c4ef29c7bbdd9cf406c5f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7005b86-d854-5234-8457-6d74e2e5490f/f7005b86-d854-5234-8457-6d74e2e5490f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 558895,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9e4c405fcc294484a52859386e0a96e7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7005b86-d854-5234-8457-6d74e2e5490f/f7005b86-d854-5234-8457-6d74e2e5490f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 589752,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/175ecda3f4b1420580e9065c8d2e4de7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7005b86-d854-5234-8457-6d74e2e5490f/f7005b86-d854-5234-8457-6d74e2e5490f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 652355,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/93d1eb07873f4da1b9e5868aeab1cdd2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7005b86-d854-5234-8457-6d74e2e5490f/f7005b86-d854-5234-8457-6d74e2e5490f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 561994,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/274818064ada4100872477ffbb381506.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7005b86-d854-5234-8457-6d74e2e5490f/f7005b86-d854-5234-8457-6d74e2e5490f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 589264,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/927c8483ac0945a18b77cc7cb9358dba.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7005b86-d854-5234-8457-6d74e2e5490f/f7005b86-d854-5234-8457-6d74e2e5490f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 399535,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4082dafba9de499a8d5d86f05de82d67.jpg',
'Width': 2048}],
'price': 36000,
'price_includes_vat': True,
'registration_date': '2021-01-28',
'seats_number': 6,
'seller_name': None,
'title': 'Tesla Model X (Dual Motor) Long Range Plus Auto 4WDE 5dr',
'transmission': 'automatic',
'trim': 'Long Range Plus',
'year': 2021}
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202412167310859%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [auto_selling_autotrader.co.uk] INFO: Saving data for 202412167310859: {'created_time': 1774883723.698511, 'last_price_update_time': 1774883723.698522}
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202412167310859') HTTP/1.1" 204 0
2026-03-30 15:15:23 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:15:23 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c with identifier: 202303235539990
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa81012abfd7646229371fb3f56406bf3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a81012abfd7646229371fb3f56406bf3.jpg already downloaded
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F95a267d0858d4eddaeb7fed71297fe68.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/95a267d0858d4eddaeb7fed71297fe68.jpg already downloaded
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe20682f050314b458b0aa918d9e0a5ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e20682f050314b458b0aa918d9e0a5ff.jpg already downloaded
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F56bf0920cf1b41fcbbe9946d1d1ee645.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/56bf0920cf1b41fcbbe9946d1d1ee645.jpg already downloaded
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1434a38be63a499283ae9b79f45496a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1434a38be63a499283ae9b79f45496a3.jpg already downloaded
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F88e869ef26ed44f9a360f978361cc6ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/88e869ef26ed44f9a360f978361cc6ee.jpg already downloaded
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F39c8d5f0e9c34e02b1993cab33da226b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/39c8d5f0e9c34e02b1993cab33da226b.jpg already downloaded
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F33c545c5ba8f4308a6105d3018cc28c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/33c545c5ba8f4308a6105d3018cc28c4.jpg already downloaded
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F908172752934456c90a90b54200117ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/908172752934456c90a90b54200117ca.jpg already downloaded
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0f5d7c1e76b04c1b8162ddc5e39ee5fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0f5d7c1e76b04c1b8162ddc5e39ee5fd.jpg already downloaded
2026-03-30 15:15:23 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c with identifier 202303235539990
2026-03-30 15:15:23 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:23 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:23 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c
2026-03-30 15:15:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 262,
'color': 'Blue',
'currency': 'GBP',
'description': 'Vat Qualifying Vehicle | Interior Carbon Fibre Package | '
'Carbon Engine Cover | Suspension Lifter System| High Premium '
'Sound System | 20" Birdcage Diamond Cut Dark Miron Finish | '
'Carbon Macrotwill Trim | Alcantara Steering Wheel With Carbon '
'Fibre | E-LSD Transmission | Home Link | Remote Garage Opener '
'| 6 Way Power Sport Seats | Active Shift Paddles in Carbon | '
'Carbon Fibre Cluster Cap | Rear Parking Camera With Dynamic '
'Guide Lines | FibreGlass Hood | Cruise Control | Heated Front '
'Seats | Specific Side View Mirrors | Extended Alcantara '
'Interior Laser Effect | Carbon Door Sills | Carbon Ceramic '
'Brakes | Blue Brake Calipers | Rear Electronic Differential | '
'Cyber Security Gateway | VAT Qualifying Vehicle | Jan 2022 '
'Registered Vehicle | Manufactures Warranty Until 2025 | 1st '
'Service Recently Carried Out by Maserati | 1 Owner Vehicle | '
'2x Keys | Competitive Finance Rates Available.',
'doors_number': 2,
'emission_standard': 'Euro 6',
'engine': '3L',
'engine_horse_power': 621,
'fuel_type': 'Petrol',
'id': '10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202303235539990',
'listing': 'directbuy',
'location': 'Broxbourne, Hertfordshire',
'make': 'Maserati',
'model': 'MC20',
'odometer': 1000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 32,
'photo_urls': ['https://m.atcdn.co.uk/a/media/a81012abfd7646229371fb3f56406bf3.jpg',
'https://m.atcdn.co.uk/a/media/95a267d0858d4eddaeb7fed71297fe68.jpg',
'https://m.atcdn.co.uk/a/media/e20682f050314b458b0aa918d9e0a5ff.jpg',
'https://m.atcdn.co.uk/a/media/56bf0920cf1b41fcbbe9946d1d1ee645.jpg',
'https://m.atcdn.co.uk/a/media/1434a38be63a499283ae9b79f45496a3.jpg',
'https://m.atcdn.co.uk/a/media/88e869ef26ed44f9a360f978361cc6ee.jpg',
'https://m.atcdn.co.uk/a/media/39c8d5f0e9c34e02b1993cab33da226b.jpg',
'https://m.atcdn.co.uk/a/media/33c545c5ba8f4308a6105d3018cc28c4.jpg',
'https://m.atcdn.co.uk/a/media/908172752934456c90a90b54200117ca.jpg',
'https://m.atcdn.co.uk/a/media/0f5d7c1e76b04c1b8162ddc5e39ee5fd.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c/10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 646360,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a81012abfd7646229371fb3f56406bf3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c/10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 786621,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/95a267d0858d4eddaeb7fed71297fe68.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c/10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 884410,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e20682f050314b458b0aa918d9e0a5ff.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c/10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 918899,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/56bf0920cf1b41fcbbe9946d1d1ee645.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c/10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 574565,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1434a38be63a499283ae9b79f45496a3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c/10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 697605,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/88e869ef26ed44f9a360f978361cc6ee.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c/10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 593567,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/39c8d5f0e9c34e02b1993cab33da226b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c/10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 615777,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/33c545c5ba8f4308a6105d3018cc28c4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c/10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 552189,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/908172752934456c90a90b54200117ca.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c/10a2a1c9-2ec1-5bc9-8d55-b737c20b7a9c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 646925,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0f5d7c1e76b04c1b8162ddc5e39ee5fd.jpg',
'Width': 2048}],
'price': 155000,
'price_includes_vat': True,
'registration_date': '2022-01-05',
'seats_number': 2,
'seller_name': None,
'title': 'Maserati MC20 3.0 V6 DCT Euro 6 (s/s) 2dr',
'transmission': 'automatic',
'year': 2022}
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202303235539990%27 HTTP/1.1" 200 None
2026-03-30 15:15:23 [auto_selling_autotrader.co.uk] INFO: Saving data for 202303235539990: {'created_time': 1774883723.9094, 'last_price_update_time': 1774883723.909411}
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202303235539990') HTTP/1.1" 204 0
2026-03-30 15:15:23 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 15:15:23 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close cursor: 'SaveToCdlqDbAutoSelling' object has no attribute 'cursor'
2026-03-30 15:15:23 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close connection: 'SaveToCdlqDbAutoSelling' object has no attribute 'conn'
2026-03-30 15:15:23 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:23 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:23 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process scrape complete CloudEvent for item 4ad108d42c1f11f18e133aacc95538c6
2026-03-30 15:15:23 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:15:23 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:15:23 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:15:23 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:15:23 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:15:23 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.MAPPED: 3> -> <SessionState.END_SENT: 4>
2026-03-30 15:15:23 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPENED: 9> -> <ConnectionState.CLOSE_SENT: 11>
2026-03-30 15:15:23 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.CLOSE_SENT: 11> -> <ConnectionState.END: 13>
2026-03-30 15:15:23 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.END_SENT: 4> -> <SessionState.DISCARDING: 6>
2026-03-30 15:15:23 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:15:23 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:15:23 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:15:23 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:15:23 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:15:23 [azure.servicebus._pyamqp._transport] DEBUG: Transport endpoint is already disconnected: OSError(107, 'Transport endpoint is not connected')
2026-03-30 15:15:24 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: [AzureBusPipeline] connection closed
2026-03-30 15:15:24 [auto_selling_autotrader.co.uk] INFO: auto_selling_autotrader.co.uk Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 9, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2026-03-30 15:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20last_price_update_time%20lt%201773587724 HTTP/1.1" 200 None
2026-03-30 15:15:25 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (9 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto_selling_autotrader.co.uk/4ad108d42c1f11f18e133aacc95538c6.jl
2026-03-30 15:15:25 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 71822,
'downloader/request_count': 2,
'downloader/request_method_count/POST': 2,
'downloader/response_bytes': 393822,
'downloader/response_count': 2,
'downloader/response_status_count/200': 2,
'elapsed_time_seconds': 12.201739,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 30, 15, 15, 24, 963241, tzinfo=datetime.timezone.utc),
'item_scraped_count': 9,
'log_count/DEBUG': 298,
'log_count/ERROR': 2,
'log_count/INFO': 205,
'memusage/max': 149487616,
'memusage/startup': 149487616,
'request_depth_max': 1,
'response_received_count': 2,
'scheduler/dequeued': 2,
'scheduler/dequeued/memory': 2,
'scheduler/enqueued': 2,
'scheduler/enqueued/memory': 2,
'scrape_type/new': 9,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 2,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 1.2422172240912914,
'scrapy-zyte-api/mean_response_seconds': 1.373922634869814,
'scrapy-zyte-api/processed': 2,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 2,
'scrapy-zyte-api/request_args/experimental.requestCookies': 1,
'scrapy-zyte-api/request_args/experimental.responseCookies': 2,
'scrapy-zyte-api/request_args/httpRequestBody': 2,
'scrapy-zyte-api/request_args/httpRequestMethod': 2,
'scrapy-zyte-api/request_args/httpResponseBody': 2,
'scrapy-zyte-api/request_args/httpResponseHeaders': 2,
'scrapy-zyte-api/request_args/url': 2,
'scrapy-zyte-api/status_codes/200': 2,
'scrapy-zyte-api/success': 2,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'start_time': datetime.datetime(2026, 3, 30, 15, 15, 12, 761502, tzinfo=datetime.timezone.utc)}
2026-03-30 15:15:25 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-30 15:15:25 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fcbdfb60490>
2026-03-30 15:15:25 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fcbdf54ff10>
PROJECT (sourcing_v2)
SPIDER (auto_selling_autotrader.co.uk)