2026-03-26 14:20:39 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-26 14:20:39 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-26 14:20:39 [auto_selling_autotrader.co.uk] INFO: Starting auto_selling_autotrader.co.uk spider
2026-03-26 14:20:39 [auto_selling_autotrader.co.uk] INFO: Quick mode enabled: batching detail requests in groups of 10
2026-03-26 14:20:39 [auto_selling_autotrader.co.uk] INFO: Limiting photo downloads to 1 per item
2026-03-26 14:20:39 [auto_selling_autotrader.co.uk] INFO: _job: f494d002291e11f18f76c264925fbcfa, SCRAPY_JOB: None
2026-03-26 14:20:39 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-26 14:20:39 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-26 14:20:39 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-26 14:20:39 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-26 14:20:39 [scrapy.extensions.telnet] INFO: Telnet Password: ea57669bb53f45f5
2026-03-26 14:20:39 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-26 14:20:39 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 3600,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto_selling_autotrader.co.uk/f494d002291e11f18f76c264925fbcfa.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-26 14:20:39 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-26 14:20:39 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-26 14:20:39 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-26 14:20:39 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware for auto_selling
2026-03-26 14:20:39 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.auto_selling.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-26 14:20:39 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.post_to_azurebus_auto_selling.AzureBusPipelineAutoSelling',
'crawlers.pipelines.save_to_cdlq_db_auto_selling.SaveToCdlqDbAutoSelling']
2026-03-26 14:20:39 [scrapy.core.engine] INFO: Spider opened
2026-03-26 14:20:39 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-26 14:20:39 [common.service_bus.service_bus_client_factory] INFO: ServiceBusClient initialized via DefaultAzureCredential for alx-production-bus.servicebus.windows.net
2026-03-26 14:20:39 [crawlers.pipelines.base_azure_bus_pipeline] INFO: [AzureBusPipeline] Connected to topic auto.sourcing-v2-quickmode
2026-03-26 14:20:39 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-26 14:20:39 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-26 14:20:39 [scrapy.extensions.memusage] INFO: Peak memory usage is 140MiB
2026-03-26 14:20:39 [scrapy-playwright] INFO: Starting download handler
2026-03-26 14:20:39 [scrapy-playwright] INFO: Starting download handler
2026-03-26 14:20:44 [auto_selling_autotrader.co.uk] INFO: Scraper started with retailer ID: 10040101 and multipost_profile_id: c35f6a77-2bc6-416e-9c58-a998522b5ede and job_id: f494d002291e11f18f76c264925fbcfa and url: https://www.autotrader.co.uk/dealers/yorkshire/leeds/ace-prestige-autos-10040101
2026-03-26 14:20:44 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 10040101, page: 1
2026-03-26 14:20:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 14:20:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: None) ['zyte-api']
2026-03-26 14:20:46 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-26 14:20:46 [auto_selling_autotrader.co.uk] INFO: Page: 1/1, total results: 18
2026-03-26 14:20:46 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2117
2026-03-26 14:20:46 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603261024220%27 HTTP/1.1" 200 None
2026-03-26 14:20:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603261024220: 1
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603240962594%27 HTTP/1.1" 200 None
2026-03-26 14:20:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603240962594: 1
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603200876418%27 HTTP/1.1" 200 None
2026-03-26 14:20:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603200876418: 1
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603190832475%27 HTTP/1.1" 200 None
2026-03-26 14:20:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603190832475: 1
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603130682570%27 HTTP/1.1" 200 None
2026-03-26 14:20:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603130682570: 1
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110607154%27 HTTP/1.1" 200 None
2026-03-26 14:20:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603110607154: 1
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603030360880%27 HTTP/1.1" 200 None
2026-03-26 14:20:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603030360880: 1
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602190063945%27 HTTP/1.1" 200 None
2026-03-26 14:20:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602190063945: 1
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602179997440%27 HTTP/1.1" 200 None
2026-03-26 14:20:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602179997440: 1
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602149925511%27 HTTP/1.1" 200 None
2026-03-26 14:20:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602149925511: 1
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602139912200%27 HTTP/1.1" 200 None
2026-03-26 14:20:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602139912200: 1
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601199256057%27 HTTP/1.1" 200 None
2026-03-26 14:20:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601199256057: 1
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601199254798%27 HTTP/1.1" 200 None
2026-03-26 14:20:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601199254798: 1
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601099030248%27 HTTP/1.1" 200 None
2026-03-26 14:20:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601099030248: 1
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601078986606%27 HTTP/1.1" 200 None
2026-03-26 14:20:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601078986606: 1
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509116242864%27 HTTP/1.1" 200 None
2026-03-26 14:20:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202509116242864: 1
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509015942291%27 HTTP/1.1" 200 None
2026-03-26 14:20:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202509015942291: 1
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508225674087%27 HTTP/1.1" 200 None
2026-03-26 14:20:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202508225674087: 1
2026-03-26 14:20:46 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-26 14:20:46 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 8 detail requests (batch 2)
2026-03-26 14:20:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 14:20:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 14:20:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 14:20:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:20:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: fb18c36b-3b80-555c-8b5b-c701518ee845 with identifier: 202603261024220
2026-03-26 14:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fb18c36b-3b80-555c-8b5b-c701518ee845
2026-03-26 14:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcc7cdcde8aa247c6ab7f75288f6acc0f.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cc7cdcde8aa247c6ab7f75288f6acc0f.jpg not downloaded yet
2026-03-26 14:20:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:20:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 646557eb-9c4b-5fff-8ea0-486a334a81bf with identifier: 202603240962594
2026-03-26 14:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 646557eb-9c4b-5fff-8ea0-486a334a81bf
2026-03-26 14:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F14f84725f9f1471598fab5610202a75c.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/14f84725f9f1471598fab5610202a75c.jpg not downloaded yet
2026-03-26 14:20:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:20:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d18de1e3-baee-5ddf-a45c-a43ec3e5d835 with identifier: 202603200876418
2026-03-26 14:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d18de1e3-baee-5ddf-a45c-a43ec3e5d835
2026-03-26 14:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F83859f72c07e4599a624688b8eb925c4.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/83859f72c07e4599a624688b8eb925c4.jpg not downloaded yet
2026-03-26 14:20:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:20:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b4a2fe30-1498-58e5-923d-004cbc57704f with identifier: 202603190832475
2026-03-26 14:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b4a2fe30-1498-58e5-923d-004cbc57704f
2026-03-26 14:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcc7cdcde8aa247c6ab7f75288f6acc0f.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cc7cdcde8aa247c6ab7f75288f6acc0f.jpg not downloaded yet
2026-03-26 14:20:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:20:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d4f7922-c1bf-575a-972d-349ae54e3fe6 with identifier: 202603130682570
2026-03-26 14:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0d4f7922-c1bf-575a-972d-349ae54e3fe6
2026-03-26 14:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4fc8e809e2584b12a168da7b96913603.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4fc8e809e2584b12a168da7b96913603.jpg not downloaded yet
2026-03-26 14:20:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:20:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b684c441-2050-5c9d-b708-7027d750e724 with identifier: 202603110607154
2026-03-26 14:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b684c441-2050-5c9d-b708-7027d750e724
2026-03-26 14:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9a30498c78114bccaea280a51e9ed9c9.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9a30498c78114bccaea280a51e9ed9c9.jpg not downloaded yet
2026-03-26 14:20:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:20:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 8dd727ef-4d05-56c4-8ae3-10579ffe3578 with identifier: 202603030360880
2026-03-26 14:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8dd727ef-4d05-56c4-8ae3-10579ffe3578
2026-03-26 14:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcbce391fa15f4dfc991bd5bc6c87c673.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cbce391fa15f4dfc991bd5bc6c87c673.jpg not downloaded yet
2026-03-26 14:20:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:20:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 74b110a9-566c-5cbb-8717-44bc362126df with identifier: 202602190063945
2026-03-26 14:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 74b110a9-566c-5cbb-8717-44bc362126df
2026-03-26 14:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4a6e22a04d2942d7b1565266d24be17f.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4a6e22a04d2942d7b1565266d24be17f.jpg not downloaded yet
2026-03-26 14:20:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:20:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 616f9325-1409-550a-934b-f99e92c5a36d with identifier: 202602179997440
2026-03-26 14:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 616f9325-1409-550a-934b-f99e92c5a36d
2026-03-26 14:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0a91257898c641b3a002b2bb71e449f7.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0a91257898c641b3a002b2bb71e449f7.jpg not downloaded yet
2026-03-26 14:20:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:20:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d877550b-1adc-541f-9a0d-f47a904185ba with identifier: 202602149925511
2026-03-26 14:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d877550b-1adc-541f-9a0d-f47a904185ba
2026-03-26 14:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffdd93d7f738d42eab7ac8e43ad0e9cd3.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fdd93d7f738d42eab7ac8e43ad0e9cd3.jpg not downloaded yet
2026-03-26 14:20:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/cc7cdcde8aa247c6ab7f75288f6acc0f.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:20:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/cc7cdcde8aa247c6ab7f75288f6acc0f.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:20:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/4fc8e809e2584b12a168da7b96913603.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:20:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/14f84725f9f1471598fab5610202a75c.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:20:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/9a30498c78114bccaea280a51e9ed9c9.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:20:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/83859f72c07e4599a624688b8eb925c4.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:20:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-26 14:20:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-26 14:20:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:20:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa5bad50950>
2026-03-26 14:20:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:20:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-26 14:20:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2121
2026-03-26 14:20:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-26 14:20:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:20:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:20:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb18c36b-3b80-555c-8b5b-c701518ee845/fb18c36b-3b80-555c-8b5b-c701518ee845_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcc7cdcde8aa247c6ab7f75288f6acc0f.jpg') HTTP/1.1" 204 0
2026-03-26 14:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cc7cdcde8aa247c6ab7f75288f6acc0f.jpg saved to cache
2026-03-26 14:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fb18c36b-3b80-555c-8b5b-c701518ee845
2026-03-26 14:20:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fb18c36b-3b80-555c-8b5b-c701518ee845 sending to next pipeline
2026-03-26 14:20:49 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: fb18c36b-3b80-555c-8b5b-c701518ee845 with identifier 202603261024220
2026-03-26 14:20:49 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: None -> <ConnectionState.START: 0>
2026-03-26 14:20:49 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.START: 0> -> <ConnectionState.HDR_SENT: 2>
2026-03-26 14:20:49 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.HDR_SENT: 2>
2026-03-26 14:20:49 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.OPEN_PIPE: 4>
2026-03-26 14:20:49 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.UNMAPPED: 0> -> <SessionState.BEGIN_SENT: 1>
2026-03-26 14:20:49 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-26 14:20:49 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-26 14:20:49 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-26 14:20:49 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-26 14:20:49 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_PIPE: 4> -> <ConnectionState.OPEN_SENT: 7>
2026-03-26 14:20:49 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_SENT: 7> -> <ConnectionState.OPENED: 9>
2026-03-26 14:20:49 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.BEGIN_SENT: 1> -> <SessionState.MAPPED: 3>
2026-03-26 14:20:49 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-26 14:20:49 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-26 14:20:49 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-26 14:20:49 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-26 14:20:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS completed opening with status: <ManagementOpenResult.OK: 1>
2026-03-26 14:20:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-26 14:20:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2029
2026-03-26 14:20:49 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-26 14:20:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774534849
2026-03-26 14:20:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774534849
2026-03-26 14:20:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS Put token result (<ManagementExecuteOperationResult.OK: 0>), status code: 202, status_description: b'Accepted'.
2026-03-26 14:20:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:50 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-26 14:20:50 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-26 14:20:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:50 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item fb18c36b-3b80-555c-8b5b-c701518ee845
2026-03-26 14:20:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/cc7cdcde8aa247c6ab7f75288f6acc0f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 299,
'color': 'Grey',
'currency': 'GBP',
'doors_number': 2,
'emission_standard': 'Euro 6',
'engine': '5L',
'engine_horse_power': 416,
'fuel_type': 'Petrol',
'id': 'fb18c36b-3b80-555c-8b5b-c701518ee845',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603261024220',
'listing': 'directbuy',
'location': 'Leeds, Yorkshire',
'make': 'Ford',
'model': 'Mustang',
'odometer': 12335,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 1,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb18c36b-3b80-555c-8b5b-c701518ee845/fb18c36b-3b80-555c-8b5b-c701518ee845_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73903,
'Height': 1280,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cc7cdcde8aa247c6ab7f75288f6acc0f.jpg',
'Width': 1920}],
'price': 33595,
'price_includes_vat': True,
'registration_date': '2017-09-09',
'seats_number': 4,
'seller_name': None,
'title': 'Ford 5.0 Mustang GT 2dr',
'transmission': 'manual',
'trim': 'GT',
'year': 2017}
2026-03-26 14:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603261024220%27 HTTP/1.1" 200 None
2026-03-26 14:20:50 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603261024220: {'created_time': 1774534850.182021, 'last_price_update_time': 1774534850.18203}
2026-03-26 14:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603261024220') HTTP/1.1" 204 0
2026-03-26 14:20:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/cbce391fa15f4dfc991bd5bc6c87c673.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:20:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 14:20:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:20:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa5bac5c350>
2026-03-26 14:20:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:20:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:20:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:20:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4a2fe30-1498-58e5-923d-004cbc57704f/b4a2fe30-1498-58e5-923d-004cbc57704f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcc7cdcde8aa247c6ab7f75288f6acc0f.jpg') HTTP/1.1" 204 0
2026-03-26 14:20:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cc7cdcde8aa247c6ab7f75288f6acc0f.jpg saved to cache
2026-03-26 14:20:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b4a2fe30-1498-58e5-923d-004cbc57704f
2026-03-26 14:20:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b4a2fe30-1498-58e5-923d-004cbc57704f sending to next pipeline
2026-03-26 14:20:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:20:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa5b9a28190>
2026-03-26 14:20:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:20:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:20:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:20:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d4f7922-c1bf-575a-972d-349ae54e3fe6/0d4f7922-c1bf-575a-972d-349ae54e3fe6_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4fc8e809e2584b12a168da7b96913603.jpg') HTTP/1.1" 204 0
2026-03-26 14:20:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4fc8e809e2584b12a168da7b96913603.jpg saved to cache
2026-03-26 14:20:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d4f7922-c1bf-575a-972d-349ae54e3fe6
2026-03-26 14:20:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d4f7922-c1bf-575a-972d-349ae54e3fe6 sending to next pipeline
2026-03-26 14:20:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:20:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa5bac70890>
2026-03-26 14:20:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:20:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:20:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:20:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_646557eb-9c4b-5fff-8ea0-486a334a81bf/646557eb-9c4b-5fff-8ea0-486a334a81bf_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F14f84725f9f1471598fab5610202a75c.jpg') HTTP/1.1" 204 0
2026-03-26 14:20:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/14f84725f9f1471598fab5610202a75c.jpg saved to cache
2026-03-26 14:20:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 646557eb-9c4b-5fff-8ea0-486a334a81bf
2026-03-26 14:20:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 646557eb-9c4b-5fff-8ea0-486a334a81bf sending to next pipeline
2026-03-26 14:20:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:20:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa5b9a35010>
2026-03-26 14:20:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:20:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:20:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:20:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b684c441-2050-5c9d-b708-7027d750e724/b684c441-2050-5c9d-b708-7027d750e724_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9a30498c78114bccaea280a51e9ed9c9.jpg') HTTP/1.1" 204 0
2026-03-26 14:20:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9a30498c78114bccaea280a51e9ed9c9.jpg saved to cache
2026-03-26 14:20:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b684c441-2050-5c9d-b708-7027d750e724
2026-03-26 14:20:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b684c441-2050-5c9d-b708-7027d750e724 sending to next pipeline
2026-03-26 14:20:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:20:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa5b9a2a4d0>
2026-03-26 14:20:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:20:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:20:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:20:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d18de1e3-baee-5ddf-a45c-a43ec3e5d835/d18de1e3-baee-5ddf-a45c-a43ec3e5d835_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F83859f72c07e4599a624688b8eb925c4.jpg') HTTP/1.1" 204 0
2026-03-26 14:20:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/83859f72c07e4599a624688b8eb925c4.jpg saved to cache
2026-03-26 14:20:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d18de1e3-baee-5ddf-a45c-a43ec3e5d835
2026-03-26 14:20:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d18de1e3-baee-5ddf-a45c-a43ec3e5d835 sending to next pipeline
2026-03-26 14:20:50 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b4a2fe30-1498-58e5-923d-004cbc57704f with identifier 202603190832475
2026-03-26 14:20:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:50 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b4a2fe30-1498-58e5-923d-004cbc57704f
2026-03-26 14:20:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/cc7cdcde8aa247c6ab7f75288f6acc0f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 281,
'color': 'Red',
'currency': 'GBP',
'doors_number': 2,
'emission_standard': 'Euro 6',
'engine': '5L',
'engine_horse_power': 416,
'fuel_type': 'Petrol',
'id': 'b4a2fe30-1498-58e5-923d-004cbc57704f',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603190832475',
'listing': 'directbuy',
'location': 'Leeds, Yorkshire',
'make': 'Ford',
'model': 'Mustang',
'odometer': 57070,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 1,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4a2fe30-1498-58e5-923d-004cbc57704f/b4a2fe30-1498-58e5-923d-004cbc57704f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73903,
'Height': 1280,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cc7cdcde8aa247c6ab7f75288f6acc0f.jpg',
'Width': 1920}],
'price': 27645,
'price_includes_vat': True,
'registration_date': '2018-03-28',
'seats_number': 4,
'seller_name': None,
'title': 'Ford 5.0 Mustang GT Auto 2dr',
'transmission': 'automatic',
'trim': 'GT',
'year': 2018}
2026-03-26 14:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603190832475%27 HTTP/1.1" 200 None
2026-03-26 14:20:50 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603190832475: {'created_time': 1774534850.886156, 'last_price_update_time': 1774534850.886165}
2026-03-26 14:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603190832475') HTTP/1.1" 204 0
2026-03-26 14:20:50 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 0d4f7922-c1bf-575a-972d-349ae54e3fe6 with identifier 202603130682570
2026-03-26 14:20:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:50 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 0d4f7922-c1bf-575a-972d-349ae54e3fe6
2026-03-26 14:20:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/4fc8e809e2584b12a168da7b96913603.jpg>
{'auction_title': '',
'c_o_2_emission_value': 136,
'color': 'Blue',
'currency': 'GBP',
'description': 'Introducing the Ford Fiesta 1.5 Fiesta ST-3 T 3dr, a true '
'powerhouse on the road. With only 27232 miles on the clock, '
'this stunning vehicle is finished in a sleek Blue colour that '
'is sure to turn heads wherever you go.\n'
'\n'
"But that's not all - this Ford Fiesta comes with the ST "
'Performance Pack, taking its performance to the next level. '
'Get ready to experience an exhilarating drive like never '
'before, with enhanced handling and power that will leave you '
'craving more.\n'
'\n'
"Don't miss out on the opportunity to own this incredible Ford "
'Fiesta. Visit us today and take it for a test drive to see '
"for yourself why it's the ultimate choice for those who "
'demand both style and performance in their vehicle.',
'doors_number': 3,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 197,
'fuel_type': 'Petrol',
'id': '0d4f7922-c1bf-575a-972d-349ae54e3fe6',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603130682570',
'listing': 'directbuy',
'location': 'Leeds, Yorkshire',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 27232,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d4f7922-c1bf-575a-972d-349ae54e3fe6/0d4f7922-c1bf-575a-972d-349ae54e3fe6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397547,
'Height': 1440,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4fc8e809e2584b12a168da7b96913603.jpg',
'Width': 1920}],
'price': 15995,
'price_includes_vat': True,
'registration_date': '2018-11-30',
'seats_number': 5,
'seller_name': None,
'title': 'Ford 1.5 Fiesta ST-3 T 3dr',
'transmission': 'manual',
'trim': 'ST-3',
'year': 2018}
2026-03-26 14:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603130682570%27 HTTP/1.1" 200 None
2026-03-26 14:20:50 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603130682570: {'created_time': 1774534850.929689, 'last_price_update_time': 1774534850.929697}
2026-03-26 14:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603130682570') HTTP/1.1" 204 0
2026-03-26 14:20:50 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 646557eb-9c4b-5fff-8ea0-486a334a81bf with identifier 202603240962594
2026-03-26 14:20:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:50 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 646557eb-9c4b-5fff-8ea0-486a334a81bf
2026-03-26 14:20:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/14f84725f9f1471598fab5610202a75c.jpg>
{'auction_title': '',
'c_o_2_emission_value': 174,
'color': 'White',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '3L',
'engine_horse_power': 335,
'fuel_type': 'Diesel',
'id': '646557eb-9c4b-5fff-8ea0-486a334a81bf',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603240962594',
'listing': 'directbuy',
'location': 'Leeds, Yorkshire',
'make': 'Audi',
'model': 'SQ5',
'odometer': 96715,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_646557eb-9c4b-5fff-8ea0-486a334a81bf/646557eb-9c4b-5fff-8ea0-486a334a81bf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 349444,
'Height': 1440,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/14f84725f9f1471598fab5610202a75c.jpg',
'Width': 1920}],
'price': 17595,
'price_includes_vat': True,
'registration_date': '2016-03-28',
'seats_number': 5,
'seller_name': None,
'title': 'Audi 3.0 SQ5+ TDI Quattro Auto 4WD 5dr',
'transmission': 'automatic',
'trim': 'Plus',
'year': 2016}
2026-03-26 14:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603240962594%27 HTTP/1.1" 200 None
2026-03-26 14:20:50 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603240962594: {'created_time': 1774534850.971549, 'last_price_update_time': 1774534850.971556}
2026-03-26 14:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603240962594') HTTP/1.1" 204 0
2026-03-26 14:20:50 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b684c441-2050-5c9d-b708-7027d750e724 with identifier 202603110607154
2026-03-26 14:20:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:50 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b684c441-2050-5c9d-b708-7027d750e724
2026-03-26 14:20:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/9a30498c78114bccaea280a51e9ed9c9.jpg>
{'auction_title': '',
'c_o_2_emission_value': 281,
'color': 'Black',
'currency': 'GBP',
'description': 'Introducing the iconic Ford Mustang 5.0 Mustang GT Auto 2dr, '
'a true symbol of power and performance. With only 30221 miles '
'on the clock and a single owner, this beast is ready to roar '
'onto the streets.\n'
'\n'
'Finished in sleek Black, this Ford Mustang is a head-turner '
"wherever it goes. But it's not just about looks - this beauty "
'comes loaded with extras, including the impressive Shaker Pro '
'Premium Audio System with Navigation, ensuring you stay '
'entertained and on track wherever your journey takes you.\n'
'\n'
"Don't miss your chance to own this stunning Ford Mustang with "
'a powerful 5.0 engine under the hood. Embrace the thrill of '
'the open road and experience the true essence of driving with '
'this incredible machine. Visit us today and make this Mustang '
"yours before it's gone.",
'doors_number': 2,
'emission_standard': 'Euro 6',
'engine': '5L',
'engine_horse_power': 416,
'fuel_type': 'Petrol',
'id': 'b684c441-2050-5c9d-b708-7027d750e724',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603110607154',
'listing': 'directbuy',
'location': 'Leeds, Yorkshire',
'make': 'Ford',
'model': 'Mustang',
'odometer': 30221,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b684c441-2050-5c9d-b708-7027d750e724/b684c441-2050-5c9d-b708-7027d750e724_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 385544,
'Height': 1440,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9a30498c78114bccaea280a51e9ed9c9.jpg',
'Width': 1920}],
'price': 29795,
'price_includes_vat': True,
'registration_date': '2016-05-26',
'seats_number': 4,
'seller_name': None,
'title': 'Ford 5.0 Mustang GT Auto 2dr',
'transmission': 'automatic',
'trim': 'GT',
'year': 2016}
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110607154%27 HTTP/1.1" 200 None
2026-03-26 14:20:51 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603110607154: {'created_time': 1774534851.014392, 'last_price_update_time': 1774534851.014399}
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603110607154') HTTP/1.1" 204 0
2026-03-26 14:20:51 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d18de1e3-baee-5ddf-a45c-a43ec3e5d835 with identifier 202603200876418
2026-03-26 14:20:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:51 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d18de1e3-baee-5ddf-a45c-a43ec3e5d835
2026-03-26 14:20:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/83859f72c07e4599a624688b8eb925c4.jpg>
{'auction_title': '',
'c_o_2_emission_value': 299,
'color': 'Grey',
'currency': 'GBP',
'doors_number': 2,
'emission_standard': 'Euro 6',
'engine': '5L',
'engine_horse_power': 416,
'fuel_type': 'Petrol',
'id': 'd18de1e3-baee-5ddf-a45c-a43ec3e5d835',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603200876418',
'listing': 'directbuy',
'location': 'Leeds, Yorkshire',
'make': 'Ford',
'model': 'Mustang',
'odometer': 40673,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 29,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d18de1e3-baee-5ddf-a45c-a43ec3e5d835/d18de1e3-baee-5ddf-a45c-a43ec3e5d835_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 378641,
'Height': 1440,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/83859f72c07e4599a624688b8eb925c4.jpg',
'Width': 1920}],
'price': 28715,
'price_includes_vat': True,
'registration_date': '2016-06-22',
'seats_number': 4,
'seller_name': None,
'title': 'Ford 5.0 Mustang GT 2dr',
'transmission': 'manual',
'trim': 'GT',
'year': 2016}
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603200876418%27 HTTP/1.1" 200 None
2026-03-26 14:20:51 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603200876418: {'created_time': 1774534851.080831, 'last_price_update_time': 1774534851.080841}
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603200876418') HTTP/1.1" 204 0
2026-03-26 14:20:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/0a91257898c641b3a002b2bb71e449f7.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:20:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/fdd93d7f738d42eab7ac8e43ad0e9cd3.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:20:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/4a6e22a04d2942d7b1565266d24be17f.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:20:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:20:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa5b9a22e10>
2026-03-26 14:20:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:20:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dd727ef-4d05-56c4-8ae3-10579ffe3578/8dd727ef-4d05-56c4-8ae3-10579ffe3578_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcbce391fa15f4dfc991bd5bc6c87c673.jpg') HTTP/1.1" 204 0
2026-03-26 14:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cbce391fa15f4dfc991bd5bc6c87c673.jpg saved to cache
2026-03-26 14:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8dd727ef-4d05-56c4-8ae3-10579ffe3578
2026-03-26 14:20:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8dd727ef-4d05-56c4-8ae3-10579ffe3578 sending to next pipeline
2026-03-26 14:20:51 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:20:51 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 984b2dd7-32ce-5ca9-a08a-b8ea57b52488 with identifier: 202602139912200
2026-03-26 14:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 984b2dd7-32ce-5ca9-a08a-b8ea57b52488
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F418e40fad63a4bdfa558609626d4a1b9.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/418e40fad63a4bdfa558609626d4a1b9.jpg not downloaded yet
2026-03-26 14:20:51 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 8dd727ef-4d05-56c4-8ae3-10579ffe3578 with identifier 202603030360880
2026-03-26 14:20:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:51 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 8dd727ef-4d05-56c4-8ae3-10579ffe3578
2026-03-26 14:20:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/cbce391fa15f4dfc991bd5bc6c87c673.jpg>
{'auction_title': '',
'c_o_2_emission_value': 220,
'color': 'Black',
'currency': 'GBP',
'description': 'Introducing the stunning Mercedes-benz Gle 2.9 GLE 400 AMG '
'Line Premium+ D 4Matic Auto 4WD 5dr. This luxurious vehicle '
'has been meticulously maintained, with only 1 previous owner '
'and 65686 miles on the clock.\n'
'\n'
'Finished in sleek Black, this Mercedes-benz Gle is sure to '
'turn heads wherever you go. The Nappa Leather interior in '
'Black adds a touch of elegance, while the Obsidian Black '
'accents complete the sophisticated look.\n'
'\n'
'Experience the ultimate in comfort, style, and performance '
"with the Mercedes-benz Gle. Don't miss your chance to own "
'this exceptional vehicle. Contact us today to arrange a test '
'drive and make this beauty yours.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2.9L',
'engine_horse_power': 325,
'fuel_type': 'Diesel',
'id': '8dd727ef-4d05-56c4-8ae3-10579ffe3578',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603030360880',
'listing': 'directbuy',
'location': 'Leeds, Yorkshire',
'make': 'Mercedes-Benz',
'model': 'GLE',
'odometer': 65686,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 33,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dd727ef-4d05-56c4-8ae3-10579ffe3578/8dd727ef-4d05-56c4-8ae3-10579ffe3578_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 431465,
'Height': 1440,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cbce391fa15f4dfc991bd5bc6c87c673.jpg',
'Width': 1920}],
'price': 43595,
'price_includes_vat': True,
'registration_date': '2022-04-08',
'seats_number': 7,
'seller_name': None,
'title': 'Mercedes-Benz 2.9 GLE 400 AMG Line Premium+ D 4Matic Auto 4WD 5dr',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2022}
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603030360880%27 HTTP/1.1" 200 None
2026-03-26 14:20:51 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603030360880: {'created_time': 1774534851.26074, 'last_price_update_time': 1774534851.260749}
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603030360880') HTTP/1.1" 204 0
2026-03-26 14:20:51 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:20:51 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 68c10821-6add-5ba2-afea-9a867d19e209 with identifier: 202601199256057
2026-03-26 14:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 68c10821-6add-5ba2-afea-9a867d19e209
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F38788afb2d564d419d193ab98bdcfee9.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/38788afb2d564d419d193ab98bdcfee9.jpg not downloaded yet
2026-03-26 14:20:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:20:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa5bacf5810>
2026-03-26 14:20:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:20:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_616f9325-1409-550a-934b-f99e92c5a36d/616f9325-1409-550a-934b-f99e92c5a36d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0a91257898c641b3a002b2bb71e449f7.jpg') HTTP/1.1" 204 0
2026-03-26 14:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0a91257898c641b3a002b2bb71e449f7.jpg saved to cache
2026-03-26 14:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 616f9325-1409-550a-934b-f99e92c5a36d
2026-03-26 14:20:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 616f9325-1409-550a-934b-f99e92c5a36d sending to next pipeline
2026-03-26 14:20:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:20:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa5bacbaf90>
2026-03-26 14:20:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:20:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d877550b-1adc-541f-9a0d-f47a904185ba/d877550b-1adc-541f-9a0d-f47a904185ba_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffdd93d7f738d42eab7ac8e43ad0e9cd3.jpg') HTTP/1.1" 204 0
2026-03-26 14:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fdd93d7f738d42eab7ac8e43ad0e9cd3.jpg saved to cache
2026-03-26 14:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d877550b-1adc-541f-9a0d-f47a904185ba
2026-03-26 14:20:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d877550b-1adc-541f-9a0d-f47a904185ba sending to next pipeline
2026-03-26 14:20:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:20:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa5b9937150>
2026-03-26 14:20:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:20:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b110a9-566c-5cbb-8717-44bc362126df/74b110a9-566c-5cbb-8717-44bc362126df_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4a6e22a04d2942d7b1565266d24be17f.jpg') HTTP/1.1" 204 0
2026-03-26 14:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4a6e22a04d2942d7b1565266d24be17f.jpg saved to cache
2026-03-26 14:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 74b110a9-566c-5cbb-8717-44bc362126df
2026-03-26 14:20:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 74b110a9-566c-5cbb-8717-44bc362126df sending to next pipeline
2026-03-26 14:20:51 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:20:51 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 64738358-16d9-575e-91ee-304575332e53 with identifier: 202601199254798
2026-03-26 14:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 64738358-16d9-575e-91ee-304575332e53
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F06b01dc1256d431383fd88c447810c67.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/06b01dc1256d431383fd88c447810c67.jpg not downloaded yet
2026-03-26 14:20:51 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 616f9325-1409-550a-934b-f99e92c5a36d with identifier 202602179997440
2026-03-26 14:20:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:51 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 616f9325-1409-550a-934b-f99e92c5a36d
2026-03-26 14:20:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/0a91257898c641b3a002b2bb71e449f7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'color': 'Grey',
'currency': 'GBP',
'description': 'Introducing the stunning Mercedes-benz Cla 1.3 CLA 180 AMG '
'Line Premium+ Auto 4dr. With only 39693 miles on the clock '
'and just 1 previous owner, this car is in impeccable '
'condition.\n'
'\n'
'Finished in a sleek Grey colour, this Mercedes-benz Cla is a '
'true head-turner on the road. The luxurious Leather - Black '
'interior adds a touch of sophistication to the already '
'impressive design.\n'
'\n'
"Don't miss your chance to own this premium vehicle with "
'top-of-the-line features. Experience the ultimate driving '
'experience with the Mercedes-benz Cla 1.3 CLA 180 AMG Line '
'Premium+ Auto 4dr.',
'doors_number': 4,
'emission_standard': 'Euro 6',
'engine': '1.3L',
'engine_horse_power': 134,
'fuel_type': 'Petrol',
'id': '616f9325-1409-550a-934b-f99e92c5a36d',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602179997440',
'listing': 'directbuy',
'location': 'Leeds, Yorkshire',
'make': 'Mercedes-Benz',
'model': 'CLA',
'odometer': 39693,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 31,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_616f9325-1409-550a-934b-f99e92c5a36d/616f9325-1409-550a-934b-f99e92c5a36d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 411156,
'Height': 1440,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0a91257898c641b3a002b2bb71e449f7.jpg',
'Width': 1920}],
'price': 22945,
'price_includes_vat': True,
'registration_date': '2022-03-20',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz 1.3 CLA 180 AMG Line Premium+ Auto 4dr',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2022}
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602179997440%27 HTTP/1.1" 200 None
2026-03-26 14:20:51 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602179997440: {'created_time': 1774534851.549054, 'last_price_update_time': 1774534851.549067}
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602179997440') HTTP/1.1" 204 0
2026-03-26 14:20:51 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d877550b-1adc-541f-9a0d-f47a904185ba with identifier 202602149925511
2026-03-26 14:20:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:51 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d877550b-1adc-541f-9a0d-f47a904185ba
2026-03-26 14:20:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/fdd93d7f738d42eab7ac8e43ad0e9cd3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 174,
'color': 'Black',
'currency': 'GBP',
'description': 'Introducing the stunning Mercedes-benz Gle 3.0 GLE 350 D '
'4Matic AMG Line Premium+ Auto 4WD 5dr. This luxurious '
'vehicle, with only 62257 miles on the clock and 2 previous '
'owners, exudes elegance and style.\n'
'\n'
'Finished in sleek Black, this Mercedes-benz Gle comes with a '
'range of extras to enhance your driving experience. The 21in '
'Alloy Wheels - AMG 5-Twin-Spoke Design not only add a touch '
'of sophistication but also ensure a smooth ride. The Obsidian '
'Black Artico Leather interior in Black provides a comfortable '
'and luxurious environment for both driver and passengers.\n'
'\n'
"Don't miss out on the opportunity to own this exceptional "
'Mercedes-benz Gle. With its premium features and impeccable '
'design, it is sure to turn heads wherever you go. Upgrade '
'your driving experience today with the Mercedes-benz Gle 3.0 '
'GLE 350 D 4Matic AMG Line Premium+ Auto 4WD 5dr.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '3L',
'engine_horse_power': 254,
'fuel_type': 'Diesel',
'id': 'd877550b-1adc-541f-9a0d-f47a904185ba',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602149925511',
'listing': 'directbuy',
'location': 'Leeds, Yorkshire',
'make': 'Mercedes-Benz',
'model': 'GLE',
'odometer': 62257,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 31,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d877550b-1adc-541f-9a0d-f47a904185ba/d877550b-1adc-541f-9a0d-f47a904185ba_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 425953,
'Height': 1440,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fdd93d7f738d42eab7ac8e43ad0e9cd3.jpg',
'Width': 1920}],
'price': 23595,
'price_includes_vat': True,
'registration_date': '2017-12-20',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz 3.0 GLE 350 D 4Matic AMG Line Premium+ Auto 4WD 5dr',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2017}
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602149925511%27 HTTP/1.1" 200 None
2026-03-26 14:20:51 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602149925511: {'created_time': 1774534851.601278, 'last_price_update_time': 1774534851.601285}
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602149925511') HTTP/1.1" 204 0
2026-03-26 14:20:51 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 74b110a9-566c-5cbb-8717-44bc362126df with identifier 202602190063945
2026-03-26 14:20:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:51 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 74b110a9-566c-5cbb-8717-44bc362126df
2026-03-26 14:20:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/4a6e22a04d2942d7b1565266d24be17f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 203,
'color': 'Blue',
'currency': 'GBP',
'description': 'Introducing the Audi RSQ3 - a powerful and stylish SUV that '
'exudes luxury and performance. Finished in a stunning Blue '
'colour, this Audi RSQ3 comes with a range of extras that '
'enhance both its appearance and functionality.\n'
'\n'
'Equipped with 20-inch Alloy Wheels in a sleek 5-Arm Rotor '
'Design with a Matt Titanium Finish, this Audi RSQ3 is sure to '
'turn heads wherever you go. The striking Red Brake Calipers '
'add a sporty touch, while the Front Electric Adjustment Seats '
'ensure maximum comfort for every journey.\n'
'\n'
'Step inside the cabin and experience the premium feel of the '
'Sepang Blue Fine Nappa Leather upholstery with Black/Rock '
'Grey Stitching and RSQ3 Logo detailing. The attention to '
'detail in the interior design of this Audi RSQ3 is truly '
'exceptional.\n'
'\n'
'With its powerful 2.5 RSQ3 TFSI engine and Quattro Semi-Auto '
'4WD system, the Audi RSQ3 delivers an exhilarating driving '
"experience that is second to none. Whether you're cruising "
'through the city streets or tackling off-road adventures, '
'this SUV is ready for any challenge.\n'
'\n'
"Don't miss your chance to own this exceptional Audi RSQ3 with "
'its unique extras and impressive performance capabilities. '
'Visit our showroom today and experience the luxury and power '
'of the Audi RSQ3 for yourself.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2.5L',
'engine_horse_power': 335,
'fuel_type': 'Petrol',
'id': '74b110a9-566c-5cbb-8717-44bc362126df',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602190063945',
'listing': 'directbuy',
'location': 'Leeds, Yorkshire',
'make': 'Audi',
'model': 'RS Q3',
'odometer': 72470,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b110a9-566c-5cbb-8717-44bc362126df/74b110a9-566c-5cbb-8717-44bc362126df_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 414294,
'Height': 1440,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4a6e22a04d2942d7b1565266d24be17f.jpg',
'Width': 1920}],
'price': 17795,
'price_includes_vat': True,
'registration_date': '2015-06-16',
'seats_number': 5,
'seller_name': None,
'title': 'Audi 2.5 RS Q3 TFSI Quattro Semi-Auto 4WD 5dr',
'transmission': 'automatic',
'year': 2015}
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602190063945%27 HTTP/1.1" 200 None
2026-03-26 14:20:51 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602190063945: {'created_time': 1774534851.647195, 'last_price_update_time': 1774534851.647203}
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602190063945') HTTP/1.1" 204 0
2026-03-26 14:20:51 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:20:51 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 10519c34-9977-534e-b61a-133674c3799c with identifier: 202601099030248
2026-03-26 14:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 10519c34-9977-534e-b61a-133674c3799c
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbbd6de1e9f674bcb9397b34797469db5.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bbd6de1e9f674bcb9397b34797469db5.jpg not downloaded yet
2026-03-26 14:20:51 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:20:51 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d2a8859-78df-553d-b5c3-76739b64a82f with identifier: 202601078986606
2026-03-26 14:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4d2a8859-78df-553d-b5c3-76739b64a82f
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6026bc3227534b3fbc049d11b91469ed.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6026bc3227534b3fbc049d11b91469ed.jpg not downloaded yet
2026-03-26 14:20:51 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:20:51 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d22b8cca-1a5a-5b78-a21e-4782a9a14f52 with identifier: 202509116242864
2026-03-26 14:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d22b8cca-1a5a-5b78-a21e-4782a9a14f52
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6532c71fa0604758b47e8c5ad98a9164.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6532c71fa0604758b47e8c5ad98a9164.jpg not downloaded yet
2026-03-26 14:20:51 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:20:51 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a5d865e-b376-50ab-a238-66cc324a69a9 with identifier: 202509015942291
2026-03-26 14:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2a5d865e-b376-50ab-a238-66cc324a69a9
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F23cdb0b3ca33493faaa4a5fdb43a790c.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/23cdb0b3ca33493faaa4a5fdb43a790c.jpg not downloaded yet
2026-03-26 14:20:51 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:20:51 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 764471bc-b649-5e64-860f-f025934c35f3 with identifier: 202508225674087
2026-03-26 14:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 764471bc-b649-5e64-860f-f025934c35f3
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F89b287d671434de89ed4596cabb7aeb7.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/89b287d671434de89ed4596cabb7aeb7.jpg not downloaded yet
2026-03-26 14:20:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/38788afb2d564d419d193ab98bdcfee9.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:20:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/418e40fad63a4bdfa558609626d4a1b9.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:20:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/bbd6de1e9f674bcb9397b34797469db5.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:20:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:20:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa5baba3710>
2026-03-26 14:20:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:20:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68c10821-6add-5ba2-afea-9a867d19e209/68c10821-6add-5ba2-afea-9a867d19e209_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F38788afb2d564d419d193ab98bdcfee9.jpg') HTTP/1.1" 204 0
2026-03-26 14:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/38788afb2d564d419d193ab98bdcfee9.jpg saved to cache
2026-03-26 14:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 68c10821-6add-5ba2-afea-9a867d19e209
2026-03-26 14:20:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 68c10821-6add-5ba2-afea-9a867d19e209 sending to next pipeline
2026-03-26 14:20:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:20:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa5bad4de50>
2026-03-26 14:20:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:20:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_984b2dd7-32ce-5ca9-a08a-b8ea57b52488/984b2dd7-32ce-5ca9-a08a-b8ea57b52488_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F418e40fad63a4bdfa558609626d4a1b9.jpg') HTTP/1.1" 204 0
2026-03-26 14:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/418e40fad63a4bdfa558609626d4a1b9.jpg saved to cache
2026-03-26 14:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 984b2dd7-32ce-5ca9-a08a-b8ea57b52488
2026-03-26 14:20:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 984b2dd7-32ce-5ca9-a08a-b8ea57b52488 sending to next pipeline
2026-03-26 14:20:52 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 68c10821-6add-5ba2-afea-9a867d19e209 with identifier 202601199256057
2026-03-26 14:20:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:52 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 68c10821-6add-5ba2-afea-9a867d19e209
2026-03-26 14:20:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/38788afb2d564d419d193ab98bdcfee9.jpg>
{'auction_title': '',
'c_o_2_emission_value': 281,
'color': 'Silver',
'currency': 'GBP',
'description': '2017 Ford Mustang GT Roush RS2 5.0L V8 Coyote Supercharged '
'435 BHP Auto\n'
'\n'
'Presented here is a beautiful one-off Roush RS2 2017 Ford '
'Mustang, finished in Ingot Silver. Complete with a 5.0L V8 '
'Coyote Supercharged engine and producing 435 BHP. An '
'excellent build with an extensive list of new and bespoke '
'parts, and with less than 18’000 miles on the clock. A '
'viewing is a must, a test dive is highly recommended.\n'
'\n'
'Engine & Performance\n'
'\n'
' 5.0L V8 Coyote Supercharged – 435 BHP\n'
' 6-speed automatic transmission\n'
' Roush super charger with plug-in in glove compartment\n'
' Roush air intakes\n'
' Custom coolant tank\n'
' Roush Red coil covers\n'
'\n'
'Exterior\n'
'\n'
' Bespoke painted body with painted stripes and '
'lettering/door decals painted\n'
' 4 new tyres\n'
' 4 new brake discs and pads all round\n'
' Custom wheels all round\n'
' Custom paint Black cills all round and front grill\n'
' Front back and lower sides and arches clear PPF protected '
'wrap\n'
' Roush badges throughout\n'
' Roush wind shield vinyl custom\n'
' Underside cleaned and protected with 10-year sealant\n'
' Front fogs surround carbon\n'
' Rear light surround carbon\n'
' Roush bonnet scoop and vents\n'
' Private number plate\n'
' Roush side scoops\n'
' Roush qtr. window scoops\n'
'\n'
'Interior\n'
'\n'
' Bespoke painted dashboard\n'
' Roush badges throughout\n'
' Bespoke carpets\n'
' Bespoke electric Recaro racing seats front and back\n'
' Bespoke door cards\n'
' Alcantara bespoke central tunnel and flip lid\n'
' GT 350 steering wheel\n'
' New tyre pack included\n'
'\n'
'Additional Info\n'
'\n'
' UK-registered and ready to drive away\n'
' HPI clear with V5 present\n'
' Warranty, Finance & Delivery available\n'
'\n'
' Advertised for £69,995.00 sensible offers & p/x welcome\n'
'\n'
'For more information or to arrange a viewing, call 0113 340 '
'0404',
'doors_number': 2,
'emission_standard': 'Euro 6',
'engine': '5L',
'engine_horse_power': 416,
'fuel_type': 'Petrol',
'id': '68c10821-6add-5ba2-afea-9a867d19e209',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601199256057',
'listing': 'directbuy',
'location': 'Leeds, Yorkshire',
'make': 'Ford',
'model': 'Mustang',
'odometer': 17538,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 37,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68c10821-6add-5ba2-afea-9a867d19e209/68c10821-6add-5ba2-afea-9a867d19e209_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 409448,
'Height': 1440,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/38788afb2d564d419d193ab98bdcfee9.jpg',
'Width': 1920}],
'price': 69995,
'price_includes_vat': True,
'registration_date': '2017-04-27',
'seats_number': 4,
'seller_name': None,
'title': 'Ford 5.0 Mustang GT Auto 2dr',
'transmission': 'automatic',
'trim': 'GT',
'year': 2017}
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601199256057%27 HTTP/1.1" 200 None
2026-03-26 14:20:52 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601199256057: {'created_time': 1774534852.09019, 'last_price_update_time': 1774534852.090198}
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601199256057') HTTP/1.1" 204 0
2026-03-26 14:20:52 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 984b2dd7-32ce-5ca9-a08a-b8ea57b52488 with identifier 202602139912200
2026-03-26 14:20:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:52 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 984b2dd7-32ce-5ca9-a08a-b8ea57b52488
2026-03-26 14:20:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/418e40fad63a4bdfa558609626d4a1b9.jpg>
{'auction_title': '',
'c_o_2_emission_value': 138,
'color': 'Grey',
'currency': 'GBP',
'description': 'Introducing the stunning Audi Tt 1.8 TT Black Edition TFSI '
'3dr. With only 33496 miles on the clock, this sleek machine '
'is ready to hit the road in style.\n'
'\n'
'Finished in a sophisticated Grey colour, this Audi Tt is sure '
'to turn heads wherever you go. The Nano Grey exterior is '
'complemented by the sporty S Line Suspension and luxurious '
'Alcantara-Leather Sport Seats in Black, making every drive a '
'truly premium experience.\n'
'\n'
"Don't miss your chance to own this exceptional Audi Tt. Visit "
'us today and experience the thrill of driving a true icon.',
'doors_number': 3,
'emission_standard': 'Euro 6',
'engine': '1.8L',
'engine_horse_power': 178,
'fuel_type': 'Petrol',
'id': '984b2dd7-32ce-5ca9-a08a-b8ea57b52488',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602139912200',
'listing': 'directbuy',
'location': 'Leeds, Yorkshire',
'make': 'Audi',
'model': 'TT',
'odometer': 33496,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 29,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984b2dd7-32ce-5ca9-a08a-b8ea57b52488/984b2dd7-32ce-5ca9-a08a-b8ea57b52488_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397967,
'Height': 1440,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/418e40fad63a4bdfa558609626d4a1b9.jpg',
'Width': 1920}],
'price': 17095,
'price_includes_vat': True,
'registration_date': '2018-07-27',
'seats_number': 4,
'seller_name': None,
'title': 'Audi 1.8 TT Black Edition TFSI 3dr',
'transmission': 'manual',
'trim': 'Black Edition',
'year': 2018}
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602139912200%27 HTTP/1.1" 200 None
2026-03-26 14:20:52 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602139912200: {'created_time': 1774534852.139417, 'last_price_update_time': 1774534852.139427}
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602139912200') HTTP/1.1" 204 0
2026-03-26 14:20:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:20:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa5bf4e8450>
2026-03-26 14:20:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:20:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10519c34-9977-534e-b61a-133674c3799c/10519c34-9977-534e-b61a-133674c3799c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbbd6de1e9f674bcb9397b34797469db5.jpg') HTTP/1.1" 204 0
2026-03-26 14:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bbd6de1e9f674bcb9397b34797469db5.jpg saved to cache
2026-03-26 14:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 10519c34-9977-534e-b61a-133674c3799c
2026-03-26 14:20:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 10519c34-9977-534e-b61a-133674c3799c sending to next pipeline
2026-03-26 14:20:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/6026bc3227534b3fbc049d11b91469ed.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:20:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/6532c71fa0604758b47e8c5ad98a9164.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:20:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/23cdb0b3ca33493faaa4a5fdb43a790c.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:20:52 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 10519c34-9977-534e-b61a-133674c3799c with identifier 202601099030248
2026-03-26 14:20:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:52 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 10519c34-9977-534e-b61a-133674c3799c
2026-03-26 14:20:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/bbd6de1e9f674bcb9397b34797469db5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 137,
'color': 'Black',
'currency': 'GBP',
'description': 'Introducing the Audi A3, a sleek and sophisticated vehicle '
'that exudes style and performance. With only 35990 miles on '
'the clock and just 1 previous owner, this Audi A3 is in '
'pristine condition and ready to hit the road.\n'
'\n'
'Finished in a striking Black colour, this Audi A3 is sure to '
'turn heads wherever you go. Plus, with extras like Body '
'Coloured Door Mirrors and Dinamica Microfibre-Artificial '
'Leather Front Sports Seats with S Embossed Logo in Steel '
"Grey, you'll be riding in luxury and comfort.\n"
'\n'
"Don't miss your chance to own this Audi A3 1.5 Sportback 35 "
'TFSI MHEV S Line Edition 1 Semi-Auto 5dr. Visit us today and '
'experience the thrill of driving an Audi for yourself.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 148,
'fuel_type': 'Petrol',
'id': '10519c34-9977-534e-b61a-133674c3799c',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601099030248',
'listing': 'directbuy',
'location': 'Leeds, Yorkshire',
'make': 'Audi',
'model': 'A3',
'odometer': 35990,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 34,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10519c34-9977-534e-b61a-133674c3799c/10519c34-9977-534e-b61a-133674c3799c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 417269,
'Height': 1440,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bbd6de1e9f674bcb9397b34797469db5.jpg',
'Width': 1920}],
'price': 22995,
'price_includes_vat': True,
'registration_date': '2021-10-01',
'seats_number': 5,
'seller_name': None,
'title': 'Audi 1.5 A3 Sportback 35 TFSI MHEV S Line Edition 1 Semi-Auto 5dr',
'transmission': 'automatic',
'trim': 'Edition 1',
'year': 2021}
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601099030248%27 HTTP/1.1" 200 None
2026-03-26 14:20:52 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601099030248: {'created_time': 1774534852.282584, 'last_price_update_time': 1774534852.282596}
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601099030248') HTTP/1.1" 204 0
2026-03-26 14:20:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/06b01dc1256d431383fd88c447810c67.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:20:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/89b287d671434de89ed4596cabb7aeb7.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:20:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:20:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa5befb3310>
2026-03-26 14:20:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:20:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d2a8859-78df-553d-b5c3-76739b64a82f/4d2a8859-78df-553d-b5c3-76739b64a82f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6026bc3227534b3fbc049d11b91469ed.jpg') HTTP/1.1" 204 0
2026-03-26 14:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6026bc3227534b3fbc049d11b91469ed.jpg saved to cache
2026-03-26 14:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4d2a8859-78df-553d-b5c3-76739b64a82f
2026-03-26 14:20:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4d2a8859-78df-553d-b5c3-76739b64a82f sending to next pipeline
2026-03-26 14:20:52 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 4d2a8859-78df-553d-b5c3-76739b64a82f with identifier 202601078986606
2026-03-26 14:20:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:52 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 4d2a8859-78df-553d-b5c3-76739b64a82f
2026-03-26 14:20:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/6026bc3227534b3fbc049d11b91469ed.jpg>
{'auction_title': '',
'c_o_2_emission_value': 30,
'color': 'Grey',
'currency': 'GBP',
'description': 'Introducing the stunning Audi A3 1.4 A3 Sportback 40 TFSI S '
'Line E Semi-Auto 5dr. This exceptional vehicle has only 20263 '
'miles on the clock and has been cherished by just 2 owners.\n'
'\n'
'Finished in a sleek Grey exterior, this Audi A3 is sure to '
'turn heads wherever you go. Plus, it comes with the luxurious '
'extra features of Daytona Grey paint and Twin Leather Front '
'Sport Seats with S Embossed Logo in Black.\n'
'\n'
'Experience the perfect blend of style, performance, and '
"sophistication with the Audi A3. Don't miss out on the "
'opportunity to own this premium vehicle. Visit us today to '
'test drive the Audi A3 and elevate your driving experience to '
'a whole new level.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.4L',
'engine_horse_power': 201,
'fuel_type': 'Petrol Plug-in Hybrid',
'id': '4d2a8859-78df-553d-b5c3-76739b64a82f',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601078986606',
'listing': 'directbuy',
'location': 'Leeds, Yorkshire',
'make': 'Audi',
'model': 'A3',
'odometer': 20263,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 36,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d2a8859-78df-553d-b5c3-76739b64a82f/4d2a8859-78df-553d-b5c3-76739b64a82f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 440195,
'Height': 1440,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6026bc3227534b3fbc049d11b91469ed.jpg',
'Width': 1920}],
'price': 19395,
'price_includes_vat': True,
'registration_date': '2021-03-18',
'seats_number': 5,
'seller_name': None,
'title': 'Audi 1.4 A3 Sportback 40 TFSI S Line E Semi-Auto 5dr',
'transmission': 'automatic',
'trim': 'S line',
'year': 2021}
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601078986606%27 HTTP/1.1" 200 None
2026-03-26 14:20:52 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601078986606: {'created_time': 1774534852.44528, 'last_price_update_time': 1774534852.445307}
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601078986606') HTTP/1.1" 204 0
2026-03-26 14:20:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:20:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa5bad93a50>
2026-03-26 14:20:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:20:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d22b8cca-1a5a-5b78-a21e-4782a9a14f52/d22b8cca-1a5a-5b78-a21e-4782a9a14f52_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6532c71fa0604758b47e8c5ad98a9164.jpg') HTTP/1.1" 204 0
2026-03-26 14:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6532c71fa0604758b47e8c5ad98a9164.jpg saved to cache
2026-03-26 14:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d22b8cca-1a5a-5b78-a21e-4782a9a14f52
2026-03-26 14:20:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d22b8cca-1a5a-5b78-a21e-4782a9a14f52 sending to next pipeline
2026-03-26 14:20:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:20:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa5bab6e750>
2026-03-26 14:20:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:20:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a5d865e-b376-50ab-a238-66cc324a69a9/2a5d865e-b376-50ab-a238-66cc324a69a9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F23cdb0b3ca33493faaa4a5fdb43a790c.jpg') HTTP/1.1" 204 0
2026-03-26 14:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/23cdb0b3ca33493faaa4a5fdb43a790c.jpg saved to cache
2026-03-26 14:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2a5d865e-b376-50ab-a238-66cc324a69a9
2026-03-26 14:20:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2a5d865e-b376-50ab-a238-66cc324a69a9 sending to next pipeline
2026-03-26 14:20:52 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d22b8cca-1a5a-5b78-a21e-4782a9a14f52 with identifier 202509116242864
2026-03-26 14:20:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:52 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d22b8cca-1a5a-5b78-a21e-4782a9a14f52
2026-03-26 14:20:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/6532c71fa0604758b47e8c5ad98a9164.jpg>
{'auction_title': '',
'c_o_2_emission_value': 150,
'color': 'Blue',
'currency': 'GBP',
'description': 'This 2018 Audi S3 TFSI Black Edition features a powerful 2.0 '
'litre petrol engine paired with a four wheel drive system, '
'ensuring excellent performance and grip. As a Euro 6 '
'compliant vehicle, it meets modern emissions standards. '
"Inside, you'll find a luxurious Bang and Olufsen sound system "
'to enhance your driving experience, along with heated front '
'seats for added comfort. The Black Edition trim also includes '
'LED headlights with dynamic rear indicators for improved '
'visibility and a sophisticated look, complemented by an auto '
'dimming rear view mirror with light and rain sensors.\n'
'\n'
'The Audi S3 TFSI Black Edition truly stands out with its '
'impressive acceleration, reaching 0-62mph in a swift 4.6 '
'seconds. This performance capability indicates its superior '
'dynamic ability compared to many other vehicles in its class. '
'Practicality is also a strong point, with generous boot space '
'making it suitable for everyday use and longer journeys. Rear '
'parking sensors are included to assist with manoeuvring, '
'adding to the overall convenience and safety of this well '
'equipped Audi S3.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 306,
'fuel_type': 'Petrol',
'id': 'd22b8cca-1a5a-5b78-a21e-4782a9a14f52',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509116242864',
'listing': 'directbuy',
'location': 'Leeds, Yorkshire',
'make': 'Audi',
'model': 'S3',
'odometer': 61794,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 33,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d22b8cca-1a5a-5b78-a21e-4782a9a14f52/d22b8cca-1a5a-5b78-a21e-4782a9a14f52_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319326,
'Height': 1280,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6532c71fa0604758b47e8c5ad98a9164.jpg',
'Width': 1920}],
'price': 19495,
'price_includes_vat': True,
'registration_date': '2018-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'Audi S3 Sportback 2.0 TFSI Black Edition Quattro Semi-Auto 4WD 5dr',
'transmission': 'automatic',
'trim': 'Black Edition',
'year': 2018}
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509116242864%27 HTTP/1.1" 200 None
2026-03-26 14:20:52 [auto_selling_autotrader.co.uk] INFO: Saving data for 202509116242864: {'created_time': 1774534852.663676, 'last_price_update_time': 1774534852.66369}
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509116242864') HTTP/1.1" 204 0
2026-03-26 14:20:52 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2a5d865e-b376-50ab-a238-66cc324a69a9 with identifier 202509015942291
2026-03-26 14:20:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:52 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2a5d865e-b376-50ab-a238-66cc324a69a9
2026-03-26 14:20:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/23cdb0b3ca33493faaa4a5fdb43a790c.jpg>
{'auction_title': '',
'c_o_2_emission_value': 209,
'color': 'Black',
'currency': 'GBP',
'description': 'Introducing this stunning 1 off BMW M2 Competition Edition, '
'With only 52247 miles on the clock, this beauty is ready to '
'hit the road in style.\n'
'\n'
'Wrapped in a bespoke in Black And Green vinyl, this BMW M2 is '
"a real head-turner wherever it goes. But it's not just about "
'looks - this car comes loaded with extras to enhance your '
'driving experience. Starting with the engine it has an TEK '
'switchable map, Remus exhaust racing silencer, Active '
'Autowerke mid pipe, ITG pro filter, S55 Insane 4 pin crank '
'hub. All this equates to a proven engine power of 560bhp. To '
'help with slowing the M2 down its has Ferodo pads all round '
'along with HEL braided brake lines and racing brake fluid.\n'
'\n'
'Onto the outside the M2 has an upgraded fully carbon bonnet, '
'rear spoiler & diffuser and sits on Vossen 19" alloys wrapped '
'in Continental tyres.\n'
'\n'
'Enjoy crystal-clear sound with the Loudspeaker System by '
'Harman Kardon, and stay safe on the road with features like '
'Exterior Mirrors that are Electrically Folding with Anti '
'Dazzle, BMW Icon Adaptive LED Headlights, and High-Beam '
'Assistant.\n'
'\n'
'The interior of this M2 is just as impressive, with features '
"like Seat Adjustment that's Front Electric with Driver "
'Memory, Seat Heating for Driver and Front Passenger, and '
'Dakota Leather seats in Black with Blue Highlight and '
'Perforated Design for a touch of luxury.\n'
'\n'
'And with Comfort Access System and Speed Limit Info, every '
"drive in this M2 will be a breeze. Don't miss out on the "
'opportunity to own this exceptional vehicle. Drive home in '
'style with the BMW M2 3.0 Competition Edition Auto 2dr today.',
'doors_number': 2,
'emission_standard': 'Euro 6',
'engine': '3L',
'engine_horse_power': 404,
'fuel_type': 'Petrol',
'id': '2a5d865e-b376-50ab-a238-66cc324a69a9',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509015942291',
'listing': 'directbuy',
'location': 'Leeds, Yorkshire',
'make': 'BMW',
'model': 'M2',
'odometer': 52247,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 44,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a5d865e-b376-50ab-a238-66cc324a69a9/2a5d865e-b376-50ab-a238-66cc324a69a9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305568,
'Height': 1280,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/23cdb0b3ca33493faaa4a5fdb43a790c.jpg',
'Width': 1920}],
'price': 36495,
'price_includes_vat': True,
'registration_date': '2019-01-30',
'seats_number': 4,
'seller_name': None,
'title': 'BMW M2 3.0 Competition Edition Auto 2dr',
'transmission': 'automatic',
'trim': 'Competition',
'year': 2019}
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509015942291%27 HTTP/1.1" 200 None
2026-03-26 14:20:52 [auto_selling_autotrader.co.uk] INFO: Saving data for 202509015942291: {'created_time': 1774534852.722241, 'last_price_update_time': 1774534852.722252}
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509015942291') HTTP/1.1" 204 0
2026-03-26 14:20:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:20:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa5b9a6ac90>
2026-03-26 14:20:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:20:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64738358-16d9-575e-91ee-304575332e53/64738358-16d9-575e-91ee-304575332e53_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F06b01dc1256d431383fd88c447810c67.jpg') HTTP/1.1" 204 0
2026-03-26 14:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/06b01dc1256d431383fd88c447810c67.jpg saved to cache
2026-03-26 14:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 64738358-16d9-575e-91ee-304575332e53
2026-03-26 14:20:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 64738358-16d9-575e-91ee-304575332e53 sending to next pipeline
2026-03-26 14:20:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:20:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa5bad72210>
2026-03-26 14:20:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:20:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_764471bc-b649-5e64-860f-f025934c35f3/764471bc-b649-5e64-860f-f025934c35f3_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F89b287d671434de89ed4596cabb7aeb7.jpg') HTTP/1.1" 204 0
2026-03-26 14:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/89b287d671434de89ed4596cabb7aeb7.jpg saved to cache
2026-03-26 14:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 764471bc-b649-5e64-860f-f025934c35f3
2026-03-26 14:20:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 764471bc-b649-5e64-860f-f025934c35f3 sending to next pipeline
2026-03-26 14:20:52 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 64738358-16d9-575e-91ee-304575332e53 with identifier 202601199254798
2026-03-26 14:20:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:52 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 64738358-16d9-575e-91ee-304575332e53
2026-03-26 14:20:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/06b01dc1256d431383fd88c447810c67.jpg>
{'auction_title': '',
'c_o_2_emission_value': 174,
'color': 'Blue',
'currency': 'GBP',
'description': 'Introducing the Audi Q5 3.0 SQ5 + TDI Quattro Auto 4WD 5dr in '
'a stunning Blue finish. This exceptional vehicle comes with a '
'range of luxurious extras to enhance your driving '
'experience.\n'
'\n'
'Feel the power of the Bang and Olufsen Sound System as you '
'cruise down the road in style. The Adaptive Cruise Control '
'ensures a smooth and safe journey, while the Audi Drive '
'Select allows you to tailor your driving experience to suit '
'your preferences.\n'
'\n'
'Stay comfortable and in control with features like Heated '
'Front Seats and Door Mirrors that are Heated-Electrically '
'Adjustable-Folding. The Running Boards add a touch of '
'sophistication, while the Headlights with High-Beam Assist '
'provide excellent visibility on the road.\n'
'\n'
'Step inside the Audi Q5 and experience the luxury of Inlays '
'in Carbon Atlas and Fine Nappa Leather Sports Seats with '
'Diamond Stitching in Black. The Palace Blue exterior adds a '
'touch of elegance to this already impressive vehicle.\n'
'\n'
"Don't miss out on the opportunity to own this exceptional "
'Audi Q5. Contact us today to schedule a test drive and '
'experience luxury driving at its finest.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '3L',
'engine_horse_power': 335,
'fuel_type': 'Diesel',
'id': '64738358-16d9-575e-91ee-304575332e53',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601199254798',
'listing': 'directbuy',
'location': 'Leeds, Yorkshire',
'make': 'Audi',
'model': 'SQ5',
'odometer': 119944,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 33,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64738358-16d9-575e-91ee-304575332e53/64738358-16d9-575e-91ee-304575332e53_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 422936,
'Height': 1440,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/06b01dc1256d431383fd88c447810c67.jpg',
'Width': 1920}],
'price': 15495,
'price_includes_vat': True,
'registration_date': '2016-10-06',
'seats_number': 5,
'seller_name': None,
'title': 'Audi SQ5 3.0 BiTDI V6 Plus SUV 5dr Diesel Tiptronic quattro Euro 6 '
'(s/s) (340 ps)',
'transmission': 'automatic',
'trim': 'Plus',
'year': 2016}
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601199254798%27 HTTP/1.1" 200 None
2026-03-26 14:20:52 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601199254798: {'created_time': 1774534852.931295, 'last_price_update_time': 1774534852.931306}
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601199254798') HTTP/1.1" 204 0
2026-03-26 14:20:52 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 764471bc-b649-5e64-860f-f025934c35f3 with identifier 202508225674087
2026-03-26 14:20:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:52 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 764471bc-b649-5e64-860f-f025934c35f3
2026-03-26 14:20:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/89b287d671434de89ed4596cabb7aeb7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 159,
'color': 'Black',
'currency': 'GBP',
'description': 'Boasting exceptionally low mileage for its age, this 2016 '
'Audi S3 TFSI presents a compelling proposition. Powered by a '
"2.0 litre petrol engine and featuring Audi's renowned four "
'wheel drive system, this Euro 6 compliant model offers a '
"dynamic driving experience. Inside, you'll find comfort and "
'convenience with heated front seats, dual zone electronic '
'climate control, and Bluetooth mobile telephone preparation. '
'The Bi-Xenon Plus headlights provide excellent visibility, '
'complemented by a tyre pressure monitoring system for added '
'peace of mind.\n'
'\n'
'This Audi S3 stands out with its impressive acceleration, '
'achieving 0-62mph in just 4.8 seconds, a performance '
'benchmark that sets it apart from many similar vehicles. The '
'generous boot space ensures practicality for everyday use and '
'longer journeys. These highlights collectively demonstrate '
'the superior engineering and thoughtful design that make this '
'S3 a distinguished choice in its class.',
'doors_number': 3,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 296,
'fuel_type': 'Petrol',
'id': '764471bc-b649-5e64-860f-f025934c35f3',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202508225674087',
'listing': 'directbuy',
'location': 'Leeds, Yorkshire',
'make': 'Audi',
'model': 'S3',
'odometer': 25469,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 37,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_764471bc-b649-5e64-860f-f025934c35f3/764471bc-b649-5e64-860f-f025934c35f3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 349961,
'Height': 1280,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/89b287d671434de89ed4596cabb7aeb7.jpg',
'Width': 1920}],
'price': 19495,
'price_includes_vat': True,
'registration_date': '2016-01-09',
'seats_number': 5,
'seller_name': None,
'title': 'Audi S3 2.0 Quattro Semi-Auto 4WD 3dr',
'transmission': 'automatic',
'year': 2016}
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508225674087%27 HTTP/1.1" 200 None
2026-03-26 14:20:52 [auto_selling_autotrader.co.uk] INFO: Saving data for 202508225674087: {'created_time': 1774534852.978742, 'last_price_update_time': 1774534852.978752}
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202508225674087') HTTP/1.1" 204 0
2026-03-26 14:20:52 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-26 14:20:52 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close cursor: 'SaveToCdlqDbAutoSelling' object has no attribute 'cursor'
2026-03-26 14:20:52 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close connection: 'SaveToCdlqDbAutoSelling' object has no attribute 'conn'
2026-03-26 14:20:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:20:53 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process scrape complete CloudEvent for item f494d002291e11f18f76c264925fbcfa
2026-03-26 14:20:53 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 14:20:53 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 14:20:53 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 14:20:53 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 14:20:53 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 14:20:53 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.MAPPED: 3> -> <SessionState.END_SENT: 4>
2026-03-26 14:20:53 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPENED: 9> -> <ConnectionState.CLOSE_SENT: 11>
2026-03-26 14:20:53 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.CLOSE_SENT: 11> -> <ConnectionState.END: 13>
2026-03-26 14:20:53 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.END_SENT: 4> -> <SessionState.DISCARDING: 6>
2026-03-26 14:20:53 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 14:20:53 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 14:20:53 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 14:20:53 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 14:20:53 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 14:20:53 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: [AzureBusPipeline] connection closed
2026-03-26 14:20:53 [auto_selling_autotrader.co.uk] INFO: auto_selling_autotrader.co.uk Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2026-03-26 14:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20last_price_update_time%20lt%201773238853 HTTP/1.1" 200 None
2026-03-26 14:20:54 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (18 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto_selling_autotrader.co.uk/f494d002291e11f18f76c264925fbcfa.jl
2026-03-26 14:20:54 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 143901,
'downloader/request_count': 21,
'downloader/request_method_count/GET': 18,
'downloader/request_method_count/POST': 3,
'downloader/response_bytes': 7226765,
'downloader/response_count': 21,
'downloader/response_status_count/200': 21,
'elapsed_time_seconds': 14.257605,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 26, 14, 20, 54, 138381, tzinfo=datetime.timezone.utc),
'item_scraped_count': 18,
'log_count/DEBUG': 338,
'log_count/INFO': 316,
'memusage/max': 147333120,
'memusage/startup': 147333120,
'photo_download_count': 18,
'request_depth_max': 2,
'response_received_count': 3,
'scheduler/dequeued': 21,
'scheduler/dequeued/memory': 21,
'scheduler/enqueued': 21,
'scheduler/enqueued/memory': 21,
'scrape_type/new': 18,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 3,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 2.1258566956967115,
'scrapy-zyte-api/mean_response_seconds': 2.21857233500729,
'scrapy-zyte-api/processed': 3,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 3,
'scrapy-zyte-api/request_args/experimental.requestCookies': 2,
'scrapy-zyte-api/request_args/experimental.responseCookies': 3,
'scrapy-zyte-api/request_args/httpRequestBody': 3,
'scrapy-zyte-api/request_args/httpRequestMethod': 3,
'scrapy-zyte-api/request_args/httpResponseBody': 3,
'scrapy-zyte-api/request_args/httpResponseHeaders': 3,
'scrapy-zyte-api/request_args/url': 3,
'scrapy-zyte-api/status_codes/200': 3,
'scrapy-zyte-api/success': 3,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'start_time': datetime.datetime(2026, 3, 26, 14, 20, 39, 880776, tzinfo=datetime.timezone.utc)}
2026-03-26 14:20:54 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-26 14:20:54 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fa5bdd6b450>
2026-03-26 14:20:54 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fa5bdd6bc90>