2026-03-25 17:06:34 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-25 17:06:34 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-25 17:06:34 [auto_selling_autotrader.co.uk] INFO: Starting auto_selling_autotrader.co.uk spider
2026-03-25 17:06:34 [auto_selling_autotrader.co.uk] INFO: Quick mode enabled: batching detail requests in groups of 10
2026-03-25 17:06:34 [auto_selling_autotrader.co.uk] INFO: Limiting photo downloads to 1 per item
2026-03-25 17:06:34 [auto_selling_autotrader.co.uk] INFO: _job: f757bf82286c11f18f76c264925fbcfa, SCRAPY_JOB: None
2026-03-25 17:06:34 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-25 17:06:34 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-25 17:06:34 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-25 17:06:34 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-25 17:06:34 [scrapy.extensions.telnet] INFO: Telnet Password: a3d18d8b90df9805
2026-03-25 17:06:34 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-25 17:06:34 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 3600,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto_selling_autotrader.co.uk/f757bf82286c11f18f76c264925fbcfa.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-25 17:06:34 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-25 17:06:34 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-25 17:06:34 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-25 17:06:35 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware for auto_selling
2026-03-25 17:06:35 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.auto_selling.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-25 17:06:35 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.post_to_azurebus_auto_selling.AzureBusPipelineAutoSelling',
 'crawlers.pipelines.save_to_cdlq_db_auto_selling.SaveToCdlqDbAutoSelling']
2026-03-25 17:06:35 [scrapy.core.engine] INFO: Spider opened
2026-03-25 17:06:35 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-25 17:06:35 [common.service_bus.service_bus_client_factory] INFO: ServiceBusClient initialized via DefaultAzureCredential for alx-production-bus.servicebus.windows.net
2026-03-25 17:06:35 [crawlers.pipelines.base_azure_bus_pipeline] INFO: [AzureBusPipeline] Connected to topic auto.sourcing-v2-quickmode
2026-03-25 17:06:35 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-25 17:06:35 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-25 17:06:35 [scrapy.extensions.memusage] INFO: Peak memory usage is 140MiB
2026-03-25 17:06:35 [scrapy-playwright] INFO: Starting download handler
2026-03-25 17:06:35 [scrapy-playwright] INFO: Starting download handler
2026-03-25 17:06:40 [auto_selling_autotrader.co.uk] INFO: Scraper started with retailer ID: 466929 and multipost_profile_id: 5a8e4fa9-1e98-4f8e-9791-71c32e06da79 and job_id: f757bf82286c11f18f76c264925fbcfa and url: https://www.autotrader.co.uk/dealers/motorsound-466929
2026-03-25 17:06:40 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 466929, page: 1
2026-03-25 17:06:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 17:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: None) ['zyte-api']
2026-03-25 17:06:41 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-25 17:06:41 [auto_selling_autotrader.co.uk] INFO: Page: 1/3, total results: 58
2026-03-25 17:06:41 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2119
2026-03-25 17:06:41 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603251003782%27 HTTP/1.1" 200 None
2026-03-25 17:06:41 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603251003782: 1
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603250999414%27 HTTP/1.1" 200 None
2026-03-25 17:06:41 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603250999414: 1
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603240967913%27 HTTP/1.1" 200 None
2026-03-25 17:06:41 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603240967913: 1
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603240964025%27 HTTP/1.1" 200 None
2026-03-25 17:06:41 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603240964025: 1
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603240963838%27 HTTP/1.1" 200 None
2026-03-25 17:06:41 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603240963838: 1
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603190840337%27 HTTP/1.1" 200 None
2026-03-25 17:06:41 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603190840337: 1
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603190839821%27 HTTP/1.1" 200 None
2026-03-25 17:06:41 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603190839821: 1
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603190839653%27 HTTP/1.1" 200 None
2026-03-25 17:06:41 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603190839653: 1
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603170776014%27 HTTP/1.1" 200 None
2026-03-25 17:06:41 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603170776014: 1
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603130682264%27 HTTP/1.1" 200 None
2026-03-25 17:06:41 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603130682264: 1
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120649257%27 HTTP/1.1" 200 None
2026-03-25 17:06:41 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603120649257: 1
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110615591%27 HTTP/1.1" 200 None
2026-03-25 17:06:41 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603110615591: 1
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603100579372%27 HTTP/1.1" 200 None
2026-03-25 17:06:41 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603100579372: 1
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603090543602%27 HTTP/1.1" 200 None
2026-03-25 17:06:41 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603090543602: 1
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603070496367%27 HTTP/1.1" 200 None
2026-03-25 17:06:41 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603070496367: 1
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603060477119%27 HTTP/1.1" 200 None
2026-03-25 17:06:41 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603060477119: 1
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603060477073%27 HTTP/1.1" 200 None
2026-03-25 17:06:41 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603060477073: 1
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603060476998%27 HTTP/1.1" 200 None
2026-03-25 17:06:41 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603060476998: 1
2026-03-25 17:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603060476905%27 HTTP/1.1" 200 None
2026-03-25 17:06:42 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603060476905: 1
2026-03-25 17:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040409714%27 HTTP/1.1" 200 None
2026-03-25 17:06:42 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603040409714: 1
2026-03-25 17:06:42 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-25 17:06:42 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-25 17:06:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 17:06:42 [auto_selling_autotrader.co.uk] INFO: Getting next page: 2
2026-03-25 17:06:42 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 466929, page: 2
2026-03-25 17:06:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 17:06:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 17:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-25 17:06:43 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-25 17:06:43 [auto_selling_autotrader.co.uk] INFO: Page: 2/3, total results: 58
2026-03-25 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040389792%27 HTTP/1.1" 200 None
2026-03-25 17:06:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603040389792: 1
2026-03-25 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603020339824%27 HTTP/1.1" 200 None
2026-03-25 17:06:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603020339824: 1
2026-03-25 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603020337447%27 HTTP/1.1" 200 None
2026-03-25 17:06:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603020337447: 1
2026-03-25 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602270277170%27 HTTP/1.1" 200 None
2026-03-25 17:06:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602270277170: 1
2026-03-25 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602270269018%27 HTTP/1.1" 200 None
2026-03-25 17:06:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602270269018: 1
2026-03-25 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602270268861%27 HTTP/1.1" 200 None
2026-03-25 17:06:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602270268861: 1
2026-03-25 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602240165917%27 HTTP/1.1" 200 None
2026-03-25 17:06:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602240165917: 1
2026-03-25 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602210112727%27 HTTP/1.1" 200 None
2026-03-25 17:06:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602210112727: 1
2026-03-25 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602210109681%27 HTTP/1.1" 200 None
2026-03-25 17:06:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602210109681: 1
2026-03-25 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602200091319%27 HTTP/1.1" 200 None
2026-03-25 17:06:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602200091319: 1
2026-03-25 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602200091257%27 HTTP/1.1" 200 None
2026-03-25 17:06:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602200091257: 1
2026-03-25 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602169972876%27 HTTP/1.1" 200 None
2026-03-25 17:06:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602169972876: 1
2026-03-25 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602149926350%27 HTTP/1.1" 200 None
2026-03-25 17:06:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602149926350: 1
2026-03-25 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602079757399%27 HTTP/1.1" 200 None
2026-03-25 17:06:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602079757399: 1
2026-03-25 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602059707540%27 HTTP/1.1" 200 None
2026-03-25 17:06:44 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602059707540: 1
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602049676263%27 HTTP/1.1" 200 None
2026-03-25 17:06:44 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602049676263: 1
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602049672089%27 HTTP/1.1" 200 None
2026-03-25 17:06:44 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602049672089: 1
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602049671970%27 HTTP/1.1" 200 None
2026-03-25 17:06:44 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602049671970: 1
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601309555554%27 HTTP/1.1" 200 None
2026-03-25 17:06:44 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601309555554: 1
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601239367678%27 HTTP/1.1" 200 None
2026-03-25 17:06:44 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601239367678: 1
2026-03-25 17:06:44 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-25 17:06:44 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-25 17:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-25 17:06:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 17:06:44 [auto_selling_autotrader.co.uk] INFO: Getting next page: 3
2026-03-25 17:06:44 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 466929, page: 3
2026-03-25 17:06:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 17:06:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 17:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-25 17:06:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 36c6472d-58b4-5982-8579-0107dbfb5663 with identifier: 202603120649257
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 36c6472d-58b4-5982-8579-0107dbfb5663
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F18f17379d7184586a6519943effaa5e7.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/18f17379d7184586a6519943effaa5e7.jpg not downloaded yet
2026-03-25 17:06:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 95406732-25a3-5683-9856-15fecc39a1f2 with identifier: 202603110615591
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 95406732-25a3-5683-9856-15fecc39a1f2
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0930fd5b3b5b4a1989f62557cd96371a.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0930fd5b3b5b4a1989f62557cd96371a.jpg not downloaded yet
2026-03-25 17:06:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c9a405e-fbec-5919-93d6-82cd0e4eeafd with identifier: 202603100579372
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4c9a405e-fbec-5919-93d6-82cd0e4eeafd
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffdb18b961ef7411195474c33e0d58a01.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fdb18b961ef7411195474c33e0d58a01.jpg not downloaded yet
2026-03-25 17:06:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 63a9f285-d153-5f34-9852-adab53f9022a with identifier: 202603090543602
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 63a9f285-d153-5f34-9852-adab53f9022a
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb3295be59e104b27beb06a7bd5fdda9d.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b3295be59e104b27beb06a7bd5fdda9d.jpg not downloaded yet
2026-03-25 17:06:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 38b6f0ac-7f7f-5ed3-a165-25053973e7f0 with identifier: 202603070496367
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 38b6f0ac-7f7f-5ed3-a165-25053973e7f0
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd65c48dce83d41269cfaa7b9ea6b38e6.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d65c48dce83d41269cfaa7b9ea6b38e6.jpg not downloaded yet
2026-03-25 17:06:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c27e83c-0b3b-577b-95f7-39c2877980d9 with identifier: 202603251003782
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7c27e83c-0b3b-577b-95f7-39c2877980d9
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0f1b501062164102b34926c1c726629f.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0f1b501062164102b34926c1c726629f.jpg not downloaded yet
2026-03-25 17:06:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e6a93bbf-7270-5c39-bd41-eb9c9425fc2c with identifier: 202603060477119
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e6a93bbf-7270-5c39-bd41-eb9c9425fc2c
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc7b4465515fb438098ae602631b24607.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c7b4465515fb438098ae602631b24607.jpg not downloaded yet
2026-03-25 17:06:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7170c27f-b93c-5386-8a06-0823994320ab with identifier: 202603250999414
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7170c27f-b93c-5386-8a06-0823994320ab
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0a3b3a5b1da94d8ab46c4841ae8ef396.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0a3b3a5b1da94d8ab46c4841ae8ef396.jpg not downloaded yet
2026-03-25 17:06:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 8259c633-5c1d-5928-a022-0e82d9b6d304 with identifier: 202603060477073
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8259c633-5c1d-5928-a022-0e82d9b6d304
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff3ba0d4a752849baada20641f24400ca.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f3ba0d4a752849baada20641f24400ca.jpg not downloaded yet
2026-03-25 17:06:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b6d6298-d27c-535a-b3d2-8b8adad0268c with identifier: 202603240967913
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5b6d6298-d27c-535a-b3d2-8b8adad0268c
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd3d95a8707ba4d07bbc98c23f16f55c7.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d3d95a8707ba4d07bbc98c23f16f55c7.jpg not downloaded yet
2026-03-25 17:06:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e7dc3a7-1a66-5fa4-abf2-ce47eeb2bbad with identifier: 202603060476998
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1e7dc3a7-1a66-5fa4-abf2-ce47eeb2bbad
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6b2f9a19845d4b29bd171fb49602fd1a.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6b2f9a19845d4b29bd171fb49602fd1a.jpg not downloaded yet
2026-03-25 17:06:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b6e1ae3f-fd87-57c7-9cf6-611cb4ebaedf with identifier: 202603240964025
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b6e1ae3f-fd87-57c7-9cf6-611cb4ebaedf
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb509ab07394340bc8c07d58fc59271b3.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b509ab07394340bc8c07d58fc59271b3.jpg not downloaded yet
2026-03-25 17:06:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ba98578c-f2f2-52bc-807a-ed6c6d7fc8f2 with identifier: 202603060476905
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ba98578c-f2f2-52bc-807a-ed6c6d7fc8f2
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8a3acc0088ad4b8c847e93f36e3c3d9c.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8a3acc0088ad4b8c847e93f36e3c3d9c.jpg not downloaded yet
2026-03-25 17:06:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 31af306b-e983-5ef1-8747-1b1118ce025f with identifier: 202603240963838
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 31af306b-e983-5ef1-8747-1b1118ce025f
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe40b5bd7893b4fd097f8f9d0ce1093fc.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e40b5bd7893b4fd097f8f9d0ce1093fc.jpg not downloaded yet
2026-03-25 17:06:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c8725a3-b755-5f7d-a860-7e1d9b89eb11 with identifier: 202603040409714
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0c8725a3-b755-5f7d-a860-7e1d9b89eb11
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa8d3f5c8d76c4e128992a7569e21136a.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a8d3f5c8d76c4e128992a7569e21136a.jpg not downloaded yet
2026-03-25 17:06:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f7ef53c-ff31-5d94-8125-d9b4fc3ea686 with identifier: 202603190840337
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1f7ef53c-ff31-5d94-8125-d9b4fc3ea686
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2cfb8006d23e47b4a45ebb7e70f35e33.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2cfb8006d23e47b4a45ebb7e70f35e33.jpg not downloaded yet
2026-03-25 17:06:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a4f6cc47-d16b-5752-926e-32cbed6bfd43 with identifier: 202603190839821
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a4f6cc47-d16b-5752-926e-32cbed6bfd43
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc49485ba3dc5488d8b9934e093aae70d.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c49485ba3dc5488d8b9934e093aae70d.jpg not downloaded yet
2026-03-25 17:06:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ec73c8e-b003-54b6-8e8e-8e67753b1a1c with identifier: 202603190839653
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2ec73c8e-b003-54b6-8e8e-8e67753b1a1c
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F423724fcd33f435d8ba143ac439c4aaa.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/423724fcd33f435d8ba143ac439c4aaa.jpg not downloaded yet
2026-03-25 17:06:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2df9163c-2b25-5840-af4c-01c73699373f with identifier: 202603170776014
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2df9163c-2b25-5840-af4c-01c73699373f
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6158856f930243989ee2a349ef7451b8.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6158856f930243989ee2a349ef7451b8.jpg not downloaded yet
2026-03-25 17:06:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: aac5b60f-688a-5984-b9af-1e694e107ef5 with identifier: 202603130682264
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item aac5b60f-688a-5984-b9af-1e694e107ef5
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F952f2351102546679b88cdc1b99f9999.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/952f2351102546679b88cdc1b99f9999.jpg not downloaded yet
2026-03-25 17:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/18f17379d7184586a6519943effaa5e7.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/b3295be59e104b27beb06a7bd5fdda9d.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/0930fd5b3b5b4a1989f62557cd96371a.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/fdb18b961ef7411195474c33e0d58a01.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/f3ba0d4a752849baada20641f24400ca.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/6b2f9a19845d4b29bd171fb49602fd1a.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/0a3b3a5b1da94d8ab46c4841ae8ef396.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-25 17:06:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-25 17:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66e150a90>
2026-03-25 17:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-25 17:06:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2114
2026-03-25 17:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-25 17:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36c6472d-58b4-5982-8579-0107dbfb5663/36c6472d-58b4-5982-8579-0107dbfb5663_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F18f17379d7184586a6519943effaa5e7.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/18f17379d7184586a6519943effaa5e7.jpg saved to cache
2026-03-25 17:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36c6472d-58b4-5982-8579-0107dbfb5663
2026-03-25 17:06:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36c6472d-58b4-5982-8579-0107dbfb5663 sending to next pipeline
2026-03-25 17:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c320050>
2026-03-25 17:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63a9f285-d153-5f34-9852-adab53f9022a/63a9f285-d153-5f34-9852-adab53f9022a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb3295be59e104b27beb06a7bd5fdda9d.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b3295be59e104b27beb06a7bd5fdda9d.jpg saved to cache
2026-03-25 17:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 63a9f285-d153-5f34-9852-adab53f9022a
2026-03-25 17:06:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 63a9f285-d153-5f34-9852-adab53f9022a sending to next pipeline
2026-03-25 17:06:45 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 36c6472d-58b4-5982-8579-0107dbfb5663 with identifier 202603120649257
2026-03-25 17:06:45 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: None -> <ConnectionState.START: 0>
2026-03-25 17:06:45 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.START: 0> -> <ConnectionState.HDR_SENT: 2>
2026-03-25 17:06:45 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.HDR_SENT: 2>
2026-03-25 17:06:45 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.OPEN_PIPE: 4>
2026-03-25 17:06:45 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.UNMAPPED: 0> -> <SessionState.BEGIN_SENT: 1>
2026-03-25 17:06:45 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-25 17:06:45 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-25 17:06:45 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-25 17:06:45 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-25 17:06:45 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_PIPE: 4> -> <ConnectionState.OPEN_SENT: 7>
2026-03-25 17:06:45 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_SENT: 7> -> <ConnectionState.OPENED: 9>
2026-03-25 17:06:45 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.BEGIN_SENT: 1> -> <SessionState.MAPPED: 3>
2026-03-25 17:06:45 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-25 17:06:45 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-25 17:06:45 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-25 17:06:45 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-25 17:06:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS completed opening with status: <ManagementOpenResult.OK: 1>
2026-03-25 17:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-25 17:06:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2021
2026-03-25 17:06:45 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-25 17:06:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774458405
2026-03-25 17:06:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774458405
2026-03-25 17:06:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS Put token result (<ManagementExecuteOperationResult.OK: 0>), status code: 202, status_description: b'Accepted'.
2026-03-25 17:06:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:45 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-25 17:06:45 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-25 17:06:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:45 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 36c6472d-58b4-5982-8579-0107dbfb5663
2026-03-25 17:06:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/18f17379d7184586a6519943effaa5e7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2021 Hyundai KONA Premium Electric boasts a single owner '
                'and an MOT valid until January 2027, offering excellent peace '
                'of mind. As a Premium trim electric vehicle, it features a '
                'substantial 68 kWh battery, providing an impressive maximum '
                'range of 300 miles when new. This KONA is designed for '
                'convenience, with a full charge at home using a 7kW charger '
                'taking approximately 10 hours and 16 minutes, and a rapid '
                'charge from empty to 80% achievable in just 53 minutes at a '
                'public charging station.\n'
                '\n'
                'The 300 mile maximum range at new is a significant advantage, '
                'demonstrating how this KONA offers superior travel distance '
                'compared to many other electric vehicles. This combination of '
                'long range, fast charging capabilities, and excellent '
                'provenance makes this 2021 Hyundai KONA Premium Electric a '
                'compelling choice for those seeking an efficient and reliable '
                'electric car. CALL 0161 633 3286/ 07867 314825. £399 admin '
                'fees apply where 3rd party finance companies are used.',
 'doors_number': 5,
 'engine_horse_power': 201,
 'fuel_type': 'Electric',
 'id': '36c6472d-58b4-5982-8579-0107dbfb5663',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603120649257',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Hyundai',
 'model': 'KONA',
 'odometer': 50000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 50,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36c6472d-58b4-5982-8579-0107dbfb5663/36c6472d-58b4-5982-8579-0107dbfb5663_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254234,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/18f17379d7184586a6519943effaa5e7.jpg',
             'Width': 1280}],
 'price': 11980,
 'price_includes_vat': True,
 'registration_date': '2021-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Kona 64kWh Premium SUV 5dr Electric Auto (10.5kW Charger) '
          '(204 ps)',
 'transmission': 'automatic',
 'trim': 'Premium',
 'year': 2021}
2026-03-25 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120649257%27 HTTP/1.1" 200 None
2026-03-25 17:06:45 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603120649257: {'created_time': 1774458405.865599, 'last_price_update_time': 1774458405.865609}
2026-03-25 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603120649257') HTTP/1.1" 204 0
2026-03-25 17:06:46 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 63a9f285-d153-5f34-9852-adab53f9022a with identifier 202603090543602
2026-03-25 17:06:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:46 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 63a9f285-d153-5f34-9852-adab53f9022a
2026-03-25 17:06:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/b3295be59e104b27beb06a7bd5fdda9d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'This 2022 Kia Sportage T GDi GT Line offers a superb blend of '
                'style and practicality, making it an excellent choice for '
                'discerning drivers. As a Euro 6 compliant model, it benefits '
                "from efficient 1.6 litre petrol performance. Inside, you'll "
                'find a host of convenient features designed to enhance your '
                'driving experience, including Android Auto and Apple Carplay '
                'with voice control, allowing seamless integration of your '
                'smartphone. For comfort in all seasons, the Sportage is '
                'equipped with heated front seats and a three zone climate '
                'control system, ensuring everyone stays comfortable.\n'
                '\n'
                'Navigating tight spaces is made easier with the rear view '
                'monitor and front parking sensors, providing added peace of '
                'mind. This particular GT Line model also boasts a generous '
                'boot space, perfect for luggage or shopping. Furthermore, its '
                'placement in a low insurance group indicates that running '
                'costs are kept to a minimum, offering excellent value '
                'compared to similar vehicles. CALL 0161 633 3286/ 07867 '
                '314825. £399 admin fees apply where 3rd party finance '
                'companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.6L',
 'engine_horse_power': 148,
 'fuel_type': 'Petrol',
 'id': '63a9f285-d153-5f34-9852-adab53f9022a',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603090543602',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 30000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 71,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63a9f285-d153-5f34-9852-adab53f9022a/63a9f285-d153-5f34-9852-adab53f9022a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237267,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/b3295be59e104b27beb06a7bd5fdda9d.jpg',
             'Width': 1280}],
 'price': 18990,
 'price_includes_vat': True,
 'registration_date': '2022-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Sportage 1.6 T-GDi GT-Line SUV 5dr Petrol',
 'transmission': 'manual',
 'trim': 'GT-Line',
 'year': 2022}
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603090543602%27 HTTP/1.1" 200 None
2026-03-25 17:06:46 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603090543602: {'created_time': 1774458406.199261, 'last_price_update_time': 1774458406.199272}
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603090543602') HTTP/1.1" 204 0
2026-03-25 17:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/d3d95a8707ba4d07bbc98c23f16f55c7.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/d65c48dce83d41269cfaa7b9ea6b38e6.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/0f1b501062164102b34926c1c726629f.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-25 17:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c160510>
2026-03-25 17:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95406732-25a3-5683-9856-15fecc39a1f2/95406732-25a3-5683-9856-15fecc39a1f2_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0930fd5b3b5b4a1989f62557cd96371a.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0930fd5b3b5b4a1989f62557cd96371a.jpg saved to cache
2026-03-25 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 95406732-25a3-5683-9856-15fecc39a1f2
2026-03-25 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 95406732-25a3-5683-9856-15fecc39a1f2 sending to next pipeline
2026-03-25 17:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c4f7cd0>
2026-03-25 17:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c9a405e-fbec-5919-93d6-82cd0e4eeafd/4c9a405e-fbec-5919-93d6-82cd0e4eeafd_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffdb18b961ef7411195474c33e0d58a01.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fdb18b961ef7411195474c33e0d58a01.jpg saved to cache
2026-03-25 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c9a405e-fbec-5919-93d6-82cd0e4eeafd
2026-03-25 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c9a405e-fbec-5919-93d6-82cd0e4eeafd sending to next pipeline
2026-03-25 17:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c4f7cd0>
2026-03-25 17:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8259c633-5c1d-5928-a022-0e82d9b6d304/8259c633-5c1d-5928-a022-0e82d9b6d304_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff3ba0d4a752849baada20641f24400ca.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f3ba0d4a752849baada20641f24400ca.jpg saved to cache
2026-03-25 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8259c633-5c1d-5928-a022-0e82d9b6d304
2026-03-25 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8259c633-5c1d-5928-a022-0e82d9b6d304 sending to next pipeline
2026-03-25 17:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c39a810>
2026-03-25 17:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e7dc3a7-1a66-5fa4-abf2-ce47eeb2bbad/1e7dc3a7-1a66-5fa4-abf2-ce47eeb2bbad_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6b2f9a19845d4b29bd171fb49602fd1a.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6b2f9a19845d4b29bd171fb49602fd1a.jpg saved to cache
2026-03-25 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1e7dc3a7-1a66-5fa4-abf2-ce47eeb2bbad
2026-03-25 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1e7dc3a7-1a66-5fa4-abf2-ce47eeb2bbad sending to next pipeline
2026-03-25 17:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66f53d810>
2026-03-25 17:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7170c27f-b93c-5386-8a06-0823994320ab/7170c27f-b93c-5386-8a06-0823994320ab_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0a3b3a5b1da94d8ab46c4841ae8ef396.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0a3b3a5b1da94d8ab46c4841ae8ef396.jpg saved to cache
2026-03-25 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7170c27f-b93c-5386-8a06-0823994320ab
2026-03-25 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7170c27f-b93c-5386-8a06-0823994320ab sending to next pipeline
2026-03-25 17:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/8a3acc0088ad4b8c847e93f36e3c3d9c.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/b509ab07394340bc8c07d58fc59271b3.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/952f2351102546679b88cdc1b99f9999.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/6158856f930243989ee2a349ef7451b8.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:46 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 95406732-25a3-5683-9856-15fecc39a1f2 with identifier 202603110615591
2026-03-25 17:06:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:46 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 95406732-25a3-5683-9856-15fecc39a1f2
2026-03-25 17:06:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/0930fd5b3b5b4a1989f62557cd96371a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'color': 'White',
 'currency': 'GBP',
 'description': 'Heated Seats, Heated Steering Wheel, Satellite Navigation, '
                'Bluetooth Connectivity, Cruise Control With Speed  Limiter, '
                'DAB Radio, Front & Rear Parking Aid Sensors With Reverse '
                'Camera, Electric Folding Door Mirrors, Finance Available, '
                'Extended Warranties Available, Part Exchange Welcome CALL '
                '0161 633 3286/ 07867 314825. £399 admin fees apply where 3rd '
                'party finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.6L',
 'engine_horse_power': 148,
 'fuel_type': 'Petrol',
 'id': '95406732-25a3-5683-9856-15fecc39a1f2',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603110615591',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Hyundai',
 'model': 'TUCSON',
 'odometer': 41000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 65,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95406732-25a3-5683-9856-15fecc39a1f2/95406732-25a3-5683-9856-15fecc39a1f2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205190,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/0930fd5b3b5b4a1989f62557cd96371a.jpg',
             'Width': 1280}],
 'price': 15780,
 'price_includes_vat': True,
 'registration_date': '2021-12-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDi Premium SUV 5dr Petrol',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2021}
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110615591%27 HTTP/1.1" 200 None
2026-03-25 17:06:46 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603110615591: {'created_time': 1774458406.541216, 'last_price_update_time': 1774458406.541225}
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603110615591') HTTP/1.1" 204 0
2026-03-25 17:06:46 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 4c9a405e-fbec-5919-93d6-82cd0e4eeafd with identifier 202603100579372
2026-03-25 17:06:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:46 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 4c9a405e-fbec-5919-93d6-82cd0e4eeafd
2026-03-25 17:06:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/fdb18b961ef7411195474c33e0d58a01.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'CALL 0161 633 3286/ 07867 314825. 399 admin fees apply where '
                '3rd party finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 79,
 'fuel_type': 'Petrol',
 'id': '4c9a405e-fbec-5919-93d6-82cd0e4eeafd',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603100579372',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'SEAT',
 'model': 'Ibiza',
 'odometer': 44000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 51,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c9a405e-fbec-5919-93d6-82cd0e4eeafd/4c9a405e-fbec-5919-93d6-82cd0e4eeafd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278957,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/fdb18b961ef7411195474c33e0d58a01.jpg',
             'Width': 1280}],
 'price': 10860,
 'price_includes_vat': True,
 'registration_date': '2019-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT Ibiza 1.0 MPI FR Hatchback 5dr Petrol',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2019}
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603100579372%27 HTTP/1.1" 200 None
2026-03-25 17:06:46 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603100579372: {'created_time': 1774458406.582007, 'last_price_update_time': 1774458406.582015}
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603100579372') HTTP/1.1" 204 0
2026-03-25 17:06:46 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 8259c633-5c1d-5928-a022-0e82d9b6d304 with identifier 202603060477073
2026-03-25 17:06:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:46 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 8259c633-5c1d-5928-a022-0e82d9b6d304
2026-03-25 17:06:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/f3ba0d4a752849baada20641f24400ca.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Yellow',
 'currency': 'GBP',
 'description': 'CALL 0161 633 3286/ 07867 314825. 399 admin fees apply where '
                '3rd party finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 148,
 'fuel_type': 'Petrol',
 'id': '8259c633-5c1d-5928-a022-0e82d9b6d304',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603060477073',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 71000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 58,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8259c633-5c1d-5928-a022-0e82d9b6d304/8259c633-5c1d-5928-a022-0e82d9b6d304_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 220116,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/f3ba0d4a752849baada20641f24400ca.jpg',
             'Width': 1280}],
 'price': 14388,
 'price_includes_vat': True,
 'registration_date': '2019-04-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A1 1.5 TFSI 35 S line Contrast Edition Sportback 5dr Petrol',
 'transmission': 'manual',
 'trim': 'S line Contrast Edition',
 'year': 2019}
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603060477073%27 HTTP/1.1" 200 None
2026-03-25 17:06:46 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603060477073: {'created_time': 1774458406.635916, 'last_price_update_time': 1774458406.635923}
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603060477073') HTTP/1.1" 204 0
2026-03-25 17:06:46 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 1e7dc3a7-1a66-5fa4-abf2-ce47eeb2bbad with identifier 202603060476998
2026-03-25 17:06:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:46 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 1e7dc3a7-1a66-5fa4-abf2-ce47eeb2bbad
2026-03-25 17:06:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/6b2f9a19845d4b29bd171fb49602fd1a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'CALL 0161 633 3286/ 07867 314825. £399 admin fees apply where '
                '3rd party finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 108,
 'fuel_type': 'Petrol',
 'id': '1e7dc3a7-1a66-5fa4-abf2-ce47eeb2bbad',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603060476998',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 22000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 59,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e7dc3a7-1a66-5fa4-abf2-ce47eeb2bbad/1e7dc3a7-1a66-5fa4-abf2-ce47eeb2bbad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243745,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/6b2f9a19845d4b29bd171fb49602fd1a.jpg',
             'Width': 1280}],
 'price': 17380,
 'price_includes_vat': True,
 'registration_date': '2023-03-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 1.0 TFSI 30 Sport Sportback 5dr Petrol',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2023}
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603060476998%27 HTTP/1.1" 200 None
2026-03-25 17:06:46 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603060476998: {'created_time': 1774458406.682274, 'last_price_update_time': 1774458406.682283}
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603060476998') HTTP/1.1" 204 0
2026-03-25 17:06:46 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7170c27f-b93c-5386-8a06-0823994320ab with identifier 202603250999414
2026-03-25 17:06:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:46 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7170c27f-b93c-5386-8a06-0823994320ab
2026-03-25 17:06:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/0a3b3a5b1da94d8ab46c4841ae8ef396.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This 2023 Nissan Juke DIG T Acenta is a superb example, '
                'having been owned by just one careful keeper. This stylish '
                'compact SUV boasts a responsive 1.0 litre petrol engine, '
                'meeting Euro 6 emissions standards. Its Acenta trim level '
                'comes equipped with essential modern conveniences, including '
                'LED headlights for enhanced visibility, a rear view camera to '
                'aid parking, and manual air conditioning to keep you '
                "comfortable. For seamless connectivity, you'll find a USB AUX "
                'socket, Bluetooth for hands free calls and audio streaming, '
                'and compatibility with Apple CarPlay and Google Android Auto, '
                "allowing you to easily access your smartphone's features on "
                'the go.\n'
                '\n'
                'The Nissan Juke DIG T Acenta offers an impressive fuel '
                'economy of 49 miles per gallon, demonstrating its efficiency '
                'compared to other vehicles in its class. Furthermore, its low '
                'CO2 emissions highlight its environmentally conscious design. '
                'This combination of excellent fuel efficiency and low '
                'emissions, alongside its comprehensive feature set and single '
                'owner provenance, makes this Juke a compelling choice for '
                'those seeking a practical and well equipped compact SUV. CALL '
                '0161 633 3286/ 07867 314825. £399 admin fees apply where 3rd '
                'party finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 112,
 'fuel_type': 'Petrol',
 'id': '7170c27f-b93c-5386-8a06-0823994320ab',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603250999414',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 24000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7170c27f-b93c-5386-8a06-0823994320ab/7170c27f-b93c-5386-8a06-0823994320ab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214397,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/0a3b3a5b1da94d8ab46c4841ae8ef396.jpg',
             'Width': 1280}],
 'price': 11840,
 'price_includes_vat': True,
 'registration_date': '2023-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Juke 1.0 DIG-T Acenta SUV 5dr Petrol',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2023}
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603250999414%27 HTTP/1.1" 200 None
2026-03-25 17:06:46 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603250999414: {'created_time': 1774458406.724476, 'last_price_update_time': 1774458406.724485}
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603250999414') HTTP/1.1" 204 0
2026-03-25 17:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/c7b4465515fb438098ae602631b24607.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-25 17:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66e174b90>
2026-03-25 17:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b6d6298-d27c-535a-b3d2-8b8adad0268c/5b6d6298-d27c-535a-b3d2-8b8adad0268c_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd3d95a8707ba4d07bbc98c23f16f55c7.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d3d95a8707ba4d07bbc98c23f16f55c7.jpg saved to cache
2026-03-25 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5b6d6298-d27c-535a-b3d2-8b8adad0268c
2026-03-25 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5b6d6298-d27c-535a-b3d2-8b8adad0268c sending to next pipeline
2026-03-25 17:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c12a110>
2026-03-25 17:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38b6f0ac-7f7f-5ed3-a165-25053973e7f0/38b6f0ac-7f7f-5ed3-a165-25053973e7f0_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd65c48dce83d41269cfaa7b9ea6b38e6.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d65c48dce83d41269cfaa7b9ea6b38e6.jpg saved to cache
2026-03-25 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 38b6f0ac-7f7f-5ed3-a165-25053973e7f0
2026-03-25 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 38b6f0ac-7f7f-5ed3-a165-25053973e7f0 sending to next pipeline
2026-03-25 17:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c388a10>
2026-03-25 17:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c27e83c-0b3b-577b-95f7-39c2877980d9/7c27e83c-0b3b-577b-95f7-39c2877980d9_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0f1b501062164102b34926c1c726629f.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0f1b501062164102b34926c1c726629f.jpg saved to cache
2026-03-25 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7c27e83c-0b3b-577b-95f7-39c2877980d9
2026-03-25 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7c27e83c-0b3b-577b-95f7-39c2877980d9 sending to next pipeline
2026-03-25 17:06:46 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-25 17:06:46 [auto_selling_autotrader.co.uk] INFO: Page: 3/3, total results: 58
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601219316270%27 HTTP/1.1" 200 None
2026-03-25 17:06:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601219316270: 1
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601089011901%27 HTTP/1.1" 200 None
2026-03-25 17:06:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601089011901: 1
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601068958239%27 HTTP/1.1" 200 None
2026-03-25 17:06:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601068958239: 1
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512058408672%27 HTTP/1.1" 200 None
2026-03-25 17:06:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512058408672: 1
2026-03-25 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512058408310%27 HTTP/1.1" 200 None
2026-03-25 17:06:47 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512058408310: 1
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511208030554%27 HTTP/1.1" 200 None
2026-03-25 17:06:47 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511208030554: 1
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511208030422%27 HTTP/1.1" 200 None
2026-03-25 17:06:47 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511208030422: 1
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511017579143%27 HTTP/1.1" 200 None
2026-03-25 17:06:47 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511017579143: 1
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510147134012%27 HTTP/1.1" 200 None
2026-03-25 17:06:47 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202510147134012: 1
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510107059106%27 HTTP/1.1" 200 None
2026-03-25 17:06:47 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202510107059106: 1
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510066924736%27 HTTP/1.1" 200 None
2026-03-25 17:06:47 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202510066924736: 1
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509256631993%27 HTTP/1.1" 200 None
2026-03-25 17:06:47 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202509256631993: 1
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509256618656%27 HTTP/1.1" 200 None
2026-03-25 17:06:47 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202509256618656: 1
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509236567553%27 HTTP/1.1" 200 None
2026-03-25 17:06:47 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202509236567553: 1
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509066098496%27 HTTP/1.1" 200 None
2026-03-25 17:06:47 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202509066098496: 1
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508075233334%27 HTTP/1.1" 200 None
2026-03-25 17:06:47 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202508075233334: 1
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508045125340%27 HTTP/1.1" 200 None
2026-03-25 17:06:47 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202508045125340: 1
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202505122301597%27 HTTP/1.1" 200 None
2026-03-25 17:06:47 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202505122301597: 1
2026-03-25 17:06:47 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-25 17:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/c49485ba3dc5488d8b9934e093aae70d.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:47 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 5b6d6298-d27c-535a-b3d2-8b8adad0268c with identifier 202603240967913
2026-03-25 17:06:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:47 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 5b6d6298-d27c-535a-b3d2-8b8adad0268c
2026-03-25 17:06:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/d3d95a8707ba4d07bbc98c23f16f55c7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'This 2020 Audi A3 TFSI S line boasts an MOT valid all the way '
                'until July 2026, offering you peace of mind for an extended '
                'period. This stylish hatchback is equipped with a 1.5 litre '
                'petrol engine and meets Euro 6 emissions standards. Inside, '
                "you'll find a Bluetooth interface for seamless connectivity, "
                'dual zone electronic climate control to keep everyone '
                'comfortable, and rear parking sensors to assist with '
                'manoeuvring. The striking LED headlights and LED rear lights, '
                'complete with dynamic rear indicators, ensure excellent '
                'visibility and a modern aesthetic.\n'
                '\n'
                'The Audi A3 TFSI S line is designed to impress, offering a '
                'fuel economy of 44 miles per gallon, which is a strong '
                'indicator of its efficiency compared to other vehicles in its '
                'class. Furthermore, its low CO2 emissions highlight its '
                'environmentally conscious design. This combination of '
                'practical features, excellent fuel economy, and a long MOT '
                'makes this Audi A3 a compelling choice for those seeking a '
                'well equipped and reliable vehicle. CALL 0161 633 3286/ 07867 '
                '314825. £399 admin fees apply where 3rd party finance '
                'companies are used.',
 'doors_number': 4,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 148,
 'fuel_type': 'Petrol',
 'id': '5b6d6298-d27c-535a-b3d2-8b8adad0268c',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603240967913',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 52000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 63,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b6d6298-d27c-535a-b3d2-8b8adad0268c/5b6d6298-d27c-535a-b3d2-8b8adad0268c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245514,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/d3d95a8707ba4d07bbc98c23f16f55c7.jpg',
             'Width': 1280}],
 'price': 13990,
 'price_includes_vat': True,
 'registration_date': '2020-01-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 1.5 TFSI CoD 35 S line Saloon 4dr Petrol',
 'transmission': 'manual',
 'trim': 'S line',
 'year': 2020}
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603240967913%27 HTTP/1.1" 200 None
2026-03-25 17:06:47 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603240967913: {'created_time': 1774458407.2385, 'last_price_update_time': 1774458407.23851}
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603240967913') HTTP/1.1" 204 0
2026-03-25 17:06:47 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 38b6f0ac-7f7f-5ed3-a165-25053973e7f0 with identifier 202603070496367
2026-03-25 17:06:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:47 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 38b6f0ac-7f7f-5ed3-a165-25053973e7f0
2026-03-25 17:06:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/d65c48dce83d41269cfaa7b9ea6b38e6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'This 2023 Hyundai TUCSON h T-GDi Ultimate is a superb '
                'example, boasting a clear vehicle history check and having '
                'had only one owner from new.  This Euro 6 compliant model '
                'features a 1.6 litre petrol hybrid engine, offering an '
                "efficient and responsive driving experience.  Inside, you'll "
                'find a wealth of advanced features designed for comfort and '
                'convenience, including three zone climate control, full LED '
                'headlights for excellent visibility, and smart adaptive '
                "cruise control with stop and go functionality.  The driver's "
                'seat benefits from electric adjustment with a memory '
                'function, ensuring your perfect driving position is always '
                'readily available, and Bluetooth connectivity keeps you '
                'connected on the go.\n'
                '\n'
                'The Hyundai TUCSON h T-GDi Ultimate truly stands out with its '
                'impressive performance, achieving 0-60mph in just 8.0 '
                'seconds, demonstrating its spirited acceleration. This '
                'particular model also offers a generous boot space, making it '
                'practical for all your needs, and is situated in a low '
                'insurance group, which can help to reduce your running costs. '
                'These highlights collectively indicate that this TUCSON '
                'offers a superior combination of performance, practicality, '
                'and economy compared to other vehicles in its class. CALL '
                '0161 633 3286/ 07867 314825. £399 admin fees apply where 3rd '
                'party finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.6L',
 'engine_horse_power': 227,
 'fuel_type': 'Petrol Hybrid',
 'id': '38b6f0ac-7f7f-5ed3-a165-25053973e7f0',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603070496367',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Hyundai',
 'model': 'TUCSON',
 'odometer': 30000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 69,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38b6f0ac-7f7f-5ed3-a165-25053973e7f0/38b6f0ac-7f7f-5ed3-a165-25053973e7f0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 224311,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/d65c48dce83d41269cfaa7b9ea6b38e6.jpg',
             'Width': 1280}],
 'price': 21990,
 'price_includes_vat': True,
 'registration_date': '2023-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 h T-GDi Ultimate SUV 5dr Petrol Hybrid Auto Euro '
          '6 (s/s) (230 ps)',
 'transmission': 'automatic',
 'trim': 'Ultimate',
 'year': 2023}
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603070496367%27 HTTP/1.1" 200 None
2026-03-25 17:06:47 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603070496367: {'created_time': 1774458407.37715, 'last_price_update_time': 1774458407.377159}
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603070496367') HTTP/1.1" 204 0
2026-03-25 17:06:47 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7c27e83c-0b3b-577b-95f7-39c2877980d9 with identifier 202603251003782
2026-03-25 17:06:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:47 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7c27e83c-0b3b-577b-95f7-39c2877980d9
2026-03-25 17:06:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/0f1b501062164102b34926c1c726629f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2023 Audi A3 TFSI Sport is a standout choice, having '
                'been owned by just one careful keeper and boasting '
                'exceptionally low mileage for its year at only 22,000 miles. '
                'This Euro 6 compliant model features a responsive 1.0 litre '
                'petrol engine and is equipped with striking LED headlights '
                'and LED daytime running lights, complemented by LED rear '
                "lights. Inside, you'll find the convenience of a Bluetooth "
                'interface for seamless connectivity and dual zone electronic '
                'climate control, ensuring comfort for all occupants.\n'
                '\n'
                'The A3 TFSI Sport offers a practical and enjoyable driving '
                'experience, with a generous boot space designed to '
                'accommodate your needs. Its acceleration from 0 to 60 miles '
                'per hour in 10.6 seconds demonstrates its capable '
                'performance. With an MOT valid until February 2027, this '
                'vehicle provides excellent peace of mind, indicating its '
                'roadworthiness and readiness for many more miles of driving. '
                'CALL 0161 633 3286/ 07867 314825. £399 admin fees apply where '
                '3rd party finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 108,
 'fuel_type': 'Petrol',
 'id': '7c27e83c-0b3b-577b-95f7-39c2877980d9',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603251003782',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 22000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 55,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c27e83c-0b3b-577b-95f7-39c2877980d9/7c27e83c-0b3b-577b-95f7-39c2877980d9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264441,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/0f1b501062164102b34926c1c726629f.jpg',
             'Width': 1280}],
 'price': 17807,
 'price_includes_vat': True,
 'registration_date': '2023-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 1.0 TFSI 30 Sport Sportback 5dr Petrol',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2023}
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603251003782%27 HTTP/1.1" 200 None
2026-03-25 17:06:47 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603251003782: {'created_time': 1774458407.41814, 'last_price_update_time': 1774458407.418148}
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603251003782') HTTP/1.1" 204 0
2026-03-25 17:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/423724fcd33f435d8ba143ac439c4aaa.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/2cfb8006d23e47b4a45ebb7e70f35e33.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:47 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 8 detail requests (batch 2)
2026-03-25 17:06:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 17:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c1f3910>
2026-03-25 17:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba98578c-f2f2-52bc-807a-ed6c6d7fc8f2/ba98578c-f2f2-52bc-807a-ed6c6d7fc8f2_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8a3acc0088ad4b8c847e93f36e3c3d9c.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8a3acc0088ad4b8c847e93f36e3c3d9c.jpg saved to cache
2026-03-25 17:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ba98578c-f2f2-52bc-807a-ed6c6d7fc8f2
2026-03-25 17:06:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ba98578c-f2f2-52bc-807a-ed6c6d7fc8f2 sending to next pipeline
2026-03-25 17:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c47f390>
2026-03-25 17:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6e1ae3f-fd87-57c7-9cf6-611cb4ebaedf/b6e1ae3f-fd87-57c7-9cf6-611cb4ebaedf_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb509ab07394340bc8c07d58fc59271b3.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b509ab07394340bc8c07d58fc59271b3.jpg saved to cache
2026-03-25 17:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b6e1ae3f-fd87-57c7-9cf6-611cb4ebaedf
2026-03-25 17:06:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b6e1ae3f-fd87-57c7-9cf6-611cb4ebaedf sending to next pipeline
2026-03-25 17:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c460590>
2026-03-25 17:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aac5b60f-688a-5984-b9af-1e694e107ef5/aac5b60f-688a-5984-b9af-1e694e107ef5_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F952f2351102546679b88cdc1b99f9999.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/952f2351102546679b88cdc1b99f9999.jpg saved to cache
2026-03-25 17:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aac5b60f-688a-5984-b9af-1e694e107ef5
2026-03-25 17:06:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aac5b60f-688a-5984-b9af-1e694e107ef5 sending to next pipeline
2026-03-25 17:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c413f90>
2026-03-25 17:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2df9163c-2b25-5840-af4c-01c73699373f/2df9163c-2b25-5840-af4c-01c73699373f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6158856f930243989ee2a349ef7451b8.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6158856f930243989ee2a349ef7451b8.jpg saved to cache
2026-03-25 17:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2df9163c-2b25-5840-af4c-01c73699373f
2026-03-25 17:06:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2df9163c-2b25-5840-af4c-01c73699373f sending to next pipeline
2026-03-25 17:06:47 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ba98578c-f2f2-52bc-807a-ed6c6d7fc8f2 with identifier 202603060476905
2026-03-25 17:06:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:47 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ba98578c-f2f2-52bc-807a-ed6c6d7fc8f2
2026-03-25 17:06:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/8a3acc0088ad4b8c847e93f36e3c3d9c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'This 2023 Citroen C4 Sense is a superb example, having had '
                'only one owner since new. It features a responsive 1.2 litre '
                'petrol engine, meeting Euro 6 emissions standards. The '
                'exterior is enhanced by LED headlights that activate '
                "automatically, ensuring optimal visibility. Inside, you'll "
                'find automatic dual zone air conditioning for perfect cabin '
                'comfort, and a 10 inch touchscreen interface that seamlessly '
                'integrates with Android Auto and Apple CarPlay, alongside '
                'Bluetooth connectivity. Rear parking sensors provide added '
                'convenience and safety when manoeuvring.\n'
                '\n'
                'This particular C4 Sense offers excellent running costs, '
                'boasting an impressive fuel economy of 55 miles per gallon. '
                'Its low CO2 emissions and low insurance group rating further '
                'contribute to its affordability, making it a sensible choice '
                'for many drivers. The generous boot space ensures you have '
                'plenty of room for shopping or luggage, highlighting its '
                'practicality for everyday use and longer journeys. CALL 0161 '
                '633 3286/ 07867 314825. £399 admin fees apply where 3rd party '
                'finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 99,
 'fuel_type': 'Petrol',
 'id': 'ba98578c-f2f2-52bc-807a-ed6c6d7fc8f2',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603060476905',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 27000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 52,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba98578c-f2f2-52bc-807a-ed6c6d7fc8f2/ba98578c-f2f2-52bc-807a-ed6c6d7fc8f2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245211,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/8a3acc0088ad4b8c847e93f36e3c3d9c.jpg',
             'Width': 1280}],
 'price': 11680,
 'price_includes_vat': True,
 'registration_date': '2023-03-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 1.2 PureTech Sense Hatchback 5dr Petrol',
 'transmission': 'manual',
 'trim': 'Sense',
 'year': 2023}
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603060476905%27 HTTP/1.1" 200 None
2026-03-25 17:06:47 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603060476905: {'created_time': 1774458407.660048, 'last_price_update_time': 1774458407.660057}
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603060476905') HTTP/1.1" 204 0
2026-03-25 17:06:47 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b6e1ae3f-fd87-57c7-9cf6-611cb4ebaedf with identifier 202603240964025
2026-03-25 17:06:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:47 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b6e1ae3f-fd87-57c7-9cf6-611cb4ebaedf
2026-03-25 17:06:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/b509ab07394340bc8c07d58fc59271b3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'CALL 0161 633 3286/ 07867 314825. £399 admin fees apply where '
                '3rd party finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.8L',
 'engine_horse_power': 120,
 'fuel_type': 'Petrol Hybrid',
 'id': 'b6e1ae3f-fd87-57c7-9cf6-611cb4ebaedf',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603240964025',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Toyota',
 'model': 'Corolla',
 'odometer': 56000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6e1ae3f-fd87-57c7-9cf6-611cb4ebaedf/b6e1ae3f-fd87-57c7-9cf6-611cb4ebaedf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230715,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/b509ab07394340bc8c07d58fc59271b3.jpg',
             'Width': 1280}],
 'price': 13790,
 'price_includes_vat': True,
 'registration_date': '2021-05-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Corolla 1.8 VVT-h GPF Icon Tech Hatchback 5dr Petrol Hybrid '
          'CVT Euro 6 (s/s) (122 ps)',
 'transmission': 'automatic',
 'trim': 'Icon Tech',
 'year': 2021}
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603240964025%27 HTTP/1.1" 200 None
2026-03-25 17:06:47 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603240964025: {'created_time': 1774458407.703349, 'last_price_update_time': 1774458407.703356}
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603240964025') HTTP/1.1" 204 0
2026-03-25 17:06:47 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: aac5b60f-688a-5984-b9af-1e694e107ef5 with identifier 202603130682264
2026-03-25 17:06:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:47 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item aac5b60f-688a-5984-b9af-1e694e107ef5
2026-03-25 17:06:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/952f2351102546679b88cdc1b99f9999.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This 2018 Volkswagen T-Roc TSI SE offers exceptional value '
                'with its remarkably low mileage of just 54,000 miles for its '
                'age. This Euro 6 compliant 1.0 litre petrol model comes in '
                'the SE trim, featuring a suite of advanced technologies to '
                'enhance your driving experience. Enjoy the convenience of '
                'Adaptive Cruise Control, automatic on headlights with LED '
                'daytime running lights, and a dusk sensor for effortless '
                'night driving. Stay connected and entertained with Car-Net '
                'App-Connect, compatible with both Android Auto and Apple '
                'CarPlay, while the 2Zone electronic climate control ensures a '
                'comfortable cabin environment for all occupants. With an MOT '
                'valid until October 2026, this T-Roc is ready for many more '
                'miles.\n'
                '\n'
                'The highlights of this Volkswagen T-Roc demonstrate its '
                'superiority over other vehicles in its class. Its impressive '
                'fuel economy of 50 mpg means fewer trips to the petrol '
                'station, and its low insurance group rating offers '
                'significant savings on your annual costs. Furthermore, its '
                'low CO2 emissions are better for the environment. These '
                'combined benefits make this T-Roc a smart and economical '
                'choice for any driver seeking a stylish and practical compact '
                'SUV. CALL 0161 633 3286/ 07867 314825. £399 admin fees apply '
                'where 3rd party finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 113,
 'fuel_type': 'Petrol',
 'id': 'aac5b60f-688a-5984-b9af-1e694e107ef5',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603130682264',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 54000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac5b60f-688a-5984-b9af-1e694e107ef5/aac5b60f-688a-5984-b9af-1e694e107ef5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 207930,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/952f2351102546679b88cdc1b99f9999.jpg',
             'Width': 1280}],
 'price': 11990,
 'price_includes_vat': True,
 'registration_date': '2018-11-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.0 TSI GPF SE SUV 5dr Petrol',
 'transmission': 'manual',
 'trim': 'SE',
 'year': 2018}
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603130682264%27 HTTP/1.1" 200 None
2026-03-25 17:06:47 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603130682264: {'created_time': 1774458407.7456, 'last_price_update_time': 1774458407.745607}
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603130682264') HTTP/1.1" 204 0
2026-03-25 17:06:47 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2df9163c-2b25-5840-af4c-01c73699373f with identifier 202603170776014
2026-03-25 17:06:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:47 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2df9163c-2b25-5840-af4c-01c73699373f
2026-03-25 17:06:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/6158856f930243989ee2a349ef7451b8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This 2022 Ford Puma ST-Line Vignale offers exceptional value '
                'with its remarkably low mileage of just 22,000 miles for its '
                'age, a clear vehicle history check, and a comprehensive Euro '
                '6 compliant 1.0L Petrol Hybrid engine. This particular model, '
                'the ST-Line Vignale, comes equipped with a suite of desirable '
                "features designed for comfort and convenience. You'll find "
                'front and rear parking sensors to aid manoeuvring, a Winter '
                'Pack including heated seats and a heated steering wheel for '
                'those colder days, and a wireless charging pad integrated '
                'with electronic air temperature control for effortless device '
                'charging and cabin climate management.\n'
                '\n'
                'The Ford Puma ST-Line Vignale stands out with its impressive '
                'fuel economy, achieving a notable 52 miles per gallon, and '
                'its low CO2 emissions, indicating a more environmentally '
                'conscious and cost effective driving experience compared to '
                'many similar vehicles. This combination of efficient hybrid '
                'technology, advanced comfort features, and a strong '
                'provenance makes this 2022 Ford Puma a compelling choice for '
                'those seeking a stylish and practical compact SUV. CALL 0161 '
                '633 3286/ 07867 314825. £399 admin fees apply where 3rd party '
                'finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 123,
 'fuel_type': 'Petrol Hybrid',
 'id': '2df9163c-2b25-5840-af4c-01c73699373f',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603170776014',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 22000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 59,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2df9163c-2b25-5840-af4c-01c73699373f/2df9163c-2b25-5840-af4c-01c73699373f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223670,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/6158856f930243989ee2a349ef7451b8.jpg',
             'Width': 1280}],
 'price': 14980,
 'price_includes_vat': True,
 'registration_date': '2022-05-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.0T EcoBoost MHEV ST-Line Vignale SUV 5dr Petrol Hybrid',
 'transmission': 'manual',
 'trim': 'ST-Line Vignale',
 'year': 2022}
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603170776014%27 HTTP/1.1" 200 None
2026-03-25 17:06:47 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603170776014: {'created_time': 1774458407.792762, 'last_price_update_time': 1774458407.792768}
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603170776014') HTTP/1.1" 204 0
2026-03-25 17:06:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 17:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66e194ad0>
2026-03-25 17:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6a93bbf-7270-5c39-bd41-eb9c9425fc2c/e6a93bbf-7270-5c39-bd41-eb9c9425fc2c_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc7b4465515fb438098ae602631b24607.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c7b4465515fb438098ae602631b24607.jpg saved to cache
2026-03-25 17:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e6a93bbf-7270-5c39-bd41-eb9c9425fc2c
2026-03-25 17:06:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e6a93bbf-7270-5c39-bd41-eb9c9425fc2c sending to next pipeline
2026-03-25 17:06:47 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:47 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e45504bf-4226-56fc-9208-da9252127d51 with identifier: 202602200091257
2026-03-25 17:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e45504bf-4226-56fc-9208-da9252127d51
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3c796bb3dc74464f8eac121de32fdde2.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3c796bb3dc74464f8eac121de32fdde2.jpg not downloaded yet
2026-03-25 17:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c3ee110>
2026-03-25 17:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4f6cc47-d16b-5752-926e-32cbed6bfd43/a4f6cc47-d16b-5752-926e-32cbed6bfd43_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc49485ba3dc5488d8b9934e093aae70d.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c49485ba3dc5488d8b9934e093aae70d.jpg saved to cache
2026-03-25 17:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a4f6cc47-d16b-5752-926e-32cbed6bfd43
2026-03-25 17:06:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a4f6cc47-d16b-5752-926e-32cbed6bfd43 sending to next pipeline
2026-03-25 17:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/a8d3f5c8d76c4e128992a7569e21136a.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/e40b5bd7893b4fd097f8f9d0ce1093fc.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:47 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e6a93bbf-7270-5c39-bd41-eb9c9425fc2c with identifier 202603060477119
2026-03-25 17:06:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:47 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e6a93bbf-7270-5c39-bd41-eb9c9425fc2c
2026-03-25 17:06:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/c7b4465515fb438098ae602631b24607.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2020 SEAT Leon TSI EVO FR Black Edition boasts an MOT '
                'valid until March 2027, offering excellent peace of mind. '
                'This stylish hatchback features a 1.5 litre Euro 6 petrol '
                'engine, combining efficient performance with a 0-60mph time '
                'of 9.4 seconds. The FR Black Edition trim includes a host of '
                'desirable features such as Full LED Headlights, front and '
                'rear parking sensors with parking assistance, and a Winter '
                "Pack with heated seats for added comfort. Inside, you'll find "
                'the Media System Plus with Bluetooth connectivity and Dual '
                'Zone Climate Control, ensuring a pleasant journey for all '
                'occupants.\n'
                '\n'
                'The SEAT Leon is designed with practicality in mind, offering '
                'generous boot space for all your needs. Its low CO2 emissions '
                'highlight its environmental consideration, making it a more '
                'responsible choice. These features collectively demonstrate '
                'how this particular SEAT Leon offers a superior driving '
                'experience compared to other vehicles in its class, providing '
                'a blend of technology, comfort, and efficiency. CALL 0161 633 '
                '3286/ 07867 314825. £399 admin fees apply where 3rd party '
                'finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 128,
 'fuel_type': 'Petrol',
 'id': 'e6a93bbf-7270-5c39-bd41-eb9c9425fc2c',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603060477119',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'SEAT',
 'model': 'Leon',
 'odometer': 68000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6a93bbf-7270-5c39-bd41-eb9c9425fc2c/e6a93bbf-7270-5c39-bd41-eb9c9425fc2c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226045,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/c7b4465515fb438098ae602631b24607.jpg',
             'Width': 1280}],
 'price': 11380,
 'price_includes_vat': True,
 'registration_date': '2020-01-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT Leon 1.5 TSI EVO FR Black Edition Hatchback 5dr Petrol',
 'transmission': 'manual',
 'trim': 'FR Black Edition',
 'year': 2020}
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603060477119%27 HTTP/1.1" 200 None
2026-03-25 17:06:47 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603060477119: {'created_time': 1774458407.978389, 'last_price_update_time': 1774458407.978398}
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603060477119') HTTP/1.1" 204 0
2026-03-25 17:06:47 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a4f6cc47-d16b-5752-926e-32cbed6bfd43 with identifier 202603190839821
2026-03-25 17:06:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:48 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a4f6cc47-d16b-5752-926e-32cbed6bfd43
2026-03-25 17:06:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/c49485ba3dc5488d8b9934e093aae70d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 92,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This 2022 Toyota Yaris VVT-h Icon is a superb example, having '
                'been owned by just one careful keeper since new. This Euro 6 '
                'compliant hatchback boasts a fuel efficient 1.5 litre petrol '
                'hybrid engine, offering an impressive 69 miles per gallon. It '
                'comes equipped with Toyota Safety Sense 2, which includes '
                'Adaptive Cruise Control for more relaxed journeys, and a '
                "reversing camera to aid with parking. Inside, you'll find "
                'automatic air conditioning for consistent comfort and '
                'Bluetooth connectivity for seamless phone integration.\n'
                '\n'
                'The Yaris Icon is designed to be economical to run, with a '
                'low insurance group and low CO2 emissions, making it a cost '
                'effective choice. These highlights demonstrate how this '
                'particular Yaris offers excellent value and efficiency '
                'compared to other vehicles in its class. With its MOT valid '
                'until November 2026, this well maintained Yaris is ready for '
                'its next owner. CALL 0161 633 3286/ 07867 314825. £399 admin '
                'fees apply where 3rd party finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 114,
 'fuel_type': 'Petrol Hybrid',
 'id': 'a4f6cc47-d16b-5752-926e-32cbed6bfd43',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603190839821',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 21000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4f6cc47-d16b-5752-926e-32cbed6bfd43/a4f6cc47-d16b-5752-926e-32cbed6bfd43_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193305,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/c49485ba3dc5488d8b9934e093aae70d.jpg',
             'Width': 1280}],
 'price': 14990,
 'price_includes_vat': True,
 'registration_date': '2022-11-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.5 VVT-h Icon Hatchback 5dr Petrol Hybrid E-CVT',
 'transmission': 'automatic',
 'trim': 'Icon',
 'year': 2022}
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603190839821%27 HTTP/1.1" 200 None
2026-03-25 17:06:48 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603190839821: {'created_time': 1774458408.023309, 'last_price_update_time': 1774458408.023318}
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603190839821') HTTP/1.1" 204 0
2026-03-25 17:06:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a6eac3f-b3c0-5f3b-bc6a-cd1cda916df5 with identifier: 202602169972876
2026-03-25 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6a6eac3f-b3c0-5f3b-bc6a-cd1cda916df5
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4b4273830b4b48598e2b5d8e97fdb79a.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4b4273830b4b48598e2b5d8e97fdb79a.jpg not downloaded yet
2026-03-25 17:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65ef3c3d0>
2026-03-25 17:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ec73c8e-b003-54b6-8e8e-8e67753b1a1c/2ec73c8e-b003-54b6-8e8e-8e67753b1a1c_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F423724fcd33f435d8ba143ac439c4aaa.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/423724fcd33f435d8ba143ac439c4aaa.jpg saved to cache
2026-03-25 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2ec73c8e-b003-54b6-8e8e-8e67753b1a1c
2026-03-25 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2ec73c8e-b003-54b6-8e8e-8e67753b1a1c sending to next pipeline
2026-03-25 17:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66f9fb050>
2026-03-25 17:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7ef53c-ff31-5d94-8125-d9b4fc3ea686/1f7ef53c-ff31-5d94-8125-d9b4fc3ea686_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2cfb8006d23e47b4a45ebb7e70f35e33.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2cfb8006d23e47b4a45ebb7e70f35e33.jpg saved to cache
2026-03-25 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1f7ef53c-ff31-5d94-8125-d9b4fc3ea686
2026-03-25 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1f7ef53c-ff31-5d94-8125-d9b4fc3ea686 sending to next pipeline
2026-03-25 17:06:48 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2ec73c8e-b003-54b6-8e8e-8e67753b1a1c with identifier 202603190839653
2026-03-25 17:06:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:48 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2ec73c8e-b003-54b6-8e8e-8e67753b1a1c
2026-03-25 17:06:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/423724fcd33f435d8ba143ac439c4aaa.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'Discover this 2021 MG ZS VTi-TECH Excite, a well presented '
                'example of this popular model. This Euro 6 compliant 1.5L '
                'petrol car offers a blend of practicality and modern '
                'technology, making it an excellent choice for everyday '
                'driving. The Excite trim level ensures you benefit from a '
                'range of useful features, including Bi-Function LED '
                'headlights for enhanced visibility and automatic headlights '
                'that activate when needed. Stay connected on the go with '
                'Bluetooth connectivity, and seamlessly integrate your '
                'smartphone using Android Auto or Apple CarPlay.\n'
                '\n'
                'This MG ZS Excite stands out with its impressive array of '
                'notable features, indicating a superior driving experience '
                'compared to other vehicles in its class. The inclusion of '
                'both Android Auto and Apple CarPlay allows for effortless '
                'access to your favourite apps, navigation, and music directly '
                "through the car's system. Furthermore, its position in a low "
                'insurance group makes it an economical option for many '
                'drivers, offering peace of mind alongside its stylish design '
                'and advanced technology. CALL 0161 633 3286/ 07867 314825. '
                '£399 admin fees apply where 3rd party finance companies are '
                'used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 105,
 'fuel_type': 'Petrol',
 'id': '2ec73c8e-b003-54b6-8e8e-8e67753b1a1c',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603190839653',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'MG',
 'model': 'MG ZS',
 'odometer': 34000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 48,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ec73c8e-b003-54b6-8e8e-8e67753b1a1c/2ec73c8e-b003-54b6-8e8e-8e67753b1a1c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229796,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/423724fcd33f435d8ba143ac439c4aaa.jpg',
             'Width': 1280}],
 'price': 9990,
 'price_includes_vat': True,
 'registration_date': '2021-05-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MG MG Zs 1.5 VTi-TECH Excite SUV 5dr Petrol',
 'transmission': 'manual',
 'trim': 'Excite',
 'year': 2021}
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603190839653%27 HTTP/1.1" 200 None
2026-03-25 17:06:48 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603190839653: {'created_time': 1774458408.17332, 'last_price_update_time': 1774458408.173327}
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603190839653') HTTP/1.1" 204 0
2026-03-25 17:06:48 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 1f7ef53c-ff31-5d94-8125-d9b4fc3ea686 with identifier 202603190840337
2026-03-25 17:06:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:48 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 1f7ef53c-ff31-5d94-8125-d9b4fc3ea686
2026-03-25 17:06:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/2cfb8006d23e47b4a45ebb7e70f35e33.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'White',
 'currency': 'GBP',
 'description': 'Discover this 2020 Nissan Juke DIG T N Connecta, a stylish '
                'and practical choice for your next vehicle. This Euro 6 '
                'compliant model boasts a 1.0 litre petrol engine and comes '
                'equipped with the desirable Comfort Pack, which includes '
                "climate control for a pleasant driving experience. You'll "
                'also appreciate the convenience of Bluetooth connectivity, '
                'along with USB, Aux, and a 12V socket for all your devices. '
                'Practicality is key with front and rear door pockets '
                'featuring drinks bottle holders, a rear hand grip with a coat '
                "hanger, and a handy card holder on the driver's sun visor.\n"
                '\n'
                'This Nissan Juke stands out with its impressive fuel economy, '
                'achieving a highlight of 46 miles per gallon, demonstrating '
                'its efficiency compared to similar vehicles. Furthermore, its '
                'low CO2 emissions contribute to a more environmentally '
                'conscious drive. The N Connecta trim level ensures you have a '
                'well appointed interior, making every journey enjoyable. CALL '
                '0161 633 3286/ 07867 314825. £399 admin fees apply where 3rd '
                'party finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 115,
 'fuel_type': 'Petrol',
 'id': '1f7ef53c-ff31-5d94-8125-d9b4fc3ea686',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603190840337',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 51000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7ef53c-ff31-5d94-8125-d9b4fc3ea686/1f7ef53c-ff31-5d94-8125-d9b4fc3ea686_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 191701,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/2cfb8006d23e47b4a45ebb7e70f35e33.jpg',
             'Width': 1280}],
 'price': 11780,
 'price_includes_vat': True,
 'registration_date': '2020-03-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Juke 1.0 DIG-T N-Connecta SUV 5dr Petrol DCT Auto',
 'transmission': 'automatic',
 'trim': 'N-Connecta',
 'year': 2020}
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603190840337%27 HTTP/1.1" 200 None
2026-03-25 17:06:48 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603190840337: {'created_time': 1774458408.225002, 'last_price_update_time': 1774458408.225008}
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603190840337') HTTP/1.1" 204 0
2026-03-25 17:06:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ca5dd1b0-aeea-5831-b966-3de5103898a0 with identifier: 202602149926350
2026-03-25 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ca5dd1b0-aeea-5831-b966-3de5103898a0
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb11c54917ad640d5b54131846ca0c592.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b11c54917ad640d5b54131846ca0c592.jpg not downloaded yet
2026-03-25 17:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c220290>
2026-03-25 17:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c8725a3-b755-5f7d-a860-7e1d9b89eb11/0c8725a3-b755-5f7d-a860-7e1d9b89eb11_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa8d3f5c8d76c4e128992a7569e21136a.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a8d3f5c8d76c4e128992a7569e21136a.jpg saved to cache
2026-03-25 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0c8725a3-b755-5f7d-a860-7e1d9b89eb11
2026-03-25 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0c8725a3-b755-5f7d-a860-7e1d9b89eb11 sending to next pipeline
2026-03-25 17:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c51ef90>
2026-03-25 17:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31af306b-e983-5ef1-8747-1b1118ce025f/31af306b-e983-5ef1-8747-1b1118ce025f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe40b5bd7893b4fd097f8f9d0ce1093fc.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e40b5bd7893b4fd097f8f9d0ce1093fc.jpg saved to cache
2026-03-25 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 31af306b-e983-5ef1-8747-1b1118ce025f
2026-03-25 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 31af306b-e983-5ef1-8747-1b1118ce025f sending to next pipeline
2026-03-25 17:06:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e6c6721d-d4e4-5ae3-a3b4-c121ad7b6999 with identifier: 202602079757399
2026-03-25 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e6c6721d-d4e4-5ae3-a3b4-c121ad7b6999
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc1db035ac2724d4795e16a8f17a8df5d.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c1db035ac2724d4795e16a8f17a8df5d.jpg not downloaded yet
2026-03-25 17:06:48 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 0c8725a3-b755-5f7d-a860-7e1d9b89eb11 with identifier 202603040409714
2026-03-25 17:06:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:48 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 0c8725a3-b755-5f7d-a860-7e1d9b89eb11
2026-03-25 17:06:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/a8d3f5c8d76c4e128992a7569e21136a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'John Cooper Works Trim, John Cooper Works Aerodynamic Kit, '
                'John Cooper Works Sport Seats, Satellite Navigation, Blueooth '
                'Connectivity, Cruise Control With Speed Limiter, DAB Radio, '
                'Apple CarPlay, Rear Parking Aid Sensors, Black Mirror Caps, '
                'Finance Available, Extended Warranties Available, Part '
                'Exchange Welcome CALL 0161 633 3286/ 07867 314825. £399 admin '
                'fees apply where 3rd party finance companies are used.',
 'doors_number': 2,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 134,
 'fuel_type': 'Petrol',
 'id': '0c8725a3-b755-5f7d-a860-7e1d9b89eb11',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603040409714',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'MINI',
 'model': 'Convertible',
 'odometer': 21000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 66,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c8725a3-b755-5f7d-a860-7e1d9b89eb11/0c8725a3-b755-5f7d-a860-7e1d9b89eb11_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249241,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/a8d3f5c8d76c4e128992a7569e21136a.jpg',
             'Width': 1280}],
 'price': 16990,
 'price_includes_vat': True,
 'registration_date': '2021-04-09',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI 1.5 Cooper Sport Convertible 2dr Petrol',
 'transmission': 'manual',
 'trim': 'Cooper Sport',
 'year': 2021}
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040409714%27 HTTP/1.1" 200 None
2026-03-25 17:06:48 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603040409714: {'created_time': 1774458408.401191, 'last_price_update_time': 1774458408.401198}
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603040409714') HTTP/1.1" 204 0
2026-03-25 17:06:48 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 31af306b-e983-5ef1-8747-1b1118ce025f with identifier 202603240963838
2026-03-25 17:06:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:48 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 31af306b-e983-5ef1-8747-1b1118ce025f
2026-03-25 17:06:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/e40b5bd7893b4fd097f8f9d0ce1093fc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'This 2018 Mercedes Benz A Class A200d Sport Edition boasts '
                'exceptionally low mileage for its age, having covered just '
                '60,000 miles. This Euro 6 compliant diesel model features a '
                '2.1L engine and comes in the desirable Sport Edition trim. '
                "Inside, you'll find the Audio 20 Radio with CD and MP3 "
                'compatibility, complete with Bluetooth connectivity, and '
                'Smartphone Integration supporting both Android Auto and Apple '
                'CarPlay. Comfort is enhanced by THERMOTRONIC Luxury Automatic '
                'Climate Control, offering two zones with a clear display. For '
                'convenience and safety, a 180 degree reversing camera with '
                'parking guidelines is included, and the LED High Performance '
                'Headlamps with integrated LED Daytime Running Lights ensure '
                'excellent visibility.\n'
                '\n'
                'The A200d Sport Edition offers several advantages over '
                'similar vehicles. Its impressive fuel economy of 71 mpg means '
                'fewer trips to the petrol station, and its low CO2 emissions '
                "are beneficial for the environment. You'll also appreciate "
                'the low insurance group, making ownership more affordable. '
                'The acceleration from 0-60mph in just 8.8 seconds provides a '
                'responsive driving experience, while the large boot space '
                'offers practicality for shopping trips or luggage. CALL 0161 '
                '633 3286/ 07867 314825. £399 admin fees apply where 3rd party '
                'finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2.1L',
 'engine_horse_power': 134,
 'fuel_type': 'Diesel',
 'id': '31af306b-e983-5ef1-8747-1b1118ce025f',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603240963838',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Mercedes-Benz',
 'model': 'A Class',
 'odometer': 60000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 60,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31af306b-e983-5ef1-8747-1b1118ce025f/31af306b-e983-5ef1-8747-1b1118ce025f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228531,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/e40b5bd7893b4fd097f8f9d0ce1093fc.jpg',
             'Width': 1280}],
 'price': 11380,
 'price_includes_vat': True,
 'registration_date': '2018-03-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Class 2.1 A200d Sport Edition Hatchback 5dr Diesel '
          '7G-DCT',
 'transmission': 'automatic',
 'trim': 'Sport Edition',
 'year': 2018}
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603240963838%27 HTTP/1.1" 200 None
2026-03-25 17:06:48 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603240963838: {'created_time': 1774458408.443917, 'last_price_update_time': 1774458408.443923}
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603240963838') HTTP/1.1" 204 0
2026-03-25 17:06:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 68b51589-031e-55c1-a81d-3529a8e8289f with identifier: 202602059707540
2026-03-25 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 68b51589-031e-55c1-a81d-3529a8e8289f
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0f9f88d7d7304af39fa18b947f0a8f70.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0f9f88d7d7304af39fa18b947f0a8f70.jpg not downloaded yet
2026-03-25 17:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/3c796bb3dc74464f8eac121de32fdde2.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e127269f-bdc4-5809-9562-1851ab6c3451 with identifier: 202602049676263
2026-03-25 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e127269f-bdc4-5809-9562-1851ab6c3451
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F20e45fbf081c4d68887b8b28f4c1a9d1.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/20e45fbf081c4d68887b8b28f4c1a9d1.jpg not downloaded yet
2026-03-25 17:06:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c75ea2c9-8614-52c1-bd9e-ba36a6d2744a with identifier: 202602049672089
2026-03-25 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c75ea2c9-8614-52c1-bd9e-ba36a6d2744a
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F539bf657d7ff47cb9cbd5d3306b18550.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/539bf657d7ff47cb9cbd5d3306b18550.jpg not downloaded yet
2026-03-25 17:06:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 20fe98dc-5472-5178-958a-744d24b2240e with identifier: 202602049671970
2026-03-25 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 20fe98dc-5472-5178-958a-744d24b2240e
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb17ecb2b227e44f0aad18f0538b5e00d.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b17ecb2b227e44f0aad18f0538b5e00d.jpg not downloaded yet
2026-03-25 17:06:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 81df77de-b094-5882-9b08-1cfca517fc39 with identifier: 202601309555554
2026-03-25 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 81df77de-b094-5882-9b08-1cfca517fc39
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F396d6190f3a145619660af79a2a33df5.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/396d6190f3a145619660af79a2a33df5.jpg not downloaded yet
2026-03-25 17:06:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d3c9c36c-97d2-5271-83f9-5f84b0beb257 with identifier: 202601239367678
2026-03-25 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d3c9c36c-97d2-5271-83f9-5f84b0beb257
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff609a3fc2fcb4619a1337c5f4d63df8b.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f609a3fc2fcb4619a1337c5f4d63df8b.jpg not downloaded yet
2026-03-25 17:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c393710>
2026-03-25 17:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e45504bf-4226-56fc-9208-da9252127d51/e45504bf-4226-56fc-9208-da9252127d51_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3c796bb3dc74464f8eac121de32fdde2.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3c796bb3dc74464f8eac121de32fdde2.jpg saved to cache
2026-03-25 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e45504bf-4226-56fc-9208-da9252127d51
2026-03-25 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e45504bf-4226-56fc-9208-da9252127d51 sending to next pipeline
2026-03-25 17:06:48 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e45504bf-4226-56fc-9208-da9252127d51 with identifier 202602200091257
2026-03-25 17:06:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:48 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e45504bf-4226-56fc-9208-da9252127d51
2026-03-25 17:06:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/3c796bb3dc74464f8eac121de32fdde2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'This 2020 Volkswagen Golf TSI R-Line offers excellent peace '
                'of mind with its MOT valid until December 2026. This Euro 6 '
                'compliant model features a 1.5 litre petrol engine and is '
                'presented in the R-Line trim. Inside, you will find a heated '
                'leather trimmed three spoke multifunction steering wheel with '
                'touch sensitive controls and an R-Line logo, alongside an '
                'electronic climate control system. For convenience, it '
                'includes a mobile phone interface with wireless inductive '
                'charging and a Discover Navigation system with Bluetooth '
                'connectivity. Parking is made easier with front and rear '
                'parking sensors.\n'
                '\n'
                'The performance of this Volkswagen Golf is noteworthy, '
                'achieving 0-60mph in 9.2 seconds. This indicates a more '
                'responsive driving experience compared to many other vehicles '
                'in its class. Furthermore, its fuel economy is a significant '
                'advantage, achieving a highlight of 51 miles per gallon, '
                'demonstrating its efficiency for everyday driving and longer '
                'journeys. CALL 0161 633 3286/ 07867 314825. £399 admin fees '
                'apply where 3rd party finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 128,
 'fuel_type': 'Petrol',
 'id': 'e45504bf-4226-56fc-9208-da9252127d51',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602200091257',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Volkswagen',
 'model': 'Golf',
 'odometer': 66000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e45504bf-4226-56fc-9208-da9252127d51/e45504bf-4226-56fc-9208-da9252127d51_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219875,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/3c796bb3dc74464f8eac121de32fdde2.jpg',
             'Width': 1280}],
 'price': 14890,
 'price_includes_vat': True,
 'registration_date': '2020-12-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf 1.5 TSI R-Line Hatchback 5dr Petrol',
 'transmission': 'manual',
 'trim': 'R-Line',
 'year': 2020}
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602200091257%27 HTTP/1.1" 200 None
2026-03-25 17:06:48 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602200091257: {'created_time': 1774458408.670943, 'last_price_update_time': 1774458408.670951}
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602200091257') HTTP/1.1" 204 0
2026-03-25 17:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/4b4273830b4b48598e2b5d8e97fdb79a.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/20e45fbf081c4d68887b8b28f4c1a9d1.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/396d6190f3a145619660af79a2a33df5.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/539bf657d7ff47cb9cbd5d3306b18550.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/b11c54917ad640d5b54131846ca0c592.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/c1db035ac2724d4795e16a8f17a8df5d.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/b17ecb2b227e44f0aad18f0538b5e00d.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/0f9f88d7d7304af39fa18b947f0a8f70.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/f609a3fc2fcb4619a1337c5f4d63df8b.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c4d8d10>
2026-03-25 17:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a6eac3f-b3c0-5f3b-bc6a-cd1cda916df5/6a6eac3f-b3c0-5f3b-bc6a-cd1cda916df5_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4b4273830b4b48598e2b5d8e97fdb79a.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4b4273830b4b48598e2b5d8e97fdb79a.jpg saved to cache
2026-03-25 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6a6eac3f-b3c0-5f3b-bc6a-cd1cda916df5
2026-03-25 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6a6eac3f-b3c0-5f3b-bc6a-cd1cda916df5 sending to next pipeline
2026-03-25 17:06:48 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 6a6eac3f-b3c0-5f3b-bc6a-cd1cda916df5 with identifier 202602169972876
2026-03-25 17:06:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:48 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 6a6eac3f-b3c0-5f3b-bc6a-cd1cda916df5
2026-03-25 17:06:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/4b4273830b4b48598e2b5d8e97fdb79a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'This 2023 Ford Puma ST offers an exhilarating driving '
                'experience, boasting a powerful 1.5L petrol engine and a '
                'swift 0-60mph acceleration of just 6.7 seconds. As a Euro 6 '
                'compliant vehicle, it meets modern emission standards. This '
                'ST trim level comes equipped with a range of desirable '
                'features, including rear parking sensors for easier '
                'manoeuvring and the convenient Ford KeyFree System for '
                'keyless entry.\n'
                '\n'
                "Inside, you'll find the advanced Ford SYNC 3 Navigation "
                'system, complete with Android Auto and Apple CarPlay '
                'integration, allowing seamless connection of your smartphone. '
                'Enjoy your favourite music through the premium B&O Sound '
                'System, a luxury branded audio experience. For added comfort '
                'during colder months, the Winter Pack includes heated seats '
                'and a heated steering wheel. The striking exterior is '
                'enhanced by fixed LED signature headlamps, providing '
                'excellent visibility. These features collectively demonstrate '
                'how this Ford Puma ST stands out from other vehicles in its '
                'class. CALL 0161 633 3286/ 07867 314825. £399 admin fees '
                'apply where 3rd party finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 197,
 'fuel_type': 'Petrol',
 'id': '6a6eac3f-b3c0-5f3b-bc6a-cd1cda916df5',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602169972876',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 37000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 55,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a6eac3f-b3c0-5f3b-bc6a-cd1cda916df5/6a6eac3f-b3c0-5f3b-bc6a-cd1cda916df5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218228,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/4b4273830b4b48598e2b5d8e97fdb79a.jpg',
             'Width': 1280}],
 'price': 17480,
 'price_includes_vat': True,
 'registration_date': '2023-10-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.5T EcoBoost ST SUV 5dr Petrol Manual Euro 6 (s/s) (200 '
          'ps)',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2023}
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602169972876%27 HTTP/1.1" 200 None
2026-03-25 17:06:48 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602169972876: {'created_time': 1774458408.873943, 'last_price_update_time': 1774458408.873954}
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602169972876') HTTP/1.1" 204 0
2026-03-25 17:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c197cd0>
2026-03-25 17:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e127269f-bdc4-5809-9562-1851ab6c3451/e127269f-bdc4-5809-9562-1851ab6c3451_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F20e45fbf081c4d68887b8b28f4c1a9d1.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/20e45fbf081c4d68887b8b28f4c1a9d1.jpg saved to cache
2026-03-25 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e127269f-bdc4-5809-9562-1851ab6c3451
2026-03-25 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e127269f-bdc4-5809-9562-1851ab6c3451 sending to next pipeline
2026-03-25 17:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c38d850>
2026-03-25 17:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81df77de-b094-5882-9b08-1cfca517fc39/81df77de-b094-5882-9b08-1cfca517fc39_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F396d6190f3a145619660af79a2a33df5.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/396d6190f3a145619660af79a2a33df5.jpg saved to cache
2026-03-25 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 81df77de-b094-5882-9b08-1cfca517fc39
2026-03-25 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 81df77de-b094-5882-9b08-1cfca517fc39 sending to next pipeline
2026-03-25 17:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c4d3e90>
2026-03-25 17:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c75ea2c9-8614-52c1-bd9e-ba36a6d2744a/c75ea2c9-8614-52c1-bd9e-ba36a6d2744a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F539bf657d7ff47cb9cbd5d3306b18550.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/539bf657d7ff47cb9cbd5d3306b18550.jpg saved to cache
2026-03-25 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c75ea2c9-8614-52c1-bd9e-ba36a6d2744a
2026-03-25 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c75ea2c9-8614-52c1-bd9e-ba36a6d2744a sending to next pipeline
2026-03-25 17:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c2b8fd0>
2026-03-25 17:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca5dd1b0-aeea-5831-b966-3de5103898a0/ca5dd1b0-aeea-5831-b966-3de5103898a0_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb11c54917ad640d5b54131846ca0c592.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b11c54917ad640d5b54131846ca0c592.jpg saved to cache
2026-03-25 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ca5dd1b0-aeea-5831-b966-3de5103898a0
2026-03-25 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ca5dd1b0-aeea-5831-b966-3de5103898a0 sending to next pipeline
2026-03-25 17:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c2bb4d0>
2026-03-25 17:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6c6721d-d4e4-5ae3-a3b4-c121ad7b6999/e6c6721d-d4e4-5ae3-a3b4-c121ad7b6999_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc1db035ac2724d4795e16a8f17a8df5d.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c1db035ac2724d4795e16a8f17a8df5d.jpg saved to cache
2026-03-25 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e6c6721d-d4e4-5ae3-a3b4-c121ad7b6999
2026-03-25 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e6c6721d-d4e4-5ae3-a3b4-c121ad7b6999 sending to next pipeline
2026-03-25 17:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66e1a0e10>
2026-03-25 17:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20fe98dc-5472-5178-958a-744d24b2240e/20fe98dc-5472-5178-958a-744d24b2240e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb17ecb2b227e44f0aad18f0538b5e00d.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b17ecb2b227e44f0aad18f0538b5e00d.jpg saved to cache
2026-03-25 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 20fe98dc-5472-5178-958a-744d24b2240e
2026-03-25 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 20fe98dc-5472-5178-958a-744d24b2240e sending to next pipeline
2026-03-25 17:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66e1b1ed0>
2026-03-25 17:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68b51589-031e-55c1-a81d-3529a8e8289f/68b51589-031e-55c1-a81d-3529a8e8289f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0f9f88d7d7304af39fa18b947f0a8f70.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0f9f88d7d7304af39fa18b947f0a8f70.jpg saved to cache
2026-03-25 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 68b51589-031e-55c1-a81d-3529a8e8289f
2026-03-25 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 68b51589-031e-55c1-a81d-3529a8e8289f sending to next pipeline
2026-03-25 17:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c4f4450>
2026-03-25 17:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3c9c36c-97d2-5271-83f9-5f84b0beb257/d3c9c36c-97d2-5271-83f9-5f84b0beb257_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff609a3fc2fcb4619a1337c5f4d63df8b.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f609a3fc2fcb4619a1337c5f4d63df8b.jpg saved to cache
2026-03-25 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3c9c36c-97d2-5271-83f9-5f84b0beb257
2026-03-25 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3c9c36c-97d2-5271-83f9-5f84b0beb257 sending to next pipeline
2026-03-25 17:06:49 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e127269f-bdc4-5809-9562-1851ab6c3451 with identifier 202602049676263
2026-03-25 17:06:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:49 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e127269f-bdc4-5809-9562-1851ab6c3451
2026-03-25 17:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/20e45fbf081c4d68887b8b28f4c1a9d1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'This 2024 MG ZS Trophy Connect is an exceptional example, '
                'boasting very low mileage for its age at just 4300 miles and '
                'a clear vehicle history check. This electric model features a '
                '51 kWh battery offering a maximum range of 198 miles when '
                'new. Charging is convenient, with a full charge at home using '
                'a 7kW charger taking approximately 8 hours, and rapid public '
                'charging can take the battery from empty to 80% in as little '
                'as 41 minutes.\n'
                '\n'
                'The MG ZS Trophy Connect is well equipped with notable '
                'features designed to enhance your driving experience. Enjoy '
                'seamless smartphone integration with Android Auto, while '
                'Bi-Function LED headlights provide excellent visibility. For '
                'added convenience and safety, it includes Adaptive Cruise '
                'Control and rear parking sensors. Keyless entry with a push '
                'button engine start system makes accessing and starting the '
                'vehicle effortless. These features collectively demonstrate '
                'the superior specification of this MG ZS compared to other '
                'vehicles in its class. CALL 0161 633 3286/ 07867 314825. £399 '
                'admin fees apply where 3rd party finance companies are used.',
 'doors_number': 5,
 'engine_horse_power': 174,
 'fuel_type': 'Electric',
 'id': 'e127269f-bdc4-5809-9562-1851ab6c3451',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602049676263',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'MG',
 'model': 'MG ZS',
 'odometer': 4300,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e127269f-bdc4-5809-9562-1851ab6c3451/e127269f-bdc4-5809-9562-1851ab6c3451_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 224825,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/20e45fbf081c4d68887b8b28f4c1a9d1.jpg',
             'Width': 1280}],
 'price': 15480,
 'price_includes_vat': True,
 'registration_date': '2024-12-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MG MG Zs 51.1kWh Trophy Connect SUV 5dr Electric Auto (176 ps)',
 'transmission': 'automatic',
 'trim': 'Trophy Connect',
 'year': 2024}
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602049676263%27 HTTP/1.1" 200 None
2026-03-25 17:06:49 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602049676263: {'created_time': 1774458409.376183, 'last_price_update_time': 1774458409.376197}
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602049676263') HTTP/1.1" 204 0
2026-03-25 17:06:49 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 81df77de-b094-5882-9b08-1cfca517fc39 with identifier 202601309555554
2026-03-25 17:06:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:49 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 81df77de-b094-5882-9b08-1cfca517fc39
2026-03-25 17:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/396d6190f3a145619660af79a2a33df5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2022 Ford Puma ST Line offers excellent peace of mind '
                'with its MOT valid until May 2026. This stylish ST Line '
                'variant is powered by an efficient 1.0 litre petrol hybrid '
                "engine, meeting Euro 6 emission standards. Inside, you'll "
                'find the convenient Ford SYNC 3 Navigation system, complete '
                'with Android Auto, Apple CarPlay, and Bluetooth connectivity. '
                'For comfort, it features manual air conditioning, and parking '
                'is made easier with rear parking sensors.\n'
                '\n'
                'The Ford Puma ST Line is designed to impress, offering a fuel '
                'economy of 52 miles per gallon, which is a strong indicator '
                'of its efficiency compared to other vehicles in its class. '
                'Furthermore, its low CO2 emissions contribute to a more '
                'environmentally conscious driving experience. This '
                'combination of modern technology, practical features, and '
                'economical performance makes the 2022 Ford Puma ST Line a '
                'compelling choice. CALL 0161 633 3286/ 07867 314825. £399 '
                'admin fees apply where 3rd party finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 123,
 'fuel_type': 'Petrol Hybrid',
 'id': '81df77de-b094-5882-9b08-1cfca517fc39',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601309555554',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 23000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81df77de-b094-5882-9b08-1cfca517fc39/81df77de-b094-5882-9b08-1cfca517fc39_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267118,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/396d6190f3a145619660af79a2a33df5.jpg',
             'Width': 1280}],
 'price': 13680,
 'price_includes_vat': True,
 'registration_date': '2022-09-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.0T EcoBoost MHEV ST-Line SUV 5dr Petrol Hybrid',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2022}
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601309555554%27 HTTP/1.1" 200 None
2026-03-25 17:06:49 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601309555554: {'created_time': 1774458409.426111, 'last_price_update_time': 1774458409.426119}
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601309555554') HTTP/1.1" 204 0
2026-03-25 17:06:49 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c75ea2c9-8614-52c1-bd9e-ba36a6d2744a with identifier 202602049672089
2026-03-25 17:06:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:49 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c75ea2c9-8614-52c1-bd9e-ba36a6d2744a
2026-03-25 17:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/539bf657d7ff47cb9cbd5d3306b18550.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'This 2020 Kia Stonic T GDi 2 is a great find with '
                'exceptionally low mileage for its age, having covered just '
                '34,000 miles. This Euro 6 compliant 1.0 litre petrol model '
                'offers a smart and practical choice for everyday driving. It '
                'comes equipped with rear parking sensors to assist you when '
                'manoeuvring, and for your comfort, it features air '
                'conditioning. Stay connected and entertained on the go with '
                'Bluetooth connectivity for music streaming, along with Apple '
                'CarPlay and Android Auto, both offering voice control for '
                'seamless integration with your smartphone. The MOT is valid '
                'until August 2026, providing peace of mind.\n'
                '\n'
                'The Kia Stonic T GDi 2 stands out with its impressive fuel '
                'economy, achieving a notable 47 miles per gallon, which is '
                'better than many other vehicles in its class. Furthermore, '
                'its low CO2 emissions contribute to a more environmentally '
                'conscious drive. These highlights demonstrate that this '
                'Stonic offers an economical and efficient driving experience, '
                'making it a sensible option for those seeking value and '
                'performance. CALL 0161 633 3286/ 07867 314825. £399 admin '
                'fees apply where 3rd party finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 118,
 'fuel_type': 'Petrol',
 'id': 'c75ea2c9-8614-52c1-bd9e-ba36a6d2744a',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602049672089',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Kia',
 'model': 'Stonic',
 'odometer': 34000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c75ea2c9-8614-52c1-bd9e-ba36a6d2744a/c75ea2c9-8614-52c1-bd9e-ba36a6d2744a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230473,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/539bf657d7ff47cb9cbd5d3306b18550.jpg',
             'Width': 1280}],
 'price': 10240,
 'price_includes_vat': True,
 'registration_date': '2020-08-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Stonic 1.0 T-GDi 2 GPF SUV 5dr Petrol',
 'transmission': 'manual',
 'trim': '2',
 'year': 2020}
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602049672089%27 HTTP/1.1" 200 None
2026-03-25 17:06:49 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602049672089: {'created_time': 1774458409.471525, 'last_price_update_time': 1774458409.471533}
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602049672089') HTTP/1.1" 204 0
2026-03-25 17:06:49 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ca5dd1b0-aeea-5831-b966-3de5103898a0 with identifier 202602149926350
2026-03-25 17:06:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:49 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ca5dd1b0-aeea-5831-b966-3de5103898a0
2026-03-25 17:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/b11c54917ad640d5b54131846ca0c592.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'This 2022 Audi A1 TFSI Sport presents an exceptional '
                'ownership proposition, boasting remarkably low mileage of '
                '24,000 miles. This Euro 6 compliant 1.0 litre petrol model, '
                'finished in the Sport trim, offers a clear vehicle history '
                'and an MOT valid until June 2026, providing peace of mind for '
                "its next custodian. Inside, you'll find a Bluetooth interface "
                'for seamless connectivity, automatic headlights activated by '
                'light and rain sensors, and manual air conditioning to keep '
                'you comfortable.\n'
                '\n'
                'Further enhancing the driving experience are the modern LED '
                'headlights with dynamic rear indicators, complemented by rear '
                'parking sensors to assist with manoeuvring. The A1 TFSI Sport '
                'also features a generously sized boot, offering practical '
                'storage solutions for everyday needs and longer journeys. '
                'These carefully selected features, combined with its single '
                'owner history and low mileage, clearly set this Audi A1 apart '
                'from other vehicles of its kind, making it a compelling '
                'choice for those seeking quality and refinement. CALL 0161 '
                '633 3286/ 07867 314825. £399 admin fees apply where 3rd party '
                'finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 94,
 'fuel_type': 'Petrol',
 'id': 'ca5dd1b0-aeea-5831-b966-3de5103898a0',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602149926350',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 24000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca5dd1b0-aeea-5831-b966-3de5103898a0/ca5dd1b0-aeea-5831-b966-3de5103898a0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267746,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/b11c54917ad640d5b54131846ca0c592.jpg',
             'Width': 1280}],
 'price': 16680,
 'price_includes_vat': True,
 'registration_date': '2022-06-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A1 1.0 TFSI 25 Sport Sportback 5dr Petrol S Tronic',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2022}
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602149926350%27 HTTP/1.1" 200 None
2026-03-25 17:06:49 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602149926350: {'created_time': 1774458409.518636, 'last_price_update_time': 1774458409.518646}
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602149926350') HTTP/1.1" 204 0
2026-03-25 17:06:49 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e6c6721d-d4e4-5ae3-a3b4-c121ad7b6999 with identifier 202602079757399
2026-03-25 17:06:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:49 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e6c6721d-d4e4-5ae3-a3b4-c121ad7b6999
2026-03-25 17:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/c1db035ac2724d4795e16a8f17a8df5d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'This 2019 Volkswagen T-Cross TSI SEL boasts exceptionally low '
                'mileage for its age, having covered just 25,000 miles, and '
                'comes with an MOT valid until June 2026 and a clear vehicle '
                'history check. This Euro 6 compliant 1.0 litre petrol model, '
                'presented in the SEL trim, offers a refined driving '
                'experience with features such as Adaptive Cruise Control, '
                'automatic dusk sensing headlights, and front and rear parking '
                'sensors to assist you. Stay connected and comfortable with '
                'Bluetooth telephone and audio streaming, and enjoy the '
                'convenience of 2Zone electronic climate control with an '
                'allergen filter, ensuring a pleasant cabin environment in all '
                'conditions.\n'
                '\n'
                'The T-Cross TSI SEL stands out with its impressive fuel '
                'economy, achieving 46 miles per gallon, and its low CO2 '
                'emissions, indicating it is a more economical choice compared '
                'to many other vehicles in its class. These highlights, '
                'combined with its comprehensive feature set and excellent '
                'provenance, make this Volkswagen T-Cross a compelling option '
                'for those seeking a stylish, practical, and efficient compact '
                'SUV. CALL 0161 633 3286/ 07867 314825. £399 admin fees apply '
                'where 3rd party finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 113,
 'fuel_type': 'Petrol',
 'id': 'e6c6721d-d4e4-5ae3-a3b4-c121ad7b6999',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602079757399',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 25000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 58,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6c6721d-d4e4-5ae3-a3b4-c121ad7b6999/e6c6721d-d4e4-5ae3-a3b4-c121ad7b6999_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241733,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/c1db035ac2724d4795e16a8f17a8df5d.jpg',
             'Width': 1280}],
 'price': 13280,
 'price_includes_vat': True,
 'registration_date': '2019-08-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI SEL SUV 5dr Petrol',
 'transmission': 'manual',
 'trim': 'SEL',
 'year': 2019}
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602079757399%27 HTTP/1.1" 200 None
2026-03-25 17:06:49 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602079757399: {'created_time': 1774458409.623232, 'last_price_update_time': 1774458409.623241}
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602079757399') HTTP/1.1" 204 0
2026-03-25 17:06:49 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 20fe98dc-5472-5178-958a-744d24b2240e with identifier 202602049671970
2026-03-25 17:06:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:49 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 20fe98dc-5472-5178-958a-744d24b2240e
2026-03-25 17:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/b17ecb2b227e44f0aad18f0538b5e00d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'This 2022 Hyundai TUCSON h T-GDi Premium is a superb example, '
                'having had only one owner since new. This stylish SUV boasts '
                'a 1.6 litre petrol hybrid engine, meeting Euro 6 emission '
                "standards. Inside, you'll find a host of desirable features "
                'designed for comfort and convenience, including dual zone '
                'climate control to keep everyone happy, and heated front '
                'seats for those colder mornings. Stay connected and '
                'entertained with Bluetooth connectivity and seamless Apple '
                'CarPlay integration. Parking is made easier thanks to the '
                'rear camera system, and the generous boot space offers ample '
                'room for all your luggage and shopping.\n'
                '\n'
                'The performance of this TUCSON is also noteworthy, with an '
                'impressive 0-60mph acceleration time of just 8.0 seconds, '
                'demonstrating its responsive hybrid power. Its low insurance '
                'group rating means that running costs are kept down, making '
                'it an economical choice. These highlights, combined with its '
                'single owner provenance and extensive features, position this '
                'Hyundai TUCSON Premium as an excellent option compared to '
                'other vehicles in its class. CALL 0161 633 3286/ 07867 '
                '314825. £399 admin fees apply where 3rd party finance '
                'companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.6L',
 'engine_horse_power': 227,
 'fuel_type': 'Petrol Hybrid',
 'id': '20fe98dc-5472-5178-958a-744d24b2240e',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602049671970',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Hyundai',
 'model': 'TUCSON',
 'odometer': 35000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 70,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20fe98dc-5472-5178-958a-744d24b2240e/20fe98dc-5472-5178-958a-744d24b2240e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251443,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/b17ecb2b227e44f0aad18f0538b5e00d.jpg',
             'Width': 1280}],
 'price': 19490,
 'price_includes_vat': True,
 'registration_date': '2022-05-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 h T-GDi Premium SUV 5dr Petrol Hybrid Auto Euro '
          '6 (s/s) (230 ps)',
 'transmission': 'automatic',
 'trim': 'Premium',
 'year': 2022}
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602049671970%27 HTTP/1.1" 200 None
2026-03-25 17:06:49 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602049671970: {'created_time': 1774458409.667112, 'last_price_update_time': 1774458409.667122}
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602049671970') HTTP/1.1" 204 0
2026-03-25 17:06:49 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 68b51589-031e-55c1-a81d-3529a8e8289f with identifier 202602059707540
2026-03-25 17:06:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:49 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 68b51589-031e-55c1-a81d-3529a8e8289f
2026-03-25 17:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/0f9f88d7d7304af39fa18b947f0a8f70.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2017 Audi S3 TFSI boasts exceptionally low mileage for '
                'its age, having covered just 43,000 miles. This impressive '
                'example features a potent 2.0 litre petrol engine paired with '
                "Audi's renowned four wheel drive system, ensuring confident "
                'handling in all conditions. As a Euro 6 compliant vehicle, it '
                'meets current emissions standards, and its MOT is valid until '
                'September 2026, offering peace of mind.\n'
                '\n'
                'Experience effortless driving with features like LED '
                'headlights that illuminate the road ahead, complemented by '
                'dynamic rear indicators for enhanced visibility. Parking is '
                'made simpler with rear parking sensors and assistance, while '
                'the auto dimming rear view mirror, along with light and rain '
                'sensors, automatically adjust to changing conditions. Stay '
                'connected on the go with the integrated Bluetooth interface, '
                'and enjoy personalised comfort thanks to the dual zone '
                'electronic climate control. The S3 also offers generous boot '
                'space for your luggage, and its remarkable 0-60mph '
                'acceleration in just 4.6 seconds demonstrates its superior '
                'performance compared to other vehicles in its class. CALL '
                '0161 633 3286/ 07867 314825. £399 admin fees apply where 3rd '
                'party finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 306,
 'fuel_type': 'Petrol',
 'id': '68b51589-031e-55c1-a81d-3529a8e8289f',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602059707540',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Audi',
 'model': 'S3',
 'odometer': 43000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 57,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68b51589-031e-55c1-a81d-3529a8e8289f/68b51589-031e-55c1-a81d-3529a8e8289f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240149,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/0f9f88d7d7304af39fa18b947f0a8f70.jpg',
             'Width': 1280}],
 'price': 19480,
 'price_includes_vat': True,
 'registration_date': '2017-12-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi S3 2.0 TFSI Sportback 5dr Petrol S Tronic quattro',
 'transmission': 'automatic',
 'year': 2017}
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602059707540%27 HTTP/1.1" 200 None
2026-03-25 17:06:49 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602059707540: {'created_time': 1774458409.727307, 'last_price_update_time': 1774458409.727314}
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602059707540') HTTP/1.1" 204 0
2026-03-25 17:06:49 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d3c9c36c-97d2-5271-83f9-5f84b0beb257 with identifier 202601239367678
2026-03-25 17:06:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:49 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d3c9c36c-97d2-5271-83f9-5f84b0beb257
2026-03-25 17:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/f609a3fc2fcb4619a1337c5f4d63df8b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'White',
 'currency': 'GBP',
 'description': 'Half Leather Interior, Heated Seats, Satellite Navigation, '
                'Bluetooth Connectivity, Cruise Control With Speed Limiter, '
                'DAB Radio, Ambient Lighting, Front & Rear Parking Aid Sensors '
                'With Reverse Camera, Electric Folding Door Mirrors, Finance '
                'Available, Extended Warranties Available, Part Exchange '
                'Welcome CALL 0161 633 3286/ 07867 314825. £399 admin fees '
                'apply where 3rd party finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.3L',
 'engine_horse_power': 134,
 'fuel_type': 'Petrol',
 'id': 'd3c9c36c-97d2-5271-83f9-5f84b0beb257',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601239367678',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Mercedes-Benz',
 'model': 'A Class',
 'odometer': 70000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 59,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3c9c36c-97d2-5271-83f9-5f84b0beb257/d3c9c36c-97d2-5271-83f9-5f84b0beb257_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205465,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/f609a3fc2fcb4619a1337c5f4d63df8b.jpg',
             'Width': 1280}],
 'price': 13880,
 'price_includes_vat': True,
 'registration_date': '2019-06-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Class 1.3 A180 AMG Line (Premium) Hatchback 5dr '
          'Petrol',
 'transmission': 'manual',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601239367678%27 HTTP/1.1" 200 None
2026-03-25 17:06:49 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601239367678: {'created_time': 1774458409.773178, 'last_price_update_time': 1774458409.773185}
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601239367678') HTTP/1.1" 204 0
2026-03-25 17:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-25 17:06:50 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:50 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d21c9873-e85f-5a65-9b17-8652848af91d with identifier: 202510066924736
2026-03-25 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d21c9873-e85f-5a65-9b17-8652848af91d
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F48841a75688d406180875f1fb407e0b6.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/48841a75688d406180875f1fb407e0b6.jpg not downloaded yet
2026-03-25 17:06:50 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:50 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ecc40415-1151-5990-8fda-15af4bc918b4 with identifier: 202509256631993
2026-03-25 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ecc40415-1151-5990-8fda-15af4bc918b4
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F40eae22fc0624079bbc9698419a67b39.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/40eae22fc0624079bbc9698419a67b39.jpg not downloaded yet
2026-03-25 17:06:50 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:50 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 082d3fc3-7a2e-5089-bbe5-2a37d490aef4 with identifier: 202509256618656
2026-03-25 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 082d3fc3-7a2e-5089-bbe5-2a37d490aef4
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F63720660794a4c4d8357e0d30fc4db08.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/63720660794a4c4d8357e0d30fc4db08.jpg not downloaded yet
2026-03-25 17:06:50 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:50 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 08d97c0e-a4d0-595b-ab30-480b9f01d034 with identifier: 202509236567553
2026-03-25 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 08d97c0e-a4d0-595b-ab30-480b9f01d034
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8eacf79135c44ba890acfa0ed111335c.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8eacf79135c44ba890acfa0ed111335c.jpg not downloaded yet
2026-03-25 17:06:50 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:50 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fd995ce-87aa-53f5-9a77-6738ff520ab1 with identifier: 202509066098496
2026-03-25 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4fd995ce-87aa-53f5-9a77-6738ff520ab1
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdd65bb31a2b84949bbcf9694b195eb07.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dd65bb31a2b84949bbcf9694b195eb07.jpg not downloaded yet
2026-03-25 17:06:50 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:50 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 72825c3d-172e-5c9b-9802-8ea70d92f43f with identifier: 202508075233334
2026-03-25 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 72825c3d-172e-5c9b-9802-8ea70d92f43f
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa4a1cdce055a4df1a94d2625e495cc0b.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a4a1cdce055a4df1a94d2625e495cc0b.jpg not downloaded yet
2026-03-25 17:06:50 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:50 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: f8ff1bcd-434a-514f-9727-8a6093b3d4b9 with identifier: 202508045125340
2026-03-25 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f8ff1bcd-434a-514f-9727-8a6093b3d4b9
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F43dcaa3efed44f309437f668a67b4cc2.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/43dcaa3efed44f309437f668a67b4cc2.jpg not downloaded yet
2026-03-25 17:06:50 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:50 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 981a4a2f-e488-589e-b4d7-645bea5cac88 with identifier: 202505122301597
2026-03-25 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 981a4a2f-e488-589e-b4d7-645bea5cac88
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8e9ad2a31798438c9edb43b16a7de7ca.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8e9ad2a31798438c9edb43b16a7de7ca.jpg not downloaded yet
2026-03-25 17:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/48841a75688d406180875f1fb407e0b6.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/40eae22fc0624079bbc9698419a67b39.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/63720660794a4c4d8357e0d30fc4db08.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/dd65bb31a2b84949bbcf9694b195eb07.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/8eacf79135c44ba890acfa0ed111335c.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/a4a1cdce055a4df1a94d2625e495cc0b.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66e16e650>
2026-03-25 17:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d21c9873-e85f-5a65-9b17-8652848af91d/d21c9873-e85f-5a65-9b17-8652848af91d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F48841a75688d406180875f1fb407e0b6.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/48841a75688d406180875f1fb407e0b6.jpg saved to cache
2026-03-25 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d21c9873-e85f-5a65-9b17-8652848af91d
2026-03-25 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d21c9873-e85f-5a65-9b17-8652848af91d sending to next pipeline
2026-03-25 17:06:50 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d21c9873-e85f-5a65-9b17-8652848af91d with identifier 202510066924736
2026-03-25 17:06:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:50 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d21c9873-e85f-5a65-9b17-8652848af91d
2026-03-25 17:06:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/48841a75688d406180875f1fb407e0b6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 234,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'This 2024 Porsche 911 T 992 Carrera T is a superb example, '
                'boasting a clear vehicle history and having been owned by '
                'just one individual. Powered by a potent 3.0 litre petrol '
                'engine meeting Euro 6 emissions standards, this model offers '
                "an exhilarating driving experience. Inside, you'll find a "
                'wealth of modern conveniences, including seamless smartphone '
                'integration with Apple CarPlay and Android Auto, ensuring '
                'your devices are always connected. The cabin is further '
                'enhanced by heated front seats for comfort in all conditions, '
                'and striking LED main headlights with distinctive four point '
                'LED daytime running lights.\n'
                '\n'
                'The instrument cluster is a sophisticated blend of classic '
                'design and modern technology, featuring a central analogue '
                'rev counter alongside two 7 inch TFT displays. This Porsche '
                '911 T 992 Carrera T accelerates from 0 to 60 miles per hour '
                'in a remarkable 4.0 seconds, a performance that places it '
                'ahead of many comparable vehicles. The two zone automatic '
                'climate control ensures a comfortable environment for all '
                'occupants, making every journey a pleasure. CALL 0161 633 '
                '3286/ 07867 314825. £399 admin fees apply where 3rd party '
                'finance companies are used.',
 'doors_number': 2,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 380,
 'fuel_type': 'Petrol',
 'id': 'd21c9873-e85f-5a65-9b17-8652848af91d',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510066924736',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Porsche',
 'model': '911',
 'odometer': 9000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d21c9873-e85f-5a65-9b17-8652848af91d/d21c9873-e85f-5a65-9b17-8652848af91d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226781,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/48841a75688d406180875f1fb407e0b6.jpg',
             'Width': 1280}],
 'price': 96480,
 'price_includes_vat': True,
 'registration_date': '2024-03-27',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Porsche 911 3.0T 992 Carrera T Coupe 2dr Petrol PDK',
 'transmission': 'automatic',
 'trim': '992 Carrera T',
 'year': 2024}
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510066924736%27 HTTP/1.1" 200 None
2026-03-25 17:06:50 [auto_selling_autotrader.co.uk] INFO: Saving data for 202510066924736: {'created_time': 1774458410.460648, 'last_price_update_time': 1774458410.460656}
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510066924736') HTTP/1.1" 204 0
2026-03-25 17:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/8e9ad2a31798438c9edb43b16a7de7ca.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c470d10>
2026-03-25 17:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecc40415-1151-5990-8fda-15af4bc918b4/ecc40415-1151-5990-8fda-15af4bc918b4_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F40eae22fc0624079bbc9698419a67b39.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/40eae22fc0624079bbc9698419a67b39.jpg saved to cache
2026-03-25 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ecc40415-1151-5990-8fda-15af4bc918b4
2026-03-25 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ecc40415-1151-5990-8fda-15af4bc918b4 sending to next pipeline
2026-03-25 17:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c398510>
2026-03-25 17:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_082d3fc3-7a2e-5089-bbe5-2a37d490aef4/082d3fc3-7a2e-5089-bbe5-2a37d490aef4_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F63720660794a4c4d8357e0d30fc4db08.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/63720660794a4c4d8357e0d30fc4db08.jpg saved to cache
2026-03-25 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 082d3fc3-7a2e-5089-bbe5-2a37d490aef4
2026-03-25 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 082d3fc3-7a2e-5089-bbe5-2a37d490aef4 sending to next pipeline
2026-03-25 17:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c22c250>
2026-03-25 17:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fd995ce-87aa-53f5-9a77-6738ff520ab1/4fd995ce-87aa-53f5-9a77-6738ff520ab1_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdd65bb31a2b84949bbcf9694b195eb07.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dd65bb31a2b84949bbcf9694b195eb07.jpg saved to cache
2026-03-25 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4fd995ce-87aa-53f5-9a77-6738ff520ab1
2026-03-25 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4fd995ce-87aa-53f5-9a77-6738ff520ab1 sending to next pipeline
2026-03-25 17:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c544990>
2026-03-25 17:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d97c0e-a4d0-595b-ab30-480b9f01d034/08d97c0e-a4d0-595b-ab30-480b9f01d034_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8eacf79135c44ba890acfa0ed111335c.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8eacf79135c44ba890acfa0ed111335c.jpg saved to cache
2026-03-25 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08d97c0e-a4d0-595b-ab30-480b9f01d034
2026-03-25 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08d97c0e-a4d0-595b-ab30-480b9f01d034 sending to next pipeline
2026-03-25 17:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c546250>
2026-03-25 17:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72825c3d-172e-5c9b-9802-8ea70d92f43f/72825c3d-172e-5c9b-9802-8ea70d92f43f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa4a1cdce055a4df1a94d2625e495cc0b.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a4a1cdce055a4df1a94d2625e495cc0b.jpg saved to cache
2026-03-25 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 72825c3d-172e-5c9b-9802-8ea70d92f43f
2026-03-25 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 72825c3d-172e-5c9b-9802-8ea70d92f43f sending to next pipeline
2026-03-25 17:06:50 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ecc40415-1151-5990-8fda-15af4bc918b4 with identifier 202509256631993
2026-03-25 17:06:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:50 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ecc40415-1151-5990-8fda-15af4bc918b4
2026-03-25 17:06:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/40eae22fc0624079bbc9698419a67b39.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 246,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'Carpathian Grey, Glass Panoramic Roof, Full Digital Cockpit, '
                'Full Leather Interior, Heated Front & Rear Seats, Heated '
                'Steering Wheel, Satellite Navigation, Bluetooth Connectivity, '
                'Cruise Control With Speed Limiter, DAB Radio, Apple CarPlay, '
                'Android Auto, Front & Rear Parking Aid Sensors With Reverse '
                'Camera, Electric Folding Door Mirrors, Meridian Sound System, '
                'Drivers Memory Seat, Finance Available, Extended Warranties '
                'Available, Part Exchange Welcome CALL 0161 633 3286/ 07867 '
                '314825. £399 admin fees apply where 3rd party finance '
                'companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 296,
 'fuel_type': 'Diesel',
 'id': 'ecc40415-1151-5990-8fda-15af4bc918b4',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509256631993',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 45000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 61,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc40415-1151-5990-8fda-15af4bc918b4/ecc40415-1151-5990-8fda-15af4bc918b4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268097,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/40eae22fc0624079bbc9698419a67b39.jpg',
             'Width': 1280}],
 'price': 34990,
 'price_includes_vat': True,
 'registration_date': '2020-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 3.0 D300 MHEV HSE Dynamic Black SUV '
          '5dr Diesel Auto 4WD',
 'transmission': 'automatic',
 'trim': 'HSE Dynamic Black',
 'year': 2020}
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509256631993%27 HTTP/1.1" 200 None
2026-03-25 17:06:50 [auto_selling_autotrader.co.uk] INFO: Saving data for 202509256631993: {'created_time': 1774458410.738953, 'last_price_update_time': 1774458410.73896}
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509256631993') HTTP/1.1" 204 0
2026-03-25 17:06:50 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 082d3fc3-7a2e-5089-bbe5-2a37d490aef4 with identifier 202509256618656
2026-03-25 17:06:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:50 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 082d3fc3-7a2e-5089-bbe5-2a37d490aef4
2026-03-25 17:06:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/63720660794a4c4d8357e0d30fc4db08.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'White',
 'currency': 'GBP',
 'description': 'Half Leather Interior, Bluetooth Connectivity, Cruise '
                'Control, Apple CarPlay, Android Auto, USB Input, Front & Rear '
                'Parking Aid Sensors, Finance Available, Extended Warranties '
                'Available, Part Exchange Welcome CALL 0161 633 3286/ 07867 '
                '314825. £399 admin fees apply where 3rd party finance '
                'companies are used.',
 'doors_number': 4,
 'emission_standard': 'Euro 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'fuel_type': 'Petrol',
 'id': '082d3fc3-7a2e-5089-bbe5-2a37d490aef4',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509256618656',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Mercedes-Benz',
 'model': 'CLA',
 'odometer': 56000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 55,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_082d3fc3-7a2e-5089-bbe5-2a37d490aef4/082d3fc3-7a2e-5089-bbe5-2a37d490aef4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213191,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/63720660794a4c4d8357e0d30fc4db08.jpg',
             'Width': 1280}],
 'price': 11480,
 'price_includes_vat': True,
 'registration_date': '2017-09-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA 1.6 CLA180 Sport Coupe 4dr Petrol',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2017}
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509256618656%27 HTTP/1.1" 200 None
2026-03-25 17:06:50 [auto_selling_autotrader.co.uk] INFO: Saving data for 202509256618656: {'created_time': 1774458410.787356, 'last_price_update_time': 1774458410.787364}
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509256618656') HTTP/1.1" 204 0
2026-03-25 17:06:50 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 4fd995ce-87aa-53f5-9a77-6738ff520ab1 with identifier 202509066098496
2026-03-25 17:06:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:50 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 4fd995ce-87aa-53f5-9a77-6738ff520ab1
2026-03-25 17:06:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/dd65bb31a2b84949bbcf9694b195eb07.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'White',
 'currency': 'GBP',
 'description': 'Half Leather Interior, Heated Seats, Satellite Navigation, '
                'Bluetooth Connectivity, Cruise Control, DAB Radio, Apple '
                'CarPlay, Android Auto, Front & Rear Parking Aid Sensors With '
                'Reverse Camera, Finance Available, Extended Warranties '
                'Available, Part Exchange Welcome CALL 0161 633 3286/ 07867 '
                '314825. £399 admin fees apply where 3rd party finance '
                'companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 187,
 'fuel_type': 'Diesel',
 'id': '4fd995ce-87aa-53f5-9a77-6738ff520ab1',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509066098496',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 82000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 62,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fd995ce-87aa-53f5-9a77-6738ff520ab1/4fd995ce-87aa-53f5-9a77-6738ff520ab1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204216,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/dd65bb31a2b84949bbcf9694b195eb07.jpg',
             'Width': 1280}],
 'price': 15990,
 'price_includes_vat': True,
 'registration_date': '2017-11-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI S line SUV 5dr Diesel S Tronic quattro',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2017}
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509066098496%27 HTTP/1.1" 200 None
2026-03-25 17:06:50 [auto_selling_autotrader.co.uk] INFO: Saving data for 202509066098496: {'created_time': 1774458410.833046, 'last_price_update_time': 1774458410.833055}
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509066098496') HTTP/1.1" 204 0
2026-03-25 17:06:50 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 08d97c0e-a4d0-595b-ab30-480b9f01d034 with identifier 202509236567553
2026-03-25 17:06:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:50 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 08d97c0e-a4d0-595b-ab30-480b9f01d034
2026-03-25 17:06:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/8eacf79135c44ba890acfa0ed111335c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'Half Leather Interior, Heated Seats, Bluetooth Connectivity, '
                'Cruise Control With Speed Limiter, DAB Radio, USB Input, Bose '
                'Sound System, Electric Folding Door Mirrors, Rear Parking Aid '
                'Sensors, Electric Folding Door Mirrors, Finance Available, '
                'Extended Warranties Available, Part Exchange Welcome CALL '
                '0161 633 3286/ 07867 314825. £399 admin fees apply where 3rd '
                'party finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 119,
 'fuel_type': 'Petrol',
 'id': '08d97c0e-a4d0-595b-ab30-480b9f01d034',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509236567553',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 45000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 55,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d97c0e-a4d0-595b-ab30-480b9f01d034/08d97c0e-a4d0-595b-ab30-480b9f01d034_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210349,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/8eacf79135c44ba890acfa0ed111335c.jpg',
             'Width': 1280}],
 'price': 10880,
 'price_includes_vat': True,
 'registration_date': '2017-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-3 2.0 SKYACTIV-G GT Sport SUV 5dr Petrol',
 'transmission': 'manual',
 'trim': 'GT Sport',
 'year': 2017}
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509236567553%27 HTTP/1.1" 200 None
2026-03-25 17:06:50 [auto_selling_autotrader.co.uk] INFO: Saving data for 202509236567553: {'created_time': 1774458410.87744, 'last_price_update_time': 1774458410.877447}
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509236567553') HTTP/1.1" 204 0
2026-03-25 17:06:50 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 72825c3d-172e-5c9b-9802-8ea70d92f43f with identifier 202508075233334
2026-03-25 17:06:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:50 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 72825c3d-172e-5c9b-9802-8ea70d92f43f
2026-03-25 17:06:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/a4a1cdce055a4df1a94d2625e495cc0b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'Finished in Grey with Half Leather Interior, 20 inch gloss '
                'black alloys, Virtual cockpit, Gloss black fixed spoiler, '
                'Heated Seats, Bluetooth Connectivity, Cruise Control With '
                'Speed Limiter, DAB Radio, Apple CarPlay, Android Auto, USB '
                'Input, Finance Available, Extended Warranties Available, Part '
                'Exchange Welcome CALL 0161 633 3286/ 07867 314825. £399 admin '
                'fees apply where 3rd party finance companies are used.',
 'doors_number': 3,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 194,
 'fuel_type': 'Petrol',
 'id': '72825c3d-172e-5c9b-9802-8ea70d92f43f',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202508075233334',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Audi',
 'model': 'TT',
 'odometer': 73000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 51,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72825c3d-172e-5c9b-9802-8ea70d92f43f/72825c3d-172e-5c9b-9802-8ea70d92f43f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258960,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/a4a1cdce055a4df1a94d2625e495cc0b.jpg',
             'Width': 1280}],
 'price': 19990,
 'price_includes_vat': True,
 'registration_date': '2021-07-16',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi TT 2.0 TFSI 40 Black Edition Coupe 3dr Petrol S Tronic',
 'transmission': 'automatic',
 'trim': 'Black Edition',
 'year': 2021}
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508075233334%27 HTTP/1.1" 200 None
2026-03-25 17:06:50 [auto_selling_autotrader.co.uk] INFO: Saving data for 202508075233334: {'created_time': 1774458410.91711, 'last_price_update_time': 1774458410.917116}
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202508075233334') HTTP/1.1" 204 0
2026-03-25 17:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/43dcaa3efed44f309437f668a67b4cc2.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c33b0d0>
2026-03-25 17:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_981a4a2f-e488-589e-b4d7-645bea5cac88/981a4a2f-e488-589e-b4d7-645bea5cac88_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8e9ad2a31798438c9edb43b16a7de7ca.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8e9ad2a31798438c9edb43b16a7de7ca.jpg saved to cache
2026-03-25 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 981a4a2f-e488-589e-b4d7-645bea5cac88
2026-03-25 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 981a4a2f-e488-589e-b4d7-645bea5cac88 sending to next pipeline
2026-03-25 17:06:50 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 981a4a2f-e488-589e-b4d7-645bea5cac88 with identifier 202505122301597
2026-03-25 17:06:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:50 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 981a4a2f-e488-589e-b4d7-645bea5cac88
2026-03-25 17:06:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/8e9ad2a31798438c9edb43b16a7de7ca.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'Heated Front & Rear Seats, Satellite Navigation, Bluetooth '
                'Connectivity, Cruise Control With Speed Limiter, DAB Radio, '
                'Apple CarPlay, Android Auto, Rear Parking Aid Sensors With '
                'Reverse Camera, Electric Folding Door Mirrors, Finance '
                'Available, Extended Warranties Available, Part Exchange '
                'Welcome CALL 0161 633 3286/ 07867 314825. £399 admin fees '
                'apply where 3rd party finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.6L',
 'engine_horse_power': 130,
 'fuel_type': 'Petrol',
 'id': '981a4a2f-e488-589e-b4d7-645bea5cac88',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202505122301597',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 60000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 55,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_981a4a2f-e488-589e-b4d7-645bea5cac88/981a4a2f-e488-589e-b4d7-645bea5cac88_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241517,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/8e9ad2a31798438c9edb43b16a7de7ca.jpg',
             'Width': 1280}],
 'price': 10990,
 'price_includes_vat': True,
 'registration_date': '2019-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Sportage 1.6 GDi 2 SUV 5dr Petrol',
 'transmission': 'manual',
 'trim': '2',
 'year': 2019}
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202505122301597%27 HTTP/1.1" 200 None
2026-03-25 17:06:51 [auto_selling_autotrader.co.uk] INFO: Saving data for 202505122301597: {'created_time': 1774458411.014278, 'last_price_update_time': 1774458411.014285}
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202505122301597') HTTP/1.1" 204 0
2026-03-25 17:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c43d2d0>
2026-03-25 17:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8ff1bcd-434a-514f-9727-8a6093b3d4b9/f8ff1bcd-434a-514f-9727-8a6093b3d4b9_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F43dcaa3efed44f309437f668a67b4cc2.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/43dcaa3efed44f309437f668a67b4cc2.jpg saved to cache
2026-03-25 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f8ff1bcd-434a-514f-9727-8a6093b3d4b9
2026-03-25 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f8ff1bcd-434a-514f-9727-8a6093b3d4b9 sending to next pipeline
2026-03-25 17:06:51 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: f8ff1bcd-434a-514f-9727-8a6093b3d4b9 with identifier 202508045125340
2026-03-25 17:06:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:51 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item f8ff1bcd-434a-514f-9727-8a6093b3d4b9
2026-03-25 17:06:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/43dcaa3efed44f309437f668a67b4cc2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'Satellite Navigation, Bluetooth Connectivity, Cruise Control '
                'With Speed Limiter, DAB Radio, Apple CarPlay, USB Inputs, '
                'Front & Rear Parking Aid Sensors With 360 Cameras, Electric '
                'Folding Door Mirrors, Finance Available, Extended Warranties '
                'Available, Part Exchange Welcome CALL 0161 633 3286/ 07867 '
                '314825. £399 admin fees apply where 3rd party finance '
                'companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.3L',
 'engine_horse_power': 156,
 'fuel_type': 'Petrol Hybrid',
 'id': 'f8ff1bcd-434a-514f-9727-8a6093b3d4b9',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202508045125340',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 41000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 60,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8ff1bcd-434a-514f-9727-8a6093b3d4b9/f8ff1bcd-434a-514f-9727-8a6093b3d4b9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250763,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/43dcaa3efed44f309437f668a67b4cc2.jpg',
             'Width': 1280}],
 'price': 15480,
 'price_includes_vat': True,
 'registration_date': '2022-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T MHEV N-Connecta SUV 5dr Petrol Hybrid '
          'XTRON',
 'transmission': 'automatic',
 'trim': 'N-Connecta',
 'year': 2022}
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508045125340%27 HTTP/1.1" 200 None
2026-03-25 17:06:51 [auto_selling_autotrader.co.uk] INFO: Saving data for 202508045125340: {'created_time': 1774458411.127808, 'last_price_update_time': 1774458411.127819}
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202508045125340') HTTP/1.1" 204 0
2026-03-25 17:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-25 17:06:51 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:51 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a37a06ad-f3c0-5aca-8f5d-cc78ed1f7934 with identifier: 202601219316270
2026-03-25 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a37a06ad-f3c0-5aca-8f5d-cc78ed1f7934
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd866ccf4987b4fda919653fb70770484.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d866ccf4987b4fda919653fb70770484.jpg not downloaded yet
2026-03-25 17:06:51 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:51 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d7cc56e2-660c-59f4-ad93-c13ef54a0255 with identifier: 202601089011901
2026-03-25 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d7cc56e2-660c-59f4-ad93-c13ef54a0255
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fae59882bae2b4f41906f316889dd607f.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ae59882bae2b4f41906f316889dd607f.jpg not downloaded yet
2026-03-25 17:06:51 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:51 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 73ce77f9-8cba-5e6e-bb94-b79d57a7bc2b with identifier: 202601068958239
2026-03-25 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 73ce77f9-8cba-5e6e-bb94-b79d57a7bc2b
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8b57100d8dd6496d8a80b5d9392e2a03.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8b57100d8dd6496d8a80b5d9392e2a03.jpg not downloaded yet
2026-03-25 17:06:51 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:51 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cd70afb-8dcb-5ef0-aac8-652cf70e1e4f with identifier: 202512058408672
2026-03-25 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3cd70afb-8dcb-5ef0-aac8-652cf70e1e4f
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb0fd230e19984adaa05be4b9436a9f36.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b0fd230e19984adaa05be4b9436a9f36.jpg not downloaded yet
2026-03-25 17:06:51 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:51 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b7aff91-5be3-52cc-ba11-4009e1b97194 with identifier: 202512058408310
2026-03-25 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9b7aff91-5be3-52cc-ba11-4009e1b97194
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F63035c8c037e49c48fcd9947fca18f9d.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/63035c8c037e49c48fcd9947fca18f9d.jpg not downloaded yet
2026-03-25 17:06:51 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:51 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a73e294c-a802-5c37-9d82-db5930c0fb00 with identifier: 202511208030554
2026-03-25 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a73e294c-a802-5c37-9d82-db5930c0fb00
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F00f8eba0026542978e54dc4087955063.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/00f8eba0026542978e54dc4087955063.jpg not downloaded yet
2026-03-25 17:06:51 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:51 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b7aa9dde-e5c0-56ec-9cd5-a6ff712540ea with identifier: 202511208030422
2026-03-25 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b7aa9dde-e5c0-56ec-9cd5-a6ff712540ea
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff9c8e418a9844480a7d0f5e82a19e540.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f9c8e418a9844480a7d0f5e82a19e540.jpg not downloaded yet
2026-03-25 17:06:51 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:51 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 90d21e17-672e-5bc7-b145-5af0f13fb8d2 with identifier: 202511017579143
2026-03-25 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 90d21e17-672e-5bc7-b145-5af0f13fb8d2
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4df0ea9ad1034370bc75feaef1b75325.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4df0ea9ad1034370bc75feaef1b75325.jpg not downloaded yet
2026-03-25 17:06:51 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:51 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 801ffbae-4c1c-55df-b6da-36b6d5d44a0f with identifier: 202510147134012
2026-03-25 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 801ffbae-4c1c-55df-b6da-36b6d5d44a0f
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F85ce7522ae1f46e794d14dc716cccb24.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/85ce7522ae1f46e794d14dc716cccb24.jpg not downloaded yet
2026-03-25 17:06:51 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:51 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ca8f7bc-12e1-5a68-9c7e-4916c9490c6d with identifier: 202510107059106
2026-03-25 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8ca8f7bc-12e1-5a68-9c7e-4916c9490c6d
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd8734cfe4d234a9e9d3d7ac898b4cb7d.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d8734cfe4d234a9e9d3d7ac898b4cb7d.jpg not downloaded yet
2026-03-25 17:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/8b57100d8dd6496d8a80b5d9392e2a03.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/d866ccf4987b4fda919653fb70770484.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/b0fd230e19984adaa05be4b9436a9f36.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/ae59882bae2b4f41906f316889dd607f.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/d8734cfe4d234a9e9d3d7ac898b4cb7d.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/63035c8c037e49c48fcd9947fca18f9d.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c161310>
2026-03-25 17:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73ce77f9-8cba-5e6e-bb94-b79d57a7bc2b/73ce77f9-8cba-5e6e-bb94-b79d57a7bc2b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8b57100d8dd6496d8a80b5d9392e2a03.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8b57100d8dd6496d8a80b5d9392e2a03.jpg saved to cache
2026-03-25 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73ce77f9-8cba-5e6e-bb94-b79d57a7bc2b
2026-03-25 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73ce77f9-8cba-5e6e-bb94-b79d57a7bc2b sending to next pipeline
2026-03-25 17:06:51 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 73ce77f9-8cba-5e6e-bb94-b79d57a7bc2b with identifier 202601068958239
2026-03-25 17:06:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:51 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 73ce77f9-8cba-5e6e-bb94-b79d57a7bc2b
2026-03-25 17:06:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/8b57100d8dd6496d8a80b5d9392e2a03.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'This 2018 Renault Captur dCi ENERGY Dynamique S Nav boasts '
                'exceptionally low mileage for its age, having covered just '
                '21,000 miles. This Euro 6 compliant 1.5L diesel model comes '
                'with an MOT valid until April 2026, offering peace of mind. '
                'The Dynamique S Nav trim level includes desirable features '
                'such as full LED headlights, automatic climate control with a '
                'one touch demist function, rear parking sensors for easier '
                'manoeuvring, and the MediaNav multimedia system with '
                'Bluetooth connectivity. Convenience is further enhanced by a '
                'handsfree keycard with push button start and stop '
                'functionality, alongside keyless entry.\n'
                '\n'
                'This Renault Captur offers significant advantages over '
                'similar vehicles. Its impressive fuel economy of 72 mpg means '
                'fewer stops at the petrol station and lower running costs. '
                'Furthermore, its low insurance group rating contributes to '
                'more affordable ownership. The vehicle also benefits from low '
                'CO2 emissions, making it a more environmentally conscious '
                'choice. CALL 0161 633 3286/ 07867 314825. £399 admin fees '
                'apply where 3rd party finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 89,
 'fuel_type': 'Diesel',
 'id': '73ce77f9-8cba-5e6e-bb94-b79d57a7bc2b',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601068958239',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 21000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73ce77f9-8cba-5e6e-bb94-b79d57a7bc2b/73ce77f9-8cba-5e6e-bb94-b79d57a7bc2b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231849,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/8b57100d8dd6496d8a80b5d9392e2a03.jpg',
             'Width': 1280}],
 'price': 10990,
 'price_includes_vat': True,
 'registration_date': '2018-05-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.5 dCi ENERGY Dynamique S Nav SUV 5dr Diesel EDC',
 'transmission': 'automatic',
 'trim': 'Dynamique S Nav',
 'year': 2018}
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601068958239%27 HTTP/1.1" 200 None
2026-03-25 17:06:51 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601068958239: {'created_time': 1774458411.935238, 'last_price_update_time': 1774458411.935251}
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601068958239') HTTP/1.1" 204 0
2026-03-25 17:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/4df0ea9ad1034370bc75feaef1b75325.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/f9c8e418a9844480a7d0f5e82a19e540.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c2cdb50>
2026-03-25 17:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a37a06ad-f3c0-5aca-8f5d-cc78ed1f7934/a37a06ad-f3c0-5aca-8f5d-cc78ed1f7934_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd866ccf4987b4fda919653fb70770484.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d866ccf4987b4fda919653fb70770484.jpg saved to cache
2026-03-25 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a37a06ad-f3c0-5aca-8f5d-cc78ed1f7934
2026-03-25 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a37a06ad-f3c0-5aca-8f5d-cc78ed1f7934 sending to next pipeline
2026-03-25 17:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c1d3250>
2026-03-25 17:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cd70afb-8dcb-5ef0-aac8-652cf70e1e4f/3cd70afb-8dcb-5ef0-aac8-652cf70e1e4f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb0fd230e19984adaa05be4b9436a9f36.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b0fd230e19984adaa05be4b9436a9f36.jpg saved to cache
2026-03-25 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3cd70afb-8dcb-5ef0-aac8-652cf70e1e4f
2026-03-25 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3cd70afb-8dcb-5ef0-aac8-652cf70e1e4f sending to next pipeline
2026-03-25 17:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c1dad50>
2026-03-25 17:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7cc56e2-660c-59f4-ad93-c13ef54a0255/d7cc56e2-660c-59f4-ad93-c13ef54a0255_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fae59882bae2b4f41906f316889dd607f.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ae59882bae2b4f41906f316889dd607f.jpg saved to cache
2026-03-25 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d7cc56e2-660c-59f4-ad93-c13ef54a0255
2026-03-25 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d7cc56e2-660c-59f4-ad93-c13ef54a0255 sending to next pipeline
2026-03-25 17:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c266450>
2026-03-25 17:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca8f7bc-12e1-5a68-9c7e-4916c9490c6d/8ca8f7bc-12e1-5a68-9c7e-4916c9490c6d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd8734cfe4d234a9e9d3d7ac898b4cb7d.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d8734cfe4d234a9e9d3d7ac898b4cb7d.jpg saved to cache
2026-03-25 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ca8f7bc-12e1-5a68-9c7e-4916c9490c6d
2026-03-25 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ca8f7bc-12e1-5a68-9c7e-4916c9490c6d sending to next pipeline
2026-03-25 17:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c471a50>
2026-03-25 17:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b7aff91-5be3-52cc-ba11-4009e1b97194/9b7aff91-5be3-52cc-ba11-4009e1b97194_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F63035c8c037e49c48fcd9947fca18f9d.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/63035c8c037e49c48fcd9947fca18f9d.jpg saved to cache
2026-03-25 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b7aff91-5be3-52cc-ba11-4009e1b97194
2026-03-25 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b7aff91-5be3-52cc-ba11-4009e1b97194 sending to next pipeline
2026-03-25 17:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/00f8eba0026542978e54dc4087955063.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:52 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a37a06ad-f3c0-5aca-8f5d-cc78ed1f7934 with identifier 202601219316270
2026-03-25 17:06:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:52 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a37a06ad-f3c0-5aca-8f5d-cc78ed1f7934
2026-03-25 17:06:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/d866ccf4987b4fda919653fb70770484.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'White',
 'currency': 'GBP',
 'description': 'Bluetooth Connectivity, Cruise Control With Speed Limiter, '
                'DAB Radio, Apple CarPlay, Android Auto, Rear Parking Aid '
                'Camera, Finance Available, Extended Warranties Available, '
                'Part Exchange Welcome CALL 0161 633 3286/ 07867 314825. £399 '
                'admin fees apply where 3rd party finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 66,
 'fuel_type': 'Petrol',
 'id': 'a37a06ad-f3c0-5aca-8f5d-cc78ed1f7934',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601219316270',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 19000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 51,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a37a06ad-f3c0-5aca-8f5d-cc78ed1f7934/a37a06ad-f3c0-5aca-8f5d-cc78ed1f7934_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 191073,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/d866ccf4987b4fda919653fb70770484.jpg',
             'Width': 1280}],
 'price': 11780,
 'price_includes_vat': True,
 'registration_date': '2022-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai I10 1.0 SE Connect Hatchback 5dr Petrol Auto',
 'transmission': 'automatic',
 'trim': 'SE Connect',
 'year': 2022}
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601219316270%27 HTTP/1.1" 200 None
2026-03-25 17:06:52 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601219316270: {'created_time': 1774458412.206501, 'last_price_update_time': 1774458412.206509}
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601219316270') HTTP/1.1" 204 0
2026-03-25 17:06:52 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 3cd70afb-8dcb-5ef0-aac8-652cf70e1e4f with identifier 202512058408672
2026-03-25 17:06:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:52 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 3cd70afb-8dcb-5ef0-aac8-652cf70e1e4f
2026-03-25 17:06:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/b0fd230e19984adaa05be4b9436a9f36.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'This 2023 MG ZS VTi-TECH Exclusive presents an exceptional '
                'opportunity with its remarkably low mileage of just 17,000 '
                'miles for its age. This Euro 6 compliant 1.5L petrol model, '
                'finished in the Exclusive trim, offers a refined driving '
                'experience. Stay connected and entertained with seamless '
                'Apple CarPlay integration and Bluetooth connectivity. '
                'Navigating tight spaces is made effortless thanks to the 360 '
                'degree parking camera, further enhanced by blind spot '
                'monitoring for added safety. The Bi-Function LED headlights '
                'provide excellent visibility in all conditions.\n'
                '\n'
                'The MG ZS VTi-TECH Exclusive stands out with its '
                'comprehensive suite of advanced features, indicating a '
                'superior level of specification compared to other vehicles in '
                'its class. Its low insurance group rating also contributes to '
                'its overall affordability and appeal. This well equipped and '
                'carefully maintained ZS is ready for its next owner, offering '
                'a blend of practicality, technology, and value. CALL 0161 633 '
                '3286/ 07867 314825. £399 admin fees apply where 3rd party '
                'finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 105,
 'fuel_type': 'Petrol',
 'id': '3cd70afb-8dcb-5ef0-aac8-652cf70e1e4f',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512058408672',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'MG',
 'model': 'MG ZS',
 'odometer': 17000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 57,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cd70afb-8dcb-5ef0-aac8-652cf70e1e4f/3cd70afb-8dcb-5ef0-aac8-652cf70e1e4f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223128,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/b0fd230e19984adaa05be4b9436a9f36.jpg',
             'Width': 1280}],
 'price': 12480,
 'price_includes_vat': True,
 'registration_date': '2023-01-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MG MG Zs 1.5 VTi-TECH Exclusive SUV 5dr Petrol',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2023}
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512058408672%27 HTTP/1.1" 200 None
2026-03-25 17:06:52 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512058408672: {'created_time': 1774458412.261098, 'last_price_update_time': 1774458412.261105}
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512058408672') HTTP/1.1" 204 0
2026-03-25 17:06:52 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d7cc56e2-660c-59f4-ad93-c13ef54a0255 with identifier 202601089011901
2026-03-25 17:06:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:52 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d7cc56e2-660c-59f4-ad93-c13ef54a0255
2026-03-25 17:06:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/ae59882bae2b4f41906f316889dd607f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'This 2021 Mercedes-Benz A Class A180 AMG Line boasts '
                'exceptionally low mileage for its age, having covered just '
                '25,000 miles. This Euro 6 compliant 1.3 litre petrol model, '
                'presented in the desirable AMG Line trim, offers a refined '
                'driving experience. Its MOT is valid until October 2026, '
                "providing peace of mind. Inside, you'll find a premium "
                'Mercedes-Benz Sound System with 100W output, dual Bluetooth '
                'interfaces for seamless connectivity, and THERMOTRONIC luxury '
                'automatic climate control with a display for perfect cabin '
                'temperature. The LED High Performance Headlamps with '
                'integrated daytime running lights ensure excellent '
                'visibility, while the 180-degree reversing camera with '
                'parking guidelines makes manoeuvring effortless.\n'
                '\n'
                'The A180 AMG Line is designed for both performance and '
                'practicality. Its acceleration from 0-60mph in 8.8 seconds '
                'demonstrates its responsive nature, outperforming many '
                'similar vehicles in its class. This capability is '
                'complemented by a generously sized boot, offering ample space '
                'for shopping, luggage, or equipment. The combination of its '
                'advanced features, efficient engine, and impressive '
                'acceleration, alongside its remarkably low mileage, makes '
                'this Mercedes-Benz A Class a compelling choice for those '
                'seeking a premium and capable compact car. CALL 0161 633 '
                '3286/ 07867 314825. £399 admin fees apply where 3rd party '
                'finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.3L',
 'engine_horse_power': 134,
 'fuel_type': 'Petrol',
 'id': 'd7cc56e2-660c-59f4-ad93-c13ef54a0255',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601089011901',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Mercedes-Benz',
 'model': 'A Class',
 'odometer': 25000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7cc56e2-660c-59f4-ad93-c13ef54a0255/d7cc56e2-660c-59f4-ad93-c13ef54a0255_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246327,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/ae59882bae2b4f41906f316889dd607f.jpg',
             'Width': 1280}],
 'price': 17780,
 'price_includes_vat': True,
 'registration_date': '2021-04-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Class 1.3 A180 AMG Line Hatchback 5dr Petrol 7G-DCT',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601089011901%27 HTTP/1.1" 200 None
2026-03-25 17:06:52 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601089011901: {'created_time': 1774458412.316375, 'last_price_update_time': 1774458412.316383}
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601089011901') HTTP/1.1" 204 0
2026-03-25 17:06:52 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 8ca8f7bc-12e1-5a68-9c7e-4916c9490c6d with identifier 202510107059106
2026-03-25 17:06:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:52 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 8ca8f7bc-12e1-5a68-9c7e-4916c9490c6d
2026-03-25 17:06:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/d8734cfe4d234a9e9d3d7ac898b4cb7d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'White',
 'currency': 'GBP',
 'description': 'Digital Cockpit Satellite Navigation, Bluetooth Connectivity, '
                'Cruise Control With Speed Limiter, DAB Radio, Apple CarPlay, '
                'Android Auto, Front & Rear Parking Aid Sensors, Finance '
                'Available, Extended Warranties Available, Part Exchange '
                'Welcome CALL 0161 633 3286/ 07867 314825. £399 admin fees '
                'apply where 3rd party finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 134,
 'fuel_type': 'Petrol',
 'id': '8ca8f7bc-12e1-5a68-9c7e-4916c9490c6d',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510107059106',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'BMW',
 'model': '1 Series',
 'odometer': 29000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 58,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca8f7bc-12e1-5a68-9c7e-4916c9490c6d/8ca8f7bc-12e1-5a68-9c7e-4916c9490c6d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200124,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/d8734cfe4d234a9e9d3d7ac898b4cb7d.jpg',
             'Width': 1280}],
 'price': 17480,
 'price_includes_vat': True,
 'registration_date': '2021-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES 1.5 118i Sport (LCP) Hatchback 5dr Petrol DCT',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2021}
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510107059106%27 HTTP/1.1" 200 None
2026-03-25 17:06:52 [auto_selling_autotrader.co.uk] INFO: Saving data for 202510107059106: {'created_time': 1774458412.361832, 'last_price_update_time': 1774458412.361839}
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510107059106') HTTP/1.1" 204 0
2026-03-25 17:06:52 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 9b7aff91-5be3-52cc-ba11-4009e1b97194 with identifier 202512058408310
2026-03-25 17:06:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:52 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 9b7aff91-5be3-52cc-ba11-4009e1b97194
2026-03-25 17:06:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/63035c8c037e49c48fcd9947fca18f9d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 92,
 'color': 'White',
 'currency': 'GBP',
 'description': 'Bluetooth Connectivity, Cruise Control, DAB Radio, Apple '
                'CarPlay, Android Auto, USB Input, Rear Parking Aid Camera, '
                'Finance Available, Extended Warranties Available, Part '
                'Exchange Welcome CALL 0161 633 3286/ 07867 314825. £399 admin '
                'fees apply where 3rd party finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 114,
 'fuel_type': 'Petrol Hybrid',
 'id': '9b7aff91-5be3-52cc-ba11-4009e1b97194',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512058408310',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 16000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 54,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b7aff91-5be3-52cc-ba11-4009e1b97194/9b7aff91-5be3-52cc-ba11-4009e1b97194_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225530,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/63035c8c037e49c48fcd9947fca18f9d.jpg',
             'Width': 1280}],
 'price': 15480,
 'price_includes_vat': True,
 'registration_date': '2022-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.5 VVT-h Icon Hatchback 5dr Petrol Hybrid E-CVT',
 'transmission': 'automatic',
 'trim': 'Icon',
 'year': 2022}
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512058408310%27 HTTP/1.1" 200 None
2026-03-25 17:06:52 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512058408310: {'created_time': 1774458412.404974, 'last_price_update_time': 1774458412.404981}
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512058408310') HTTP/1.1" 204 0
2026-03-25 17:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/85ce7522ae1f46e794d14dc716cccb24.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c226b90>
2026-03-25 17:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90d21e17-672e-5bc7-b145-5af0f13fb8d2/90d21e17-672e-5bc7-b145-5af0f13fb8d2_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4df0ea9ad1034370bc75feaef1b75325.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4df0ea9ad1034370bc75feaef1b75325.jpg saved to cache
2026-03-25 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 90d21e17-672e-5bc7-b145-5af0f13fb8d2
2026-03-25 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 90d21e17-672e-5bc7-b145-5af0f13fb8d2 sending to next pipeline
2026-03-25 17:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c418fd0>
2026-03-25 17:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7aa9dde-e5c0-56ec-9cd5-a6ff712540ea/b7aa9dde-e5c0-56ec-9cd5-a6ff712540ea_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff9c8e418a9844480a7d0f5e82a19e540.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f9c8e418a9844480a7d0f5e82a19e540.jpg saved to cache
2026-03-25 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b7aa9dde-e5c0-56ec-9cd5-a6ff712540ea
2026-03-25 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b7aa9dde-e5c0-56ec-9cd5-a6ff712540ea sending to next pipeline
2026-03-25 17:06:52 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 90d21e17-672e-5bc7-b145-5af0f13fb8d2 with identifier 202511017579143
2026-03-25 17:06:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:52 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 90d21e17-672e-5bc7-b145-5af0f13fb8d2
2026-03-25 17:06:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/4df0ea9ad1034370bc75feaef1b75325.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'This 2019 Ford EcoSport T Titanium presents an exceptional '
                'opportunity with remarkably low mileage for its age, having '
                'covered just 33,000 miles. This Euro 6 compliant 1.0L petrol '
                'model is presented in the desirable Titanium trim, offering a '
                'refined driving experience. Its MOT is valid until August '
                '2026, providing peace of mind for the new owner. Notable '
                'features include a Rear View Camera Pack with parking '
                'assistance sensors, automatic headlights for enhanced '
                'visibility, and electronic automatic temperature control for '
                'consistent cabin comfort.\n'
                '\n'
                'The Ford SYNC 3 navigation system, complete with an 8 inch '
                'touchscreen, seamlessly integrates Android Auto and Apple '
                'CarPlay, keeping you connected on every journey. With an '
                'impressive fuel economy of 46 mpg, this EcoSport is designed '
                'to be economical to run, a highlight that sets it apart from '
                'many other vehicles in its class. Furthermore, its low CO2 '
                'emissions contribute to its environmentally conscious '
                'profile, making it a sensible choice for drivers seeking '
                'efficiency and modern technology. CALL 0161 633 3286/ 07867 '
                '314825. £399 admin fees apply where 3rd party finance '
                'companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 123,
 'fuel_type': 'Petrol',
 'id': '90d21e17-672e-5bc7-b145-5af0f13fb8d2',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511017579143',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 33000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 61,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90d21e17-672e-5bc7-b145-5af0f13fb8d2/90d21e17-672e-5bc7-b145-5af0f13fb8d2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255235,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/4df0ea9ad1034370bc75feaef1b75325.jpg',
             'Width': 1280}],
 'price': 8990,
 'price_includes_vat': True,
 'registration_date': '2019-08-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Ecosport 1.0T EcoBoost GPF Titanium SUV 5dr Petrol',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2019}
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511017579143%27 HTTP/1.1" 200 None
2026-03-25 17:06:52 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511017579143: {'created_time': 1774458412.572364, 'last_price_update_time': 1774458412.572373}
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511017579143') HTTP/1.1" 204 0
2026-03-25 17:06:52 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b7aa9dde-e5c0-56ec-9cd5-a6ff712540ea with identifier 202511208030422
2026-03-25 17:06:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:52 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b7aa9dde-e5c0-56ec-9cd5-a6ff712540ea
2026-03-25 17:06:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/f9c8e418a9844480a7d0f5e82a19e540.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'Bluetooth Connectivity, Cruise Control With Speed Limiter, '
                'DAB Radio, Apple CarPlay, Android Auto, Rear Parking Aid '
                'Sensors, USB Input, Finance Available, Extended Warranties '
                'Available, Part Exchange Welcome CALL 0161 633 3286/ 07867 '
                '314825. £399 admin fees apply where 3rd party finance '
                'companies are used.',
 'doors_number': 5,
 'engine_horse_power': 200,
 'fuel_type': 'Electric',
 'id': 'b7aa9dde-e5c0-56ec-9cd5-a6ff712540ea',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511208030422',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'MG',
 'model': 'MG4',
 'odometer': 18000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 48,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7aa9dde-e5c0-56ec-9cd5-a6ff712540ea/b7aa9dde-e5c0-56ec-9cd5-a6ff712540ea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211388,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/f9c8e418a9844480a7d0f5e82a19e540.jpg',
             'Width': 1280}],
 'price': 12990,
 'price_includes_vat': True,
 'registration_date': '2023-09-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MG MG 4 64kWh SE Long Range Hatchback 5dr Electric Auto (203 ps)',
 'transmission': 'automatic',
 'trim': 'SE Long Range',
 'year': 2023}
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511208030422%27 HTTP/1.1" 200 None
2026-03-25 17:06:52 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511208030422: {'created_time': 1774458412.627032, 'last_price_update_time': 1774458412.627042}
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511208030422') HTTP/1.1" 204 0
2026-03-25 17:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c41b190>
2026-03-25 17:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a73e294c-a802-5c37-9d82-db5930c0fb00/a73e294c-a802-5c37-9d82-db5930c0fb00_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F00f8eba0026542978e54dc4087955063.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/00f8eba0026542978e54dc4087955063.jpg saved to cache
2026-03-25 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a73e294c-a802-5c37-9d82-db5930c0fb00
2026-03-25 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a73e294c-a802-5c37-9d82-db5930c0fb00 sending to next pipeline
2026-03-25 17:06:52 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a73e294c-a802-5c37-9d82-db5930c0fb00 with identifier 202511208030554
2026-03-25 17:06:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:52 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a73e294c-a802-5c37-9d82-db5930c0fb00
2026-03-25 17:06:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/00f8eba0026542978e54dc4087955063.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'Bluetooth Connectivity, Apple CarPlay, Android Auto, USB '
                'Input, Electric Folding Door Mirrors, Finance Available, '
                'Extended Warranties Available, Part Exchange Welcome CALL '
                '0161 633 3286/ 07867 314825. £399 admin fees apply where 3rd '
                'party finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 94,
 'fuel_type': 'Petrol',
 'id': 'a73e294c-a802-5c37-9d82-db5930c0fb00',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511208030554',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 45000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 57,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a73e294c-a802-5c37-9d82-db5930c0fb00/a73e294c-a802-5c37-9d82-db5930c0fb00_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231412,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/00f8eba0026542978e54dc4087955063.jpg',
             'Width': 1280}],
 'price': 13760,
 'price_includes_vat': True,
 'registration_date': '2021-06-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A1 1.0 TFSI 25 Technik Sportback 5dr Petrol',
 'transmission': 'manual',
 'trim': 'Technik',
 'year': 2021}
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511208030554%27 HTTP/1.1" 200 None
2026-03-25 17:06:52 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511208030554: {'created_time': 1774458412.724664, 'last_price_update_time': 1774458412.724675}
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511208030554') HTTP/1.1" 204 0
2026-03-25 17:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c439e90>
2026-03-25 17:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_801ffbae-4c1c-55df-b6da-36b6d5d44a0f/801ffbae-4c1c-55df-b6da-36b6d5d44a0f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F85ce7522ae1f46e794d14dc716cccb24.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/85ce7522ae1f46e794d14dc716cccb24.jpg saved to cache
2026-03-25 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 801ffbae-4c1c-55df-b6da-36b6d5d44a0f
2026-03-25 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 801ffbae-4c1c-55df-b6da-36b6d5d44a0f sending to next pipeline
2026-03-25 17:06:52 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 801ffbae-4c1c-55df-b6da-36b6d5d44a0f with identifier 202510147134012
2026-03-25 17:06:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:52 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 801ffbae-4c1c-55df-b6da-36b6d5d44a0f
2026-03-25 17:06:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/85ce7522ae1f46e794d14dc716cccb24.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'This 2022 Peugeot 3008 BlueHDi Allure Premium offers '
                'excellent peace of mind with its MOT valid until August 2026. '
                'This stylish SUV is equipped with a 1.5 litre Euro 6 diesel '
                'engine, known for its efficiency. The Allure Premium trim '
                'level ensures a well appointed interior and exterior, '
                'featuring Eco LED headlights for clear visibility and '
                'automatic activation. For enhanced safety and convenience, it '
                'includes the Safety Plus Pack with Blind Spot Assistance and '
                'the Visibility Pack. Parking is made simpler with the Rear '
                'Parking Aid, and the electric door mirrors offer blind spot '
                'detection and an auto dipping function when reversing.\n'
                '\n'
                'The Peugeot 3008 BlueHDi Allure Premium stands out with its '
                'impressive fuel economy, achieving a highlight of 61 miles '
                'per gallon, which indicates it is more economical than many '
                'similar vehicles. This efficiency is complemented by low CO2 '
                'emissions, making it a more environmentally conscious choice. '
                'Furthermore, you will appreciate the generous boot space, '
                'offering ample room for luggage, shopping, or equipment, '
                'demonstrating its practicality for everyday use and longer '
                'journeys. CALL 0161 633 3286/ 07867 314825. £399 admin fees '
                'apply where 3rd party finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 129,
 'fuel_type': 'Diesel',
 'id': '801ffbae-4c1c-55df-b6da-36b6d5d44a0f',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510147134012',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 41000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 57,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_801ffbae-4c1c-55df-b6da-36b6d5d44a0f/801ffbae-4c1c-55df-b6da-36b6d5d44a0f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221670,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/85ce7522ae1f46e794d14dc716cccb24.jpg',
             'Width': 1280}],
 'price': 14780,
 'price_includes_vat': True,
 'registration_date': '2022-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 BlueHDi Allure Premium SUV 5dr Diesel',
 'transmission': 'manual',
 'trim': 'Allure Premium',
 'year': 2022}
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510147134012%27 HTTP/1.1" 200 None
2026-03-25 17:06:52 [auto_selling_autotrader.co.uk] INFO: Saving data for 202510147134012: {'created_time': 1774458412.820652, 'last_price_update_time': 1774458412.820662}
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510147134012') HTTP/1.1" 204 0
2026-03-25 17:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-25 17:07:16 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:07:16 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 72e6dca1-514e-5c68-9df0-ea28eb7e1a66 with identifier: 202603040389792
2026-03-25 17:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 72e6dca1-514e-5c68-9df0-ea28eb7e1a66
2026-03-25 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4ec4af2279b94327a4464165056c020d.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4ec4af2279b94327a4464165056c020d.jpg not downloaded yet
2026-03-25 17:07:16 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:07:16 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a2d5b7ad-5ccc-52db-9480-5e38c50395b5 with identifier: 202603020339824
2026-03-25 17:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a2d5b7ad-5ccc-52db-9480-5e38c50395b5
2026-03-25 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1401042ca0544bc9954e7095fb97a92e.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1401042ca0544bc9954e7095fb97a92e.jpg not downloaded yet
2026-03-25 17:07:16 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:07:16 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a92bc479-5bbd-5b30-a151-2fb7376fb9d9 with identifier: 202603020337447
2026-03-25 17:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a92bc479-5bbd-5b30-a151-2fb7376fb9d9
2026-03-25 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F28c008796bb94783b832743996e08028.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/28c008796bb94783b832743996e08028.jpg not downloaded yet
2026-03-25 17:07:16 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:07:16 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 41afd5ad-e6fa-548f-940f-2685cbcd7072 with identifier: 202602270277170
2026-03-25 17:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 41afd5ad-e6fa-548f-940f-2685cbcd7072
2026-03-25 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F86c28f8e413c47d2b947839fe9854404.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/86c28f8e413c47d2b947839fe9854404.jpg not downloaded yet
2026-03-25 17:07:16 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:07:16 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: f2650607-cee5-5878-9afe-cf619148e915 with identifier: 202602270269018
2026-03-25 17:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f2650607-cee5-5878-9afe-cf619148e915
2026-03-25 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0c16b213c633457fa665a791623651c9.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0c16b213c633457fa665a791623651c9.jpg not downloaded yet
2026-03-25 17:07:16 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:07:16 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 65937b9d-0193-50df-b5f5-c4d2bc58cfe1 with identifier: 202602270268861
2026-03-25 17:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 65937b9d-0193-50df-b5f5-c4d2bc58cfe1
2026-03-25 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9b74dff9f07c439c850a189d6b52f352.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9b74dff9f07c439c850a189d6b52f352.jpg not downloaded yet
2026-03-25 17:07:16 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:07:16 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 21b5a84c-dfb2-5b14-99bf-f9eec6214f05 with identifier: 202602240165917
2026-03-25 17:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 21b5a84c-dfb2-5b14-99bf-f9eec6214f05
2026-03-25 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdf9bb54e73564c6996226e237929e8ee.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/df9bb54e73564c6996226e237929e8ee.jpg not downloaded yet
2026-03-25 17:07:16 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:07:16 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ff10787c-15cb-5331-a9c0-28a674b9e2b9 with identifier: 202602210112727
2026-03-25 17:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ff10787c-15cb-5331-a9c0-28a674b9e2b9
2026-03-25 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F163a425b8c0c42d7835cac784d83fc14.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/163a425b8c0c42d7835cac784d83fc14.jpg not downloaded yet
2026-03-25 17:07:16 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:07:16 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d8cf9767-e8bb-5b79-97a3-ecaf18c97377 with identifier: 202602210109681
2026-03-25 17:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d8cf9767-e8bb-5b79-97a3-ecaf18c97377
2026-03-25 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fefa47e816c3b4ce58f97fa0252803e84.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/efa47e816c3b4ce58f97fa0252803e84.jpg not downloaded yet
2026-03-25 17:07:16 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:07:16 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d0797d17-4b6f-5e43-950f-6a6eef114fad with identifier: 202602200091319
2026-03-25 17:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d0797d17-4b6f-5e43-950f-6a6eef114fad
2026-03-25 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F52de4263afa84734beb0470352a8a2d8.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/52de4263afa84734beb0470352a8a2d8.jpg not downloaded yet
2026-03-25 17:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/4ec4af2279b94327a4464165056c020d.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/9b74dff9f07c439c850a189d6b52f352.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/28c008796bb94783b832743996e08028.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/86c28f8e413c47d2b947839fe9854404.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/1401042ca0544bc9954e7095fb97a92e.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/163a425b8c0c42d7835cac784d83fc14.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6716fb210>
2026-03-25 17:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72e6dca1-514e-5c68-9df0-ea28eb7e1a66/72e6dca1-514e-5c68-9df0-ea28eb7e1a66_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4ec4af2279b94327a4464165056c020d.jpg') HTTP/1.1" 204 0
2026-03-25 17:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4ec4af2279b94327a4464165056c020d.jpg saved to cache
2026-03-25 17:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 72e6dca1-514e-5c68-9df0-ea28eb7e1a66
2026-03-25 17:07:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 72e6dca1-514e-5c68-9df0-ea28eb7e1a66 sending to next pipeline
2026-03-25 17:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/efa47e816c3b4ce58f97fa0252803e84.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:07:17 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 72e6dca1-514e-5c68-9df0-ea28eb7e1a66 with identifier 202603040389792
2026-03-25 17:07:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:07:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:07:17 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 72e6dca1-514e-5c68-9df0-ea28eb7e1a66
2026-03-25 17:07:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/4ec4af2279b94327a4464165056c020d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'CALL 0161 633 3286/ 07867 314825. 399 admin fees apply where '
                '3rd party finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 123,
 'fuel_type': 'Petrol Hybrid',
 'id': '72e6dca1-514e-5c68-9df0-ea28eb7e1a66',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603040389792',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 37000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 55,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72e6dca1-514e-5c68-9df0-ea28eb7e1a66/72e6dca1-514e-5c68-9df0-ea28eb7e1a66_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256363,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/4ec4af2279b94327a4464165056c020d.jpg',
             'Width': 1280}],
 'price': 10990,
 'price_includes_vat': True,
 'registration_date': '2022-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.0T EcoBoost MHEV Titanium Hatchback 5dr Petrol Hybrid',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2022}
2026-03-25 17:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040389792%27 HTTP/1.1" 200 None
2026-03-25 17:07:17 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603040389792: {'created_time': 1774458437.560655, 'last_price_update_time': 1774458437.560663}
2026-03-25 17:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603040389792') HTTP/1.1" 204 0
2026-03-25 17:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/0c16b213c633457fa665a791623651c9.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/52de4263afa84734beb0470352a8a2d8.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66f5536d0>
2026-03-25 17:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65937b9d-0193-50df-b5f5-c4d2bc58cfe1/65937b9d-0193-50df-b5f5-c4d2bc58cfe1_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9b74dff9f07c439c850a189d6b52f352.jpg') HTTP/1.1" 204 0
2026-03-25 17:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9b74dff9f07c439c850a189d6b52f352.jpg saved to cache
2026-03-25 17:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 65937b9d-0193-50df-b5f5-c4d2bc58cfe1
2026-03-25 17:07:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 65937b9d-0193-50df-b5f5-c4d2bc58cfe1 sending to next pipeline
2026-03-25 17:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c470450>
2026-03-25 17:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a92bc479-5bbd-5b30-a151-2fb7376fb9d9/a92bc479-5bbd-5b30-a151-2fb7376fb9d9_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F28c008796bb94783b832743996e08028.jpg') HTTP/1.1" 204 0
2026-03-25 17:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/28c008796bb94783b832743996e08028.jpg saved to cache
2026-03-25 17:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a92bc479-5bbd-5b30-a151-2fb7376fb9d9
2026-03-25 17:07:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a92bc479-5bbd-5b30-a151-2fb7376fb9d9 sending to next pipeline
2026-03-25 17:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65ef3f410>
2026-03-25 17:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41afd5ad-e6fa-548f-940f-2685cbcd7072/41afd5ad-e6fa-548f-940f-2685cbcd7072_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F86c28f8e413c47d2b947839fe9854404.jpg') HTTP/1.1" 204 0
2026-03-25 17:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/86c28f8e413c47d2b947839fe9854404.jpg saved to cache
2026-03-25 17:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 41afd5ad-e6fa-548f-940f-2685cbcd7072
2026-03-25 17:07:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 41afd5ad-e6fa-548f-940f-2685cbcd7072 sending to next pipeline
2026-03-25 17:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66e1b1990>
2026-03-25 17:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2d5b7ad-5ccc-52db-9480-5e38c50395b5/a2d5b7ad-5ccc-52db-9480-5e38c50395b5_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1401042ca0544bc9954e7095fb97a92e.jpg') HTTP/1.1" 204 0
2026-03-25 17:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1401042ca0544bc9954e7095fb97a92e.jpg saved to cache
2026-03-25 17:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a2d5b7ad-5ccc-52db-9480-5e38c50395b5
2026-03-25 17:07:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a2d5b7ad-5ccc-52db-9480-5e38c50395b5 sending to next pipeline
2026-03-25 17:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c4724d0>
2026-03-25 17:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff10787c-15cb-5331-a9c0-28a674b9e2b9/ff10787c-15cb-5331-a9c0-28a674b9e2b9_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F163a425b8c0c42d7835cac784d83fc14.jpg') HTTP/1.1" 204 0
2026-03-25 17:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/163a425b8c0c42d7835cac784d83fc14.jpg saved to cache
2026-03-25 17:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff10787c-15cb-5331-a9c0-28a674b9e2b9
2026-03-25 17:07:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff10787c-15cb-5331-a9c0-28a674b9e2b9 sending to next pipeline
2026-03-25 17:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/df9bb54e73564c6996226e237929e8ee.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:07:17 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 65937b9d-0193-50df-b5f5-c4d2bc58cfe1 with identifier 202602270268861
2026-03-25 17:07:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:07:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:07:17 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 65937b9d-0193-50df-b5f5-c4d2bc58cfe1
2026-03-25 17:07:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/9b74dff9f07c439c850a189d6b52f352.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This 2023 Citroen Grand C4 SpaceTourer BlueHDi Shine is a '
                'superb example, having had only one owner since new and '
                'boasting an MOT valid until February 2027. This seven seat '
                'MPV is powered by an efficient 1.5 litre Euro 6 diesel '
                'engine, offering a remarkable 62 miles per gallon. The Shine '
                'trim level ensures a host of desirable features are included, '
                'such as Mirror Screen with Apple CarPlay and Android Auto for '
                'seamless smartphone integration, and front parking sensors to '
                "aid manoeuvrability. You'll also benefit from Blind Spot "
                'Detection for enhanced safety, and Bluetooth handsfree with '
                'media streaming and a USB socket for convenient '
                'connectivity.\n'
                '\n'
                'Experience a smoother and safer drive with the Active Cruise '
                'Control featuring a speed limiter and braking function, which '
                'adapts to traffic conditions. The low CO2 emissions highlight '
                'how this vehicle is kinder to the environment compared to '
                'many others in its class. Furthermore, its acceleration from '
                '0 to 60 miles per hour in just 10.9 seconds demonstrates a '
                'capable performance that stands out amongst similar diesel '
                'models. CALL 0161 633 3286/ 07867 314825. £399 admin fees '
                'apply where 3rd party finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 127,
 'fuel_type': 'Diesel',
 'id': '65937b9d-0193-50df-b5f5-c4d2bc58cfe1',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602270268861',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Citroen',
 'model': 'Grand C4 SpaceTourer',
 'odometer': 39000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 60,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65937b9d-0193-50df-b5f5-c4d2bc58cfe1/65937b9d-0193-50df-b5f5-c4d2bc58cfe1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 212917,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/9b74dff9f07c439c850a189d6b52f352.jpg',
             'Width': 1280}],
 'price': 16990,
 'price_includes_vat': True,
 'registration_date': '2023-01-13',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Citroen GRAND C4 SPACETOURER 1.5 BlueHDi Shine MPV 5dr Diesel',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2023}
2026-03-25 17:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602270268861%27 HTTP/1.1" 200 None
2026-03-25 17:07:17 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602270268861: {'created_time': 1774458437.964997, 'last_price_update_time': 1774458437.965007}
2026-03-25 17:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602270268861') HTTP/1.1" 204 0
2026-03-25 17:07:17 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a92bc479-5bbd-5b30-a151-2fb7376fb9d9 with identifier 202603020337447
2026-03-25 17:07:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:07:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:07:17 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a92bc479-5bbd-5b30-a151-2fb7376fb9d9
2026-03-25 17:07:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/28c008796bb94783b832743996e08028.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'This 2020 Kia Niro 4 is an electric vehicle offering an '
                'impressive maximum range of 282 miles from new, making it a '
                'practical choice for both daily commutes and longer journeys. '
                'With a substantial 68 kWh battery, this Niro provides ample '
                'power and efficiency. Charging at home using a 7kW charger '
                'will take approximately 9 hours and 35 minutes for a full '
                'charge, while rapid public charging can replenish the battery '
                "from empty to 80% in as little as 54 minutes. Inside, you'll "
                'find a host of convenient features designed to enhance your '
                'driving experience, including a wireless phone charger, '
                'heated front seats for comfort in cooler weather, and front '
                'parking sensors to aid manoeuvrability. The automatic '
                'headlight control ensures optimal visibility, and the single '
                'automatic air conditioning system maintains a pleasant cabin '
                'temperature.\n'
                '\n'
                'The 282 mile maximum range at new is a significant highlight, '
                "demonstrating the Niro's capability to cover substantial "
                'distances on a single charge, setting it apart from many '
                'other vehicles in its class. This extended range, combined '
                'with the efficient electric powertrain, means fewer stops and '
                'more time enjoying your drive. The inclusion of features like '
                'heated seats and a wireless phone charger further elevates '
                'the comfort and convenience offered by this 2020 Kia Niro 4, '
                'providing a refined and user friendly experience for all '
                'occupants. CALL 0161 633 3286/ 07867 314825. £399 admin fees '
                'apply where 3rd party finance companies are used.',
 'doors_number': 5,
 'engine_horse_power': 201,
 'fuel_type': 'Electric',
 'id': 'a92bc479-5bbd-5b30-a151-2fb7376fb9d9',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603020337447',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Kia',
 'model': 'Niro',
 'odometer': 63000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 62,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a92bc479-5bbd-5b30-a151-2fb7376fb9d9/a92bc479-5bbd-5b30-a151-2fb7376fb9d9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210317,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/28c008796bb94783b832743996e08028.jpg',
             'Width': 1280}],
 'price': 11990,
 'price_includes_vat': True,
 'registration_date': '2020-09-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Niro 64kWh 4 SUV 5dr Electric Auto (201 bhp)',
 'transmission': 'automatic',
 'trim': '4',
 'year': 2020}
2026-03-25 17:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603020337447%27 HTTP/1.1" 200 None
2026-03-25 17:07:18 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603020337447: {'created_time': 1774458438.006648, 'last_price_update_time': 1774458438.006658}
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603020337447') HTTP/1.1" 204 0
2026-03-25 17:07:18 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 41afd5ad-e6fa-548f-940f-2685cbcd7072 with identifier 202602270277170
2026-03-25 17:07:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:07:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:07:18 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 41afd5ad-e6fa-548f-940f-2685cbcd7072
2026-03-25 17:07:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/86c28f8e413c47d2b947839fe9854404.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'This 2024 Tesla Model Y offers an impressive electric driving '
                'experience with a new battery maximum range of 283 miles. As '
                'an electric vehicle, it provides a smooth and quiet ride, '
                "complemented by modern conveniences. Inside, you'll find dual "
                'zone climate control for personalised comfort, LED headlights '
                'for enhanced visibility, and automatic on headlights for '
                'convenience. The Model Y also features keyless entry and '
                'driving, along with wireless phone charging, making your '
                'journeys more seamless.\n'
                '\n'
                'The Tesla Model Y stands out with its remarkable '
                'acceleration, reaching 0 to 60 miles per hour in just 6.6 '
                'seconds, demonstrating its dynamic performance. This electric '
                'SUV also boasts a large boot space, offering ample room for '
                'luggage, shopping, or equipment, making it a practical choice '
                'for everyday use and longer trips. CALL 0161 633 3286/ 07867 '
                '314825. £399 admin fees apply where 3rd party finance '
                'companies are used.',
 'doors_number': 5,
 'engine_horse_power': 341,
 'fuel_type': 'Electric',
 'id': '41afd5ad-e6fa-548f-940f-2685cbcd7072',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602270277170',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Tesla',
 'model': 'Model Y',
 'odometer': 25000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 74,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41afd5ad-e6fa-548f-940f-2685cbcd7072/41afd5ad-e6fa-548f-940f-2685cbcd7072_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233207,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/86c28f8e413c47d2b947839fe9854404.jpg',
             'Width': 1280}],
 'price': 23990,
 'price_includes_vat': True,
 'registration_date': '2024-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Tesla Model Y SUV 5dr Electric Auto RWD (346 ps)',
 'transmission': 'automatic',
 'year': 2024}
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602270277170%27 HTTP/1.1" 200 None
2026-03-25 17:07:18 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602270277170: {'created_time': 1774458438.051232, 'last_price_update_time': 1774458438.05124}
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602270277170') HTTP/1.1" 204 0
2026-03-25 17:07:18 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a2d5b7ad-5ccc-52db-9480-5e38c50395b5 with identifier 202603020339824
2026-03-25 17:07:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:07:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:07:18 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a2d5b7ad-5ccc-52db-9480-5e38c50395b5
2026-03-25 17:07:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/1401042ca0544bc9954e7095fb97a92e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'CALL 0161 633 3286/ 07867 314825. 399 admin fees apply where '
                '3rd party finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 99,
 'fuel_type': 'Petrol',
 'id': 'a2d5b7ad-5ccc-52db-9480-5e38c50395b5',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603020339824',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 36000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 57,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2d5b7ad-5ccc-52db-9480-5e38c50395b5/a2d5b7ad-5ccc-52db-9480-5e38c50395b5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262180,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/1401042ca0544bc9954e7095fb97a92e.jpg',
             'Width': 1280}],
 'price': 13380,
 'price_includes_vat': True,
 'registration_date': '2023-09-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.0T EcoBoost ST-Line X Hatchback 5dr Petrol',
 'transmission': 'manual',
 'trim': 'ST-Line X',
 'year': 2023}
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603020339824%27 HTTP/1.1" 200 None
2026-03-25 17:07:18 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603020339824: {'created_time': 1774458438.09538, 'last_price_update_time': 1774458438.09539}
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603020339824') HTTP/1.1" 204 0
2026-03-25 17:07:18 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ff10787c-15cb-5331-a9c0-28a674b9e2b9 with identifier 202602210112727
2026-03-25 17:07:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:07:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:07:18 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ff10787c-15cb-5331-a9c0-28a674b9e2b9
2026-03-25 17:07:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/163a425b8c0c42d7835cac784d83fc14.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'This 2023 SEAT Arona TSI FR Edition offers excellent peace of '
                'mind with its MOT valid until February 2027. This stylish '
                'compact SUV is equipped with a 1.0 litre Euro 6 compliant '
                'petrol engine, ensuring efficient performance. The FR Edition '
                'trim boasts a range of desirable features, including KESSY '
                'keyless entry and go for effortless access, and full LED '
                "automatic headlights for enhanced visibility. Inside, you'll "
                'appreciate the convenience of dual zone climate control, '
                'allowing you to set individual temperatures, and rear parking '
                'sensors to assist with manoeuvring.\n'
                '\n'
                'The SEAT Arona TSI FR Edition also excels in its running '
                'costs and technology integration. With a fuel economy of 46 '
                'mpg, it offers a more economical driving experience compared '
                'to many similar vehicles. Furthermore, its low CO2 emissions '
                'contribute to its environmental credentials. For seamless '
                'connectivity, the Full Link smartphone integration supports '
                'both Android Auto and Apple CarPlay, keeping your digital '
                'life accessible on the go. CALL 0161 633 3286/ 07867 314825. '
                '£399 admin fees apply where 3rd party finance companies are '
                'used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 108,
 'fuel_type': 'Petrol',
 'id': 'ff10787c-15cb-5331-a9c0-28a674b9e2b9',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602210112727',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'SEAT',
 'model': 'Arona',
 'odometer': 39000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff10787c-15cb-5331-a9c0-28a674b9e2b9/ff10787c-15cb-5331-a9c0-28a674b9e2b9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252470,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/163a425b8c0c42d7835cac784d83fc14.jpg',
             'Width': 1280}],
 'price': 13780,
 'price_includes_vat': True,
 'registration_date': '2023-01-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT Arona 1.0 TSI FR Edition SUV 5dr Petrol DSG',
 'transmission': 'automatic',
 'trim': 'FR Edition',
 'year': 2023}
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602210112727%27 HTTP/1.1" 200 None
2026-03-25 17:07:18 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602210112727: {'created_time': 1774458438.167002, 'last_price_update_time': 1774458438.167014}
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602210112727') HTTP/1.1" 204 0
2026-03-25 17:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c544f10>
2026-03-25 17:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8cf9767-e8bb-5b79-97a3-ecaf18c97377/d8cf9767-e8bb-5b79-97a3-ecaf18c97377_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fefa47e816c3b4ce58f97fa0252803e84.jpg') HTTP/1.1" 204 0
2026-03-25 17:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/efa47e816c3b4ce58f97fa0252803e84.jpg saved to cache
2026-03-25 17:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d8cf9767-e8bb-5b79-97a3-ecaf18c97377
2026-03-25 17:07:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d8cf9767-e8bb-5b79-97a3-ecaf18c97377 sending to next pipeline
2026-03-25 17:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66e147410>
2026-03-25 17:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2650607-cee5-5878-9afe-cf619148e915/f2650607-cee5-5878-9afe-cf619148e915_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0c16b213c633457fa665a791623651c9.jpg') HTTP/1.1" 204 0
2026-03-25 17:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0c16b213c633457fa665a791623651c9.jpg saved to cache
2026-03-25 17:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f2650607-cee5-5878-9afe-cf619148e915
2026-03-25 17:07:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f2650607-cee5-5878-9afe-cf619148e915 sending to next pipeline
2026-03-25 17:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c3ea2d0>
2026-03-25 17:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0797d17-4b6f-5e43-950f-6a6eef114fad/d0797d17-4b6f-5e43-950f-6a6eef114fad_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F52de4263afa84734beb0470352a8a2d8.jpg') HTTP/1.1" 204 0
2026-03-25 17:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/52de4263afa84734beb0470352a8a2d8.jpg saved to cache
2026-03-25 17:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d0797d17-4b6f-5e43-950f-6a6eef114fad
2026-03-25 17:07:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d0797d17-4b6f-5e43-950f-6a6eef114fad sending to next pipeline
2026-03-25 17:07:18 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d8cf9767-e8bb-5b79-97a3-ecaf18c97377 with identifier 202602210109681
2026-03-25 17:07:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:07:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:07:18 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d8cf9767-e8bb-5b79-97a3-ecaf18c97377
2026-03-25 17:07:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/efa47e816c3b4ce58f97fa0252803e84.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'This 2022 Volkswagen Polo Life EVO is presented with a clear '
                'vehicle history check and an MOT valid until September 2026, '
                'offering peace of mind. This stylish hatchback is equipped '
                'with a 1.0 litre Euro 6 petrol engine, ensuring it meets '
                "modern emission standards. Inside, you'll find a manually "
                'controlled air conditioning system for your comfort, '
                'alongside a Bluetooth mobile phone interface and the Ready 2 '
                'Discover infotainment system, keeping you connected and '
                'entertained. The Light and Sight Pack, including automatic '
                'headlights and LED headlights, enhances visibility and '
                'convenience.\n'
                '\n'
                'The Volkswagen Polo Life EVO stands out with its impressive '
                'fuel economy of 54 miles per gallon, demonstrating its '
                'efficiency compared to other vehicles. Its low CO2 emissions '
                'are also a key benefit, contributing to a lower environmental '
                'impact. Furthermore, this model boasts a low insurance group, '
                'making it an economical choice for many drivers. The generous '
                'boot space provides ample room for shopping or luggage, '
                'making it a practical and versatile option for everyday use. '
                'CALL 0161 633 3286/ 07867 314825. £399 admin fees apply where '
                '3rd party finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 79,
 'fuel_type': 'Petrol',
 'id': 'd8cf9767-e8bb-5b79-97a3-ecaf18c97377',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602210109681',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 29000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 52,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8cf9767-e8bb-5b79-97a3-ecaf18c97377/d8cf9767-e8bb-5b79-97a3-ecaf18c97377_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249267,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/efa47e816c3b4ce58f97fa0252803e84.jpg',
             'Width': 1280}],
 'price': 13890,
 'price_includes_vat': True,
 'registration_date': '2022-09-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 EVO Life Hatchback 5dr Petrol',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2022}
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602210109681%27 HTTP/1.1" 200 None
2026-03-25 17:07:18 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602210109681: {'created_time': 1774458438.364517, 'last_price_update_time': 1774458438.364525}
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602210109681') HTTP/1.1" 204 0
2026-03-25 17:07:18 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: f2650607-cee5-5878-9afe-cf619148e915 with identifier 202602270269018
2026-03-25 17:07:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:07:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:07:18 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item f2650607-cee5-5878-9afe-cf619148e915
2026-03-25 17:07:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/0c16b213c633457fa665a791623651c9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'This 2023 Mazda MX-30 Prime Line presents an exceptional '
                'opportunity with its remarkably low mileage of just 11,000 '
                'miles for its age. As an electric vehicle, this Prime Line '
                'model offers a smooth and quiet driving experience, powered '
                'by a 36 kWh battery that provides a maximum range of 124 '
                'miles when new. Recharging is convenient, with a full charge '
                'at home using a 7kW charger taking approximately 4 hours, and '
                'rapid charging to 80% achievable in just 33 minutes at a '
                'public charging station.\n'
                '\n'
                'The Mazda MX-30 Prime Line is equipped with a range of '
                'thoughtful features designed to enhance your journey. Parking '
                'is made easier with front and rear parking sensors that '
                'provide both audible and visual warnings, complemented by '
                'parking assistance systems. For added safety, it includes '
                'Emergency Lane Keeping with Blind Spot Assist, ensuring '
                'greater awareness of your surroundings. The vehicle also '
                'boasts LED headlights with automatic levelling for optimal '
                'visibility, integrated Bluetooth for seamless connectivity, '
                'and climate control air conditioning to ensure a comfortable '
                'cabin temperature in all conditions. CALL 0161 633 3286/ '
                '07867 314825. £399 admin fees apply where 3rd party finance '
                'companies are used.',
 'doors_number': 5,
 'engine_horse_power': 143,
 'fuel_type': 'Electric',
 'id': 'f2650607-cee5-5878-9afe-cf619148e915',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602270269018',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Mazda',
 'model': 'MX-30',
 'odometer': 11000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 47,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2650607-cee5-5878-9afe-cf619148e915/f2650607-cee5-5878-9afe-cf619148e915_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208941,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/0c16b213c633457fa665a791623651c9.jpg',
             'Width': 1280}],
 'price': 10990,
 'price_includes_vat': True,
 'registration_date': '2023-12-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda MX-30 35.5kWh Prime-Line SUV 5dr Electric Auto (145 ps)',
 'transmission': 'automatic',
 'trim': 'Prime-Line',
 'year': 2023}
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602270269018%27 HTTP/1.1" 200 None
2026-03-25 17:07:18 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602270269018: {'created_time': 1774458438.405978, 'last_price_update_time': 1774458438.405987}
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602270269018') HTTP/1.1" 204 0
2026-03-25 17:07:18 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d0797d17-4b6f-5e43-950f-6a6eef114fad with identifier 202602200091319
2026-03-25 17:07:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:07:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:07:18 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d0797d17-4b6f-5e43-950f-6a6eef114fad
2026-03-25 17:07:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/52de4263afa84734beb0470352a8a2d8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This 2022 Audi Q2 TFSI Sport boasts exceptionally low mileage '
                'for its age, having covered just 23,000 miles. This Euro 6 '
                'compliant 1.0 litre petrol model comes in the Sport trim, '
                'offering a refined driving experience. Its MOT is valid until '
                'December 2026, providing peace of mind. Key features include '
                'LED headlights for enhanced visibility, a Bluetooth interface '
                'for seamless audio streaming and calls, and the Audi '
                'Smartphone Interface which supports both Android Auto and '
                'Apple CarPlay, keeping you connected on the go. For added '
                'convenience, it is equipped with rear parking sensors to '
                'assist with manoeuvring.\n'
                '\n'
                'The Audi Q2 TFSI Sport delivers impressive fuel economy, '
                'achieving up to 49 miles per gallon, which is a notable '
                'highlight indicating its efficiency compared to similar '
                'vehicles. Its low CO2 emissions further contribute to its '
                'economical running costs. The manual air conditioning ensures '
                'a comfortable cabin temperature in all conditions. This '
                'combination of advanced technology, practical features, and '
                'excellent efficiency makes this Audi Q2 a compelling choice. '
                'CALL 0161 633 3286/ 07867 314825. £399 admin fees apply where '
                '3rd party finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 108,
 'fuel_type': 'Petrol',
 'id': 'd0797d17-4b6f-5e43-950f-6a6eef114fad',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602200091319',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 23000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 58,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0797d17-4b6f-5e43-950f-6a6eef114fad/d0797d17-4b6f-5e43-950f-6a6eef114fad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 206560,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/52de4263afa84734beb0470352a8a2d8.jpg',
             'Width': 1280}],
 'price': 16890,
 'price_includes_vat': True,
 'registration_date': '2022-01-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q2 1.0 TFSI 30 Sport SUV 5dr Petrol',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2022}
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602200091319%27 HTTP/1.1" 200 None
2026-03-25 17:07:18 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602200091319: {'created_time': 1774458438.451755, 'last_price_update_time': 1774458438.451765}
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602200091319') HTTP/1.1" 204 0
2026-03-25 17:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66c1e8f10>
2026-03-25 17:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21b5a84c-dfb2-5b14-99bf-f9eec6214f05/21b5a84c-dfb2-5b14-99bf-f9eec6214f05_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdf9bb54e73564c6996226e237929e8ee.jpg') HTTP/1.1" 204 0
2026-03-25 17:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/df9bb54e73564c6996226e237929e8ee.jpg saved to cache
2026-03-25 17:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 21b5a84c-dfb2-5b14-99bf-f9eec6214f05
2026-03-25 17:07:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 21b5a84c-dfb2-5b14-99bf-f9eec6214f05 sending to next pipeline
2026-03-25 17:07:18 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 21b5a84c-dfb2-5b14-99bf-f9eec6214f05 with identifier 202602240165917
2026-03-25 17:07:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:07:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:07:18 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 21b5a84c-dfb2-5b14-99bf-f9eec6214f05
2026-03-25 17:07:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/df9bb54e73564c6996226e237929e8ee.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 30,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2021 Peugeot 3008 GT offers exceptional peace of mind '
                'with its MOT valid all the way until December 2026. This '
                'striking example of the popular 3008 model is presented in GT '
                'trim and features a powerful yet efficient 1.6 litre petrol '
                'plug-in hybrid engine paired with a capable four wheel drive '
                'drivetrain. As a Euro 6 compliant vehicle, it meets modern '
                'emissions standards.\n'
                '\n'
                'The GT trim level brings a host of desirable features '
                "designed to enhance your driving experience. You'll "
                'appreciate the convenience of electric door mirrors, complete '
                'with blind spot detection indicators and an auto dipping '
                'function for reverse gear, which also includes blind spot '
                'assistance. Illumination is expertly handled by full LED '
                'headlights, featuring static cornering lighting and daytime '
                'running light extension. Parking is made simpler with a 180 '
                'degree colour reversing camera that includes a wash system. '
                'Inside, enjoy the sophisticated touch of blue ambient '
                'lighting to the head up instrument panel, and stay connected '
                'with the integrated Bluetooth telephone facility. This '
                'Peugeot 3008 GT stands out with its impressive 0-60mph '
                'acceleration time of just 6.1 seconds, demonstrating a '
                'performance advantage over many comparable vehicles. CALL '
                '0161 633 3286/ 07867 314825. £399 admin fees apply where 3rd '
                'party finance companies are used.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.6L',
 'engine_horse_power': 296,
 'fuel_type': 'Petrol Plug-in Hybrid',
 'id': '21b5a84c-dfb2-5b14-99bf-f9eec6214f05',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602240165917',
 'listing': 'directbuy',
 'location': 'Oldham, Lancashire',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 48000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 55,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21b5a84c-dfb2-5b14-99bf-f9eec6214f05/21b5a84c-dfb2-5b14-99bf-f9eec6214f05_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262905,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/df9bb54e73564c6996226e237929e8ee.jpg',
             'Width': 1280}],
 'price': 15780,
 'price_includes_vat': True,
 'registration_date': '2021-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 13.2kWh GT SUV 5dr Petrol Plug-in Hybrid e-EAT 4WD '
          'Euro 6 (s/s) (300 ps)',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2021}
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602240165917%27 HTTP/1.1" 200 None
2026-03-25 17:07:18 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602240165917: {'created_time': 1774458438.615262, 'last_price_update_time': 1774458438.615274}
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602240165917') HTTP/1.1" 204 0
2026-03-25 17:07:18 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-25 17:07:18 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close cursor: 'SaveToCdlqDbAutoSelling' object has no attribute 'cursor'
2026-03-25 17:07:18 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close connection: 'SaveToCdlqDbAutoSelling' object has no attribute 'conn'
2026-03-25 17:07:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:07:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:07:18 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process scrape complete CloudEvent for item f757bf82286c11f18f76c264925fbcfa
2026-03-25 17:07:18 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-25 17:07:18 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-25 17:07:18 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-25 17:07:18 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-25 17:07:18 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-25 17:07:18 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.MAPPED: 3> -> <SessionState.END_SENT: 4>
2026-03-25 17:07:18 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPENED: 9> -> <ConnectionState.CLOSE_SENT: 11>
2026-03-25 17:07:18 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.CLOSE_SENT: 11> -> <ConnectionState.END: 13>
2026-03-25 17:07:18 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.END_SENT: 4> -> <SessionState.DISCARDING: 6>
2026-03-25 17:07:18 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-25 17:07:18 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-25 17:07:18 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-25 17:07:18 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-25 17:07:18 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-25 17:07:18 [azure.servicebus._pyamqp._transport] DEBUG: Transport endpoint is already disconnected: OSError(107, 'Transport endpoint is not connected')
2026-03-25 17:07:19 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: [AzureBusPipeline] connection closed
2026-03-25 17:07:19 [auto_selling_autotrader.co.uk] INFO: auto_selling_autotrader.co.uk Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2026-03-25 17:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20last_price_update_time%20lt%201773162439 HTTP/1.1" 200 None
2026-03-25 17:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601199251909') HTTP/1.1" 204 0
2026-03-25 17:07:19 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (58 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto_selling_autotrader.co.uk/f757bf82286c11f18f76c264925fbcfa.jl
2026-03-25 17:07:19 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 464619,
 'downloader/request_count': 67,
 'downloader/request_method_count/GET': 58,
 'downloader/request_method_count/POST': 9,
 'downloader/response_bytes': 16497944,
 'downloader/response_count': 67,
 'downloader/response_status_count/200': 67,
 'elapsed_time_seconds': 44.73514,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 25, 17, 7, 19, 851710, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 58,
 'log_count/DEBUG': 1034,
 'log_count/INFO': 886,
 'memusage/max': 147116032,
 'memusage/startup': 147116032,
 'photo_download_count': 58,
 'request_depth_max': 4,
 'response_received_count': 9,
 'scheduler/dequeued': 67,
 'scheduler/dequeued/memory': 67,
 'scheduler/enqueued': 67,
 'scheduler/enqueued/memory': 67,
 'scrape_type/new': 58,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 9,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 5.358011164236814,
 'scrapy-zyte-api/mean_response_seconds': 5.582285523932013,
 'scrapy-zyte-api/processed': 9,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 9,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 8,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 9,
 'scrapy-zyte-api/request_args/httpRequestBody': 9,
 'scrapy-zyte-api/request_args/httpRequestMethod': 9,
 'scrapy-zyte-api/request_args/httpResponseBody': 9,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 9,
 'scrapy-zyte-api/request_args/url': 9,
 'scrapy-zyte-api/status_codes/200': 9,
 'scrapy-zyte-api/success': 9,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2026, 3, 25, 17, 6, 35, 116570, tzinfo=datetime.timezone.utc)}
2026-03-25 17:07:19 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-25 17:07:20 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fa66f973950>
2026-03-25 17:07:20 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fa66f980210>