2026-03-26 11:54:34 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-26 11:54:34 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-26 11:54:34 [auto_selling_autotrader.co.uk] INFO: Starting auto_selling_autotrader.co.uk spider
2026-03-26 11:54:34 [auto_selling_autotrader.co.uk] INFO: Quick mode enabled: batching detail requests in groups of 10
2026-03-26 11:54:34 [auto_selling_autotrader.co.uk] INFO: Limiting photo downloads to 1 per item
2026-03-26 11:54:34 [auto_selling_autotrader.co.uk] INFO: _job: 8c3c21fe290a11f18f76c264925fbcfa, SCRAPY_JOB: None
2026-03-26 11:54:34 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-26 11:54:34 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-26 11:54:34 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-26 11:54:34 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-26 11:54:34 [scrapy.extensions.telnet] INFO: Telnet Password: bd33d6a606ff371b
2026-03-26 11:54:34 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-26 11:54:34 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 3600,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto_selling_autotrader.co.uk/8c3c21fe290a11f18f76c264925fbcfa.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-26 11:54:34 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-26 11:54:34 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-26 11:54:34 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-26 11:54:34 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware for auto_selling
2026-03-26 11:54:34 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.auto_selling.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-26 11:54:34 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.post_to_azurebus_auto_selling.AzureBusPipelineAutoSelling',
 'crawlers.pipelines.save_to_cdlq_db_auto_selling.SaveToCdlqDbAutoSelling']
2026-03-26 11:54:34 [scrapy.core.engine] INFO: Spider opened
2026-03-26 11:54:34 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-26 11:54:34 [common.service_bus.service_bus_client_factory] INFO: ServiceBusClient initialized via DefaultAzureCredential for alx-production-bus.servicebus.windows.net
2026-03-26 11:54:34 [crawlers.pipelines.base_azure_bus_pipeline] INFO: [AzureBusPipeline] Connected to topic auto.sourcing-v2-quickmode
2026-03-26 11:54:34 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-26 11:54:34 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-26 11:54:34 [scrapy.extensions.memusage] INFO: Peak memory usage is 140MiB
2026-03-26 11:54:34 [scrapy-playwright] INFO: Starting download handler
2026-03-26 11:54:34 [scrapy-playwright] INFO: Starting download handler
2026-03-26 11:54:39 [auto_selling_autotrader.co.uk] INFO: Scraper started with retailer ID: 10003406 and multipost_profile_id: a1205316-f1d8-4671-9ba0-1139b8286046 and job_id: 8c3c21fe290a11f18f76c264925fbcfa and url: https://www.autotrader.co.uk/dealers/phoenix-way-car-dealership-ltd-10003406
2026-03-26 11:54:39 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 10003406, page: 1
2026-03-26 11:54:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: None) ['zyte-api']
2026-03-26 11:54:41 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-26 11:54:41 [auto_selling_autotrader.co.uk] INFO: Page: 1/3, total results: 48
2026-03-26 11:54:41 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-26 11:54:41 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603261023882%27 HTTP/1.1" 200 None
2026-03-26 11:54:41 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603261023882: 1
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603250995885%27 HTTP/1.1" 200 None
2026-03-26 11:54:41 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603250995885: 1
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603210889939%27 HTTP/1.1" 200 None
2026-03-26 11:54:41 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603210889939: 1
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603190833181%27 HTTP/1.1" 200 None
2026-03-26 11:54:41 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603190833181: 1
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603180804854%27 HTTP/1.1" 200 None
2026-03-26 11:54:41 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603180804854: 1
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603170764580%27 HTTP/1.1" 200 None
2026-03-26 11:54:41 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603170764580: 1
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603160739965%27 HTTP/1.1" 200 None
2026-03-26 11:54:41 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603160739965: 1
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603160735798%27 HTTP/1.1" 200 None
2026-03-26 11:54:41 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603160735798: 1
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110597597%27 HTTP/1.1" 200 None
2026-03-26 11:54:41 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603110597597: 1
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110597296%27 HTTP/1.1" 200 None
2026-03-26 11:54:41 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603110597296: 1
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603100577484%27 HTTP/1.1" 200 None
2026-03-26 11:54:41 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603100577484: 1
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603100569572%27 HTTP/1.1" 200 None
2026-03-26 11:54:41 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603100569572: 1
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603100569374%27 HTTP/1.1" 200 None
2026-03-26 11:54:41 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603100569374: 1
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603080513797%27 HTTP/1.1" 200 None
2026-03-26 11:54:41 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603080513797: 1
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603060464883%27 HTTP/1.1" 200 None
2026-03-26 11:54:41 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603060464883: 1
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040392968%27 HTTP/1.1" 200 None
2026-03-26 11:54:41 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603040392968: 1
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603010308243%27 HTTP/1.1" 200 None
2026-03-26 11:54:41 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603010308243: 1
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602270265589%27 HTTP/1.1" 200 None
2026-03-26 11:54:41 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602270265589: 1
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602270264810%27 HTTP/1.1" 200 None
2026-03-26 11:54:41 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602270264810: 1
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602250205097%27 HTTP/1.1" 200 None
2026-03-26 11:54:41 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602250205097: 1
2026-03-26 11:54:41 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-26 11:54:41 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-26 11:54:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:54:41 [auto_selling_autotrader.co.uk] INFO: Getting next page: 2
2026-03-26 11:54:41 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 10003406, page: 2
2026-03-26 11:54:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:54:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:54:42 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-26 11:54:42 [auto_selling_autotrader.co.uk] INFO: Page: 2/3, total results: 48
2026-03-26 11:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602200086914%27 HTTP/1.1" 200 None
2026-03-26 11:54:42 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602200086914: 1
2026-03-26 11:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602200084458%27 HTTP/1.1" 200 None
2026-03-26 11:54:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602200084458: 1
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602119844624%27 HTTP/1.1" 200 None
2026-03-26 11:54:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602119844624: 1
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602119844476%27 HTTP/1.1" 200 None
2026-03-26 11:54:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602119844476: 1
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602109811125%27 HTTP/1.1" 200 None
2026-03-26 11:54:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602109811125: 1
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602039644497%27 HTTP/1.1" 200 None
2026-03-26 11:54:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602039644497: 1
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601319571902%27 HTTP/1.1" 200 None
2026-03-26 11:54:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601319571902: 1
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601309559753%27 HTTP/1.1" 200 None
2026-03-26 11:54:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601309559753: 1
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601299517146%27 HTTP/1.1" 200 None
2026-03-26 11:54:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601299517146: 1
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601299516923%27 HTTP/1.1" 200 None
2026-03-26 11:54:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601299516923: 1
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601289488731%27 HTTP/1.1" 200 None
2026-03-26 11:54:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601289488731: 1
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601289480879%27 HTTP/1.1" 200 None
2026-03-26 11:54:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601289480879: 1
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601289480728%27 HTTP/1.1" 200 None
2026-03-26 11:54:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601289480728: 1
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601249394730%27 HTTP/1.1" 200 None
2026-03-26 11:54:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601249394730: 1
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601219310748%27 HTTP/1.1" 200 None
2026-03-26 11:54:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601219310748: 1
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601159177369%27 HTTP/1.1" 200 None
2026-03-26 11:54:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601159177369: 1
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149151006%27 HTTP/1.1" 200 None
2026-03-26 11:54:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601149151006: 1
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512108514159%27 HTTP/1.1" 200 None
2026-03-26 11:54:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512108514159: 1
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512058406853%27 HTTP/1.1" 200 None
2026-03-26 11:54:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512058406853: 1
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512038317605%27 HTTP/1.1" 200 None
2026-03-26 11:54:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512038317605: 1
2026-03-26 11:54:43 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-26 11:54:43 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-26 11:54:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:54:43 [auto_selling_autotrader.co.uk] INFO: Getting next page: 3
2026-03-26 11:54:43 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 10003406, page: 3
2026-03-26 11:54:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:54:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:54:43 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:43 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e2308073-69a3-5854-b9a9-e93905534f1b with identifier: 202603261023882
2026-03-26 11:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e2308073-69a3-5854-b9a9-e93905534f1b
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F186fb261b2c84be68b19d656b818a382.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/186fb261b2c84be68b19d656b818a382.jpg not downloaded yet
2026-03-26 11:54:43 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:43 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 58e210e6-64b1-576c-b44c-9a928b1e1c2c with identifier: 202603250995885
2026-03-26 11:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 58e210e6-64b1-576c-b44c-9a928b1e1c2c
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1f69f5bf5dfa477b911fa36177bb5af5.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1f69f5bf5dfa477b911fa36177bb5af5.jpg not downloaded yet
2026-03-26 11:54:43 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:43 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 0865cadf-b3be-5d7b-8b17-1035af75620d with identifier: 202603210889939
2026-03-26 11:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0865cadf-b3be-5d7b-8b17-1035af75620d
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0f3f80fea6f645ffbbfc559b26957bcf.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0f3f80fea6f645ffbbfc559b26957bcf.jpg not downloaded yet
2026-03-26 11:54:43 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:43 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 0864bfd2-f3a8-5173-829f-f0fcc4aa8dfc with identifier: 202603190833181
2026-03-26 11:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0864bfd2-f3a8-5173-829f-f0fcc4aa8dfc
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9283194fc0334badbacb4f037b4a08db.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9283194fc0334badbacb4f037b4a08db.jpg not downloaded yet
2026-03-26 11:54:43 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:43 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a1ae517-1e15-52df-b97b-a7e21b2eba1d with identifier: 202603180804854
2026-03-26 11:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4a1ae517-1e15-52df-b97b-a7e21b2eba1d
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3a60e3336b784a22a1f959a5e3b9d027.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3a60e3336b784a22a1f959a5e3b9d027.jpg not downloaded yet
2026-03-26 11:54:43 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:43 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e311c36-2483-5449-98bd-cd55fb68ece2 with identifier: 202603170764580
2026-03-26 11:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4e311c36-2483-5449-98bd-cd55fb68ece2
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5ebe0d584b6a4990bb2b1c312e04db87.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5ebe0d584b6a4990bb2b1c312e04db87.jpg not downloaded yet
2026-03-26 11:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:54:43 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:43 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 75c686e6-95b1-5769-950c-c51a3691c7fa with identifier: 202603160739965
2026-03-26 11:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 75c686e6-95b1-5769-950c-c51a3691c7fa
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1f69f5bf5dfa477b911fa36177bb5af5.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1f69f5bf5dfa477b911fa36177bb5af5.jpg not downloaded yet
2026-03-26 11:54:43 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:43 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ef5e51e-d19b-53c1-b1c4-bad60eda3904 with identifier: 202603160735798
2026-03-26 11:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1ef5e51e-d19b-53c1-b1c4-bad60eda3904
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fab3b3257d2bd4532ba42d13445fcaf03.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ab3b3257d2bd4532ba42d13445fcaf03.jpg not downloaded yet
2026-03-26 11:54:43 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:43 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bbe9438-c917-59d3-a3ae-775e800c26b8 with identifier: 202603110597597
2026-03-26 11:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2bbe9438-c917-59d3-a3ae-775e800c26b8
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa91faf4dcbdf4211ade3dd41135eedc6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a91faf4dcbdf4211ade3dd41135eedc6.jpg not downloaded yet
2026-03-26 11:54:43 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:43 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 771685ab-0e64-5c62-9d19-08ddebf55e86 with identifier: 202603110597296
2026-03-26 11:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 771685ab-0e64-5c62-9d19-08ddebf55e86
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F296f1233d9d1402596b2903daf19263e.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/296f1233d9d1402596b2903daf19263e.jpg not downloaded yet
2026-03-26 11:54:43 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:43 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d29afe1b-2159-59e3-8bab-ccf69dbf7215 with identifier: 202603100577484
2026-03-26 11:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d29afe1b-2159-59e3-8bab-ccf69dbf7215
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9d983b31a724495293ec633a452eceb0.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9d983b31a724495293ec633a452eceb0.jpg not downloaded yet
2026-03-26 11:54:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 56c1f992-2c85-5030-b10a-cb78e8b401b5 with identifier: 202603100569572
2026-03-26 11:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 56c1f992-2c85-5030-b10a-cb78e8b401b5
2026-03-26 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F497e898ff7504fb184b452b2e593f311.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/497e898ff7504fb184b452b2e593f311.jpg not downloaded yet
2026-03-26 11:54:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c7a7eda1-3b44-5a81-b00b-19178bcc7936 with identifier: 202603100569374
2026-03-26 11:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c7a7eda1-3b44-5a81-b00b-19178bcc7936
2026-03-26 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fba93b20b0f1d4ff4abb6680a94fea3d3.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ba93b20b0f1d4ff4abb6680a94fea3d3.jpg not downloaded yet
2026-03-26 11:54:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b4ee2dcd-a113-5888-9684-05de12149f86 with identifier: 202603080513797
2026-03-26 11:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b4ee2dcd-a113-5888-9684-05de12149f86
2026-03-26 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc3e9a0485fe6452f8ca9875640c6d518.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c3e9a0485fe6452f8ca9875640c6d518.jpg not downloaded yet
2026-03-26 11:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/186fb261b2c84be68b19d656b818a382.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c74fdc86-c137-57ad-8a1b-cb23a36477c0 with identifier: 202603060464883
2026-03-26 11:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c74fdc86-c137-57ad-8a1b-cb23a36477c0
2026-03-26 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Faef1fe3d3d934cee84e7a309e24cb50a.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/aef1fe3d3d934cee84e7a309e24cb50a.jpg not downloaded yet
2026-03-26 11:54:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ffde341c-61f4-572d-bb3c-bb5770d90a68 with identifier: 202603040392968
2026-03-26 11:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ffde341c-61f4-572d-bb3c-bb5770d90a68
2026-03-26 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4f24881397074469a75e3048f7401ca9.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4f24881397074469a75e3048f7401ca9.jpg not downloaded yet
2026-03-26 11:54:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 79a676e2-8178-5215-83c1-020f676d01c0 with identifier: 202603010308243
2026-03-26 11:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 79a676e2-8178-5215-83c1-020f676d01c0
2026-03-26 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F456b4982f1834dc9b19c46bb9dae575a.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/456b4982f1834dc9b19c46bb9dae575a.jpg not downloaded yet
2026-03-26 11:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/9283194fc0334badbacb4f037b4a08db.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a508d186-acf7-5eeb-b652-bf9c6ef4a69b with identifier: 202602270265589
2026-03-26 11:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a508d186-acf7-5eeb-b652-bf9c6ef4a69b
2026-03-26 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9b5d576f6ba2420181fa4117c2128858.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9b5d576f6ba2420181fa4117c2128858.jpg not downloaded yet
2026-03-26 11:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/1f69f5bf5dfa477b911fa36177bb5af5.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d1552da9-74ca-5a70-b7de-693271ede6a2 with identifier: 202602270264810
2026-03-26 11:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d1552da9-74ca-5a70-b7de-693271ede6a2
2026-03-26 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F586a505276e64778ba46fb8d94f63731.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/586a505276e64778ba46fb8d94f63731.jpg not downloaded yet
2026-03-26 11:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/3a60e3336b784a22a1f959a5e3b9d027.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e8dcdf31-a53d-5650-9afa-8f22589138c6 with identifier: 202602250205097
2026-03-26 11:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e8dcdf31-a53d-5650-9afa-8f22589138c6
2026-03-26 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe490e62afcf845bf8926f906d9c73ce1.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e490e62afcf845bf8926f906d9c73ce1.jpg not downloaded yet
2026-03-26 11:54:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-26 11:54:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-26 11:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879de77a50>
2026-03-26 11:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-26 11:54:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-26 11:54:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-26 11:54:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2308073-69a3-5854-b9a9-e93905534f1b/e2308073-69a3-5854-b9a9-e93905534f1b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F186fb261b2c84be68b19d656b818a382.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/186fb261b2c84be68b19d656b818a382.jpg saved to cache
2026-03-26 11:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e2308073-69a3-5854-b9a9-e93905534f1b
2026-03-26 11:54:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e2308073-69a3-5854-b9a9-e93905534f1b sending to next pipeline
2026-03-26 11:54:44 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e2308073-69a3-5854-b9a9-e93905534f1b with identifier 202603261023882
2026-03-26 11:54:44 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: None -> <ConnectionState.START: 0>
2026-03-26 11:54:44 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.START: 0> -> <ConnectionState.HDR_SENT: 2>
2026-03-26 11:54:44 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.HDR_SENT: 2>
2026-03-26 11:54:44 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.OPEN_PIPE: 4>
2026-03-26 11:54:44 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.UNMAPPED: 0> -> <SessionState.BEGIN_SENT: 1>
2026-03-26 11:54:44 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-26 11:54:44 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-26 11:54:44 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-26 11:54:44 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-26 11:54:44 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_PIPE: 4> -> <ConnectionState.OPEN_SENT: 7>
2026-03-26 11:54:44 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_SENT: 7> -> <ConnectionState.OPENED: 9>
2026-03-26 11:54:44 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.BEGIN_SENT: 1> -> <SessionState.MAPPED: 3>
2026-03-26 11:54:44 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-26 11:54:44 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-26 11:54:44 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-26 11:54:44 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-26 11:54:44 [azure.servicebus._pyamqp.cbs] DEBUG: CBS completed opening with status: <ManagementOpenResult.OK: 1>
2026-03-26 11:54:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-26 11:54:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2018
2026-03-26 11:54:45 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-26 11:54:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774526085
2026-03-26 11:54:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774526085
2026-03-26 11:54:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS Put token result (<ManagementExecuteOperationResult.OK: 0>), status code: 202, status_description: b'Accepted'.
2026-03-26 11:54:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:45 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-26 11:54:45 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-26 11:54:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:45 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e2308073-69a3-5854-b9a9-e93905534f1b
2026-03-26 11:54:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/186fb261b2c84be68b19d656b818a382.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 75,
 'color': 'White',
 'currency': 'GBP',
 'description': '***************************APPOINTMENTS '
                'ONLY*******************This 2016 Toyota Yaris VVT-h Icon '
                'boasts exceptionally low mileage for its age, having covered '
                'just 40,000 miles, and comes with an MOT valid until February '
                '2027. This Euro 6 compliant 1.5L petrol hybrid is presented '
                'with a clear vehicle history check and includes a 3 month '
                'warranty for your peace of mind. The Icon trim level offers '
                'desirable features such as dual zone climate control for '
                'personalised comfort, Bluetooth connectivity for seamless '
                'phone integration, and a rear view reversing camera to aid '
                'with parking.\n'
                '\n'
                'The Yaris VVT-h Icon stands out with its remarkable fuel '
                'economy, achieving an impressive 86 miles per gallon, which '
                'is significantly better than many other vehicles in its '
                'class. Furthermore, its low CO2 emissions and low insurance '
                'group rating contribute to lower running costs, making it an '
                'economical choice for everyday driving.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 100,
 'fuel_type': 'Petrol Hybrid',
 'id': 'e2308073-69a3-5854-b9a9-e93905534f1b',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603261023882',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 40000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2308073-69a3-5854-b9a9-e93905534f1b/e2308073-69a3-5854-b9a9-e93905534f1b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76558,
             'Height': 576,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/186fb261b2c84be68b19d656b818a382.jpg',
             'Width': 1024}],
 'price': 10499,
 'price_includes_vat': True,
 'registration_date': '2016-03-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.5 VVT-h Icon E-CVT Euro 6 5dr',
 'transmission': 'automatic',
 'trim': 'Icon',
 'year': 2016}
2026-03-26 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603261023882%27 HTTP/1.1" 200 None
2026-03-26 11:54:45 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603261023882: {'created_time': 1774526085.271529, 'last_price_update_time': 1774526085.27154}
2026-03-26 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603261023882') HTTP/1.1" 204 0
2026-03-26 11:54:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/0f3f80fea6f645ffbbfc559b26957bcf.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:54:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/296f1233d9d1402596b2903daf19263e.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/5ebe0d584b6a4990bb2b1c312e04db87.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879e87ac90>
2026-03-26 11:54:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0864bfd2-f3a8-5173-829f-f0fcc4aa8dfc/0864bfd2-f3a8-5173-829f-f0fcc4aa8dfc_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9283194fc0334badbacb4f037b4a08db.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9283194fc0334badbacb4f037b4a08db.jpg saved to cache
2026-03-26 11:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0864bfd2-f3a8-5173-829f-f0fcc4aa8dfc
2026-03-26 11:54:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0864bfd2-f3a8-5173-829f-f0fcc4aa8dfc sending to next pipeline
2026-03-26 11:54:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879e8845d0>
2026-03-26 11:54:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58e210e6-64b1-576c-b44c-9a928b1e1c2c/58e210e6-64b1-576c-b44c-9a928b1e1c2c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1f69f5bf5dfa477b911fa36177bb5af5.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1f69f5bf5dfa477b911fa36177bb5af5.jpg saved to cache
2026-03-26 11:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 58e210e6-64b1-576c-b44c-9a928b1e1c2c
2026-03-26 11:54:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 58e210e6-64b1-576c-b44c-9a928b1e1c2c sending to next pipeline
2026-03-26 11:54:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879e8c0250>
2026-03-26 11:54:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a1ae517-1e15-52df-b97b-a7e21b2eba1d/4a1ae517-1e15-52df-b97b-a7e21b2eba1d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3a60e3336b784a22a1f959a5e3b9d027.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3a60e3336b784a22a1f959a5e3b9d027.jpg saved to cache
2026-03-26 11:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4a1ae517-1e15-52df-b97b-a7e21b2eba1d
2026-03-26 11:54:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4a1ae517-1e15-52df-b97b-a7e21b2eba1d sending to next pipeline
2026-03-26 11:54:45 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 0864bfd2-f3a8-5173-829f-f0fcc4aa8dfc with identifier 202603190833181
2026-03-26 11:54:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:45 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 0864bfd2-f3a8-5173-829f-f0fcc4aa8dfc
2026-03-26 11:54:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/9283194fc0334badbacb4f037b4a08db.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Blue',
 'currency': 'GBP',
 'description': '*******************APPOINTMENTS ONLY*****************This '
                '2022 Mazda2 SKYACTIV-G GT Sport is a superb example, having '
                'been owned by just one person from new. This particular model '
                'boasts the refined GT Sport trim and is powered by an '
                'efficient 1.5 litre petrol engine, meeting Euro 6 emissions '
                'standards. You can drive away with confidence, as it comes '
                'with a 3 month warranty and a full 12 months MOT provided on '
                'purchase, alongside a clear vehicle history check. Notable '
                'features include dusk sensing automatic headlights, a colour '
                'active driving display which acts as a head up display, and '
                'smart keyless entry for ultimate convenience. The signature '
                'LED headlights with LED daytime running lights enhance '
                'visibility, and the integrated reversing camera makes parking '
                'a breeze.\n'
                '\n'
                'With an impressive fuel economy of 52 miles per gallon, this '
                'Mazda2 offers excellent value for money, making it a more '
                'economical choice compared to similar vehicles. Its low CO2 '
                'emissions further contribute to its appeal for '
                'environmentally conscious drivers. This well maintained and '
                'feature packed Mazda2 presents a compelling option for anyone '
                'seeking a stylish and practical compact car.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 89,
 'fuel_type': 'Petrol',
 'id': '0864bfd2-f3a8-5173-829f-f0fcc4aa8dfc',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603190833181',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Mazda',
 'model': 'Mazda2',
 'odometer': 33000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0864bfd2-f3a8-5173-829f-f0fcc4aa8dfc/0864bfd2-f3a8-5173-829f-f0fcc4aa8dfc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82529,
             'Height': 576,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/9283194fc0334badbacb4f037b4a08db.jpg',
             'Width': 1024}],
 'price': 13499,
 'price_includes_vat': True,
 'registration_date': '2022-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda2 1.5 SKYACTIV-G GT Sport Auto Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'GT Sport',
 'year': 2022}
2026-03-26 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603190833181%27 HTTP/1.1" 200 None
2026-03-26 11:54:45 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603190833181: {'created_time': 1774526085.766251, 'last_price_update_time': 1774526085.766263}
2026-03-26 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603190833181') HTTP/1.1" 204 0
2026-03-26 11:54:45 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 58e210e6-64b1-576c-b44c-9a928b1e1c2c with identifier 202603250995885
2026-03-26 11:54:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:45 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 58e210e6-64b1-576c-b44c-9a928b1e1c2c
2026-03-26 11:54:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/1f69f5bf5dfa477b911fa36177bb5af5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Black',
 'currency': 'GBP',
 'description': '***********************APPOINTMENTS '
                'ONLY*********************This 2015 Vauxhall Corsa i Excite is '
                'presented with a clear vehicle history check, offering you '
                'peace of mind. This popular model features a 1.4 litre petrol '
                'engine and meets Euro 6 emissions standards. For your '
                'comfort, it includes automatic headlights, a heated steering '
                'wheel, and heated front seats, alongside air conditioning to '
                'keep you comfortable in all seasons. Stay connected on the go '
                'with Bluetooth connectivity.\n'
                '\n'
                'The Excite trim level of this Vauxhall Corsa is designed to '
                'enhance your driving experience. Its inclusion in a low '
                'insurance group makes it a cost effective choice for many '
                'drivers, indicating its affordability compared to similar '
                'vehicles. This Corsa also comes with a 3 month warranty, '
                'further demonstrating its value and reliability.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.4L',
 'engine_horse_power': 89,
 'fuel_type': 'Petrol',
 'id': '58e210e6-64b1-576c-b44c-9a928b1e1c2c',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603250995885',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Vauxhall',
 'model': 'Corsa',
 'odometer': 73000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58e210e6-64b1-576c-b44c-9a928b1e1c2c/58e210e6-64b1-576c-b44c-9a928b1e1c2c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 564613,
             'Height': 1690,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/1f69f5bf5dfa477b911fa36177bb5af5.jpg',
             'Width': 2048}],
 'price': 4499,
 'price_includes_vat': True,
 'registration_date': '2015-06-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Corsa 1.4i ecoFLEX Excite Euro 6 5dr (a/c)',
 'transmission': 'manual',
 'trim': 'Excite',
 'year': 2015}
2026-03-26 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603250995885%27 HTTP/1.1" 200 None
2026-03-26 11:54:45 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603250995885: {'created_time': 1774526085.820144, 'last_price_update_time': 1774526085.820153}
2026-03-26 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603250995885') HTTP/1.1" 204 0
2026-03-26 11:54:45 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 4a1ae517-1e15-52df-b97b-a7e21b2eba1d with identifier 202603180804854
2026-03-26 11:54:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:45 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 4a1ae517-1e15-52df-b97b-a7e21b2eba1d
2026-03-26 11:54:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/3a60e3336b784a22a1f959a5e3b9d027.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'color': 'White',
 'currency': 'GBP',
 'description': '***************************APPOINTMENTS '
                'ONLY***********************This 2018 BMW 4 Series Gran Coupe '
                '440i M Sport is a Euro 6 compliant model, offering a blend of '
                'performance and practicality. It features the M Sport trim '
                'and is powered by a 3.0 litre petrol engine. Notable features '
                'include a Head Up Display, a glass electric sunroof, and the '
                'Innovation Package which adds Bluetooth connectivity and '
                'wireless phone charging. The car also benefits from Driving '
                'Assistant and a Digital Cockpit, providing a modern and '
                'connected driving experience.\n'
                '\n'
                'This particular 440i M Sport stands out with its impressive '
                'acceleration, achieving 0-62mph in just 5.1 seconds, '
                'demonstrating its superior performance compared to similar '
                'vehicles. Furthermore, its large boot space offers excellent '
                'versatility for everyday needs and longer journeys. The '
                'vehicle also falls into a low insurance group, making it a '
                'more economical choice for many drivers.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 322,
 'fuel_type': 'Petrol',
 'id': '4a1ae517-1e15-52df-b97b-a7e21b2eba1d',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603180804854',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'BMW',
 'model': '4 Series Gran Coupe',
 'odometer': 64000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 47,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a1ae517-1e15-52df-b97b-a7e21b2eba1d/4a1ae517-1e15-52df-b97b-a7e21b2eba1d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260208,
             'Height': 1232,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/3a60e3336b784a22a1f959a5e3b9d027.jpg',
             'Width': 2048}],
 'price': 20499,
 'price_includes_vat': True,
 'registration_date': '2018-04-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 4 Series Gran Coupe 3.0 440i M Sport Auto Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-26 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603180804854%27 HTTP/1.1" 200 None
2026-03-26 11:54:45 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603180804854: {'created_time': 1774526085.868362, 'last_price_update_time': 1774526085.868383}
2026-03-26 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603180804854') HTTP/1.1" 204 0
2026-03-26 11:54:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/ab3b3257d2bd4532ba42d13445fcaf03.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/a91faf4dcbdf4211ade3dd41135eedc6.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:54:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:54:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879e82d5d0>
2026-03-26 11:54:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0865cadf-b3be-5d7b-8b17-1035af75620d/0865cadf-b3be-5d7b-8b17-1035af75620d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0f3f80fea6f645ffbbfc559b26957bcf.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0f3f80fea6f645ffbbfc559b26957bcf.jpg saved to cache
2026-03-26 11:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0865cadf-b3be-5d7b-8b17-1035af75620d
2026-03-26 11:54:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0865cadf-b3be-5d7b-8b17-1035af75620d sending to next pipeline
2026-03-26 11:54:45 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-26 11:54:45 [auto_selling_autotrader.co.uk] INFO: Page: 3/3, total results: 48
2026-03-26 11:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511268154863%27 HTTP/1.1" 200 None
2026-03-26 11:54:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511268154863: 1
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511208023779%27 HTTP/1.1" 200 None
2026-03-26 11:54:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511208023779: 1
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511057686600%27 HTTP/1.1" 200 None
2026-03-26 11:54:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511057686600: 1
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510157166316%27 HTTP/1.1" 200 None
2026-03-26 11:54:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202510157166316: 1
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510157165059%27 HTTP/1.1" 200 None
2026-03-26 11:54:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202510157165059: 1
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509106220660%27 HTTP/1.1" 200 None
2026-03-26 11:54:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202509106220660: 1
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508295858918%27 HTTP/1.1" 200 None
2026-03-26 11:54:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202508295858918: 1
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202506223760986%27 HTTP/1.1" 200 None
2026-03-26 11:54:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202506223760986: 1
2026-03-26 11:54:46 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 8 detail requests (batch 1)
2026-03-26 11:54:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879e7b9950>
2026-03-26 11:54:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_771685ab-0e64-5c62-9d19-08ddebf55e86/771685ab-0e64-5c62-9d19-08ddebf55e86_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F296f1233d9d1402596b2903daf19263e.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/296f1233d9d1402596b2903daf19263e.jpg saved to cache
2026-03-26 11:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 771685ab-0e64-5c62-9d19-08ddebf55e86
2026-03-26 11:54:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 771685ab-0e64-5c62-9d19-08ddebf55e86 sending to next pipeline
2026-03-26 11:54:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879e7f8050>
2026-03-26 11:54:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e311c36-2483-5449-98bd-cd55fb68ece2/4e311c36-2483-5449-98bd-cd55fb68ece2_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5ebe0d584b6a4990bb2b1c312e04db87.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5ebe0d584b6a4990bb2b1c312e04db87.jpg saved to cache
2026-03-26 11:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4e311c36-2483-5449-98bd-cd55fb68ece2
2026-03-26 11:54:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4e311c36-2483-5449-98bd-cd55fb68ece2 sending to next pipeline
2026-03-26 11:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/1f69f5bf5dfa477b911fa36177bb5af5.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/9d983b31a724495293ec633a452eceb0.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/497e898ff7504fb184b452b2e593f311.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:46 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 0865cadf-b3be-5d7b-8b17-1035af75620d with identifier 202603210889939
2026-03-26 11:54:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:46 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 0865cadf-b3be-5d7b-8b17-1035af75620d
2026-03-26 11:54:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/0f3f80fea6f645ffbbfc559b26957bcf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Grey',
 'currency': 'GBP',
 'description': '*****************************APPOINTMENTS '
                'ONLY*************************This 2015 Mercedes Benz CLS220 '
                'AMG Line presents a remarkable opportunity with its '
                'exceptionally low mileage of just 73,000 miles for its age. '
                'This stylish CLS220 AMG Line is powered by an efficient 2.1 '
                'litre diesel engine, meeting Euro 6 emissions standards. It '
                'boasts the desirable AMG Line trim, enhancing its sporty '
                "appeal. Inside, you'll find comfort and convenience features "
                'such as automatic two zone climate control with dust filter '
                'and air recirculation, ensuring a pleasant cabin environment. '
                'For seamless connectivity, it includes a Bluetooth interface '
                'for hands free telephone calls.\n'
                '\n'
                'The intelligent LED lighting system provides excellent '
                'visibility, with LED headlights and the advanced Intelligent '
                'Light System. Parking is made easier with front parking '
                'sensors, helping you navigate tight spaces. This CLS also '
                'offers generous boot space, making it practical for everyday '
                'use and longer journeys. The combination of its low mileage, '
                'desirable AMG Line specification, and advanced features '
                'clearly sets this Mercedes Benz CLS apart from other vehicles '
                'in its class.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2.1L',
 'engine_horse_power': 175,
 'fuel_type': 'Diesel',
 'id': '0865cadf-b3be-5d7b-8b17-1035af75620d',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603210889939',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Mercedes-Benz',
 'model': 'CLS',
 'odometer': 73000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 43,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0865cadf-b3be-5d7b-8b17-1035af75620d/0865cadf-b3be-5d7b-8b17-1035af75620d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349878,
             'Height': 1273,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/0f3f80fea6f645ffbbfc559b26957bcf.jpg',
             'Width': 2048}],
 'price': 12999,
 'price_includes_vat': True,
 'registration_date': '2015-04-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLS 2.1 CLS220 BlueTEC AMG Line Shooting Brake '
          'G-Tronic+ Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2015}
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603210889939%27 HTTP/1.1" 200 None
2026-03-26 11:54:46 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603210889939: {'created_time': 1774526086.287132, 'last_price_update_time': 1774526086.287143}
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603210889939') HTTP/1.1" 204 0
2026-03-26 11:54:46 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 771685ab-0e64-5c62-9d19-08ddebf55e86 with identifier 202603110597296
2026-03-26 11:54:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:46 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 771685ab-0e64-5c62-9d19-08ddebf55e86
2026-03-26 11:54:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/296f1233d9d1402596b2903daf19263e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Black',
 'currency': 'GBP',
 'description': '*****************************APPOINTMENTS '
                'ONLY**********************This 2023 Audi A3 TFSI S line '
                'boasts a single owner from new, offering you peace of mind. '
                'This Euro 6 compliant model features a 1.0 litre petrol '
                'engine and comes with a 3 month warranty for added security. '
                'Its vehicle history check is clear, and it will be supplied '
                'with a full 12 months MOT for your convenience.\n'
                '\n'
                'Experience the sophisticated S line trim, enhanced with '
                'striking LED headlights and dynamic rear indicators. Inside, '
                "you'll find dual zone electronic climate control to keep "
                'everyone comfortable, and the Bluetooth interface along with '
                'the Audi Smartphone Interface, including Apple CarPlay, '
                'ensures seamless connectivity. Parking is made easier with '
                "rear parking sensors, and you'll appreciate the generous boot "
                'space for all your needs. This A3 accelerates from 0 to 62mph '
                'in 10.6 seconds, demonstrating its capable performance.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 108,
 'fuel_type': 'Petrol',
 'id': '771685ab-0e64-5c62-9d19-08ddebf55e86',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603110597296',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 53000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_771685ab-0e64-5c62-9d19-08ddebf55e86/771685ab-0e64-5c62-9d19-08ddebf55e86_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89069,
             'Height': 576,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/296f1233d9d1402596b2903daf19263e.jpg',
             'Width': 1024}],
 'price': 18999,
 'price_includes_vat': True,
 'registration_date': '2023-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 1.0 TFSI 30 S line Sportback S Tronic Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2023}
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110597296%27 HTTP/1.1" 200 None
2026-03-26 11:54:46 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603110597296: {'created_time': 1774526086.33625, 'last_price_update_time': 1774526086.336261}
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603110597296') HTTP/1.1" 204 0
2026-03-26 11:54:46 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 4e311c36-2483-5449-98bd-cd55fb68ece2 with identifier 202603170764580
2026-03-26 11:54:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:46 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 4e311c36-2483-5449-98bd-cd55fb68ece2
2026-03-26 11:54:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/5ebe0d584b6a4990bb2b1c312e04db87.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Red',
 'currency': 'GBP',
 'description': '**********************APPOINTMENTS '
                'ONLY*****************************This 2017 Ford Focus Zetec '
                'Edition presents an exceptional opportunity with its MOT '
                'valid until August 2026 and a clear vehicle history check, '
                'offering peace of mind for its next owner. Powered by an '
                'efficient 1.0L Euro 6 petrol engine, this model boasts a low '
                "mileage of just 52,000 miles for its age. Inside, you'll find "
                'manual air conditioning to keep you comfortable and rear '
                'parking distance sensors to assist with manoeuvring.\n'
                '\n'
                'The Ford Focus Zetec Edition stands out with its impressive '
                'fuel economy, achieving a remarkable 61 miles per gallon, '
                'which indicates it is more economical than many similar '
                'vehicles. Furthermore, its low CO2 emissions highlight its '
                'environmental consideration. This Focus also offers generous '
                'boot space, making it a practical choice for everyday use and '
                'longer journeys, all backed by a 3 month warranty for added '
                'assurance.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 99,
 'fuel_type': 'Petrol',
 'id': '4e311c36-2483-5449-98bd-cd55fb68ece2',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603170764580',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 52000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 46,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e311c36-2483-5449-98bd-cd55fb68ece2/4e311c36-2483-5449-98bd-cd55fb68ece2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 373249,
             'Height': 1352,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/5ebe0d584b6a4990bb2b1c312e04db87.jpg',
             'Width': 2048}],
 'price': 6499,
 'price_includes_vat': True,
 'registration_date': '2017-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.0T EcoBoost Zetec Edition Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Zetec Edition',
 'year': 2017}
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603170764580%27 HTTP/1.1" 200 None
2026-03-26 11:54:46 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603170764580: {'created_time': 1774526086.385534, 'last_price_update_time': 1774526086.38555}
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603170764580') HTTP/1.1" 204 0
2026-03-26 11:54:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/c3e9a0485fe6452f8ca9875640c6d518.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/ba93b20b0f1d4ff4abb6680a94fea3d3.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/456b4982f1834dc9b19c46bb9dae575a.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879de9ead0>
2026-03-26 11:54:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ef5e51e-d19b-53c1-b1c4-bad60eda3904/1ef5e51e-d19b-53c1-b1c4-bad60eda3904_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fab3b3257d2bd4532ba42d13445fcaf03.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ab3b3257d2bd4532ba42d13445fcaf03.jpg saved to cache
2026-03-26 11:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1ef5e51e-d19b-53c1-b1c4-bad60eda3904
2026-03-26 11:54:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1ef5e51e-d19b-53c1-b1c4-bad60eda3904 sending to next pipeline
2026-03-26 11:54:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879e7aad50>
2026-03-26 11:54:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bbe9438-c917-59d3-a3ae-775e800c26b8/2bbe9438-c917-59d3-a3ae-775e800c26b8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa91faf4dcbdf4211ade3dd41135eedc6.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a91faf4dcbdf4211ade3dd41135eedc6.jpg saved to cache
2026-03-26 11:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2bbe9438-c917-59d3-a3ae-775e800c26b8
2026-03-26 11:54:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2bbe9438-c917-59d3-a3ae-775e800c26b8 sending to next pipeline
2026-03-26 11:54:46 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:46 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: cfbee9d7-efee-55b0-8b01-2a111188b8e2 with identifier: 202601289488731
2026-03-26 11:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cfbee9d7-efee-55b0-8b01-2a111188b8e2
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6e036f127f284f21b2414d3426689147.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6e036f127f284f21b2414d3426689147.jpg not downloaded yet
2026-03-26 11:54:46 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:46 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: bcdcad5c-6747-535d-9e4a-4f9f233aa509 with identifier: 202602200086914
2026-03-26 11:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bcdcad5c-6747-535d-9e4a-4f9f233aa509
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5217d1e22b5b4717ab57e445c25aedfa.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5217d1e22b5b4717ab57e445c25aedfa.jpg not downloaded yet
2026-03-26 11:54:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879e7d46d0>
2026-03-26 11:54:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75c686e6-95b1-5769-950c-c51a3691c7fa/75c686e6-95b1-5769-950c-c51a3691c7fa_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1f69f5bf5dfa477b911fa36177bb5af5.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1f69f5bf5dfa477b911fa36177bb5af5.jpg saved to cache
2026-03-26 11:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 75c686e6-95b1-5769-950c-c51a3691c7fa
2026-03-26 11:54:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 75c686e6-95b1-5769-950c-c51a3691c7fa sending to next pipeline
2026-03-26 11:54:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879d39a7d0>
2026-03-26 11:54:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d29afe1b-2159-59e3-8bab-ccf69dbf7215/d29afe1b-2159-59e3-8bab-ccf69dbf7215_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9d983b31a724495293ec633a452eceb0.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9d983b31a724495293ec633a452eceb0.jpg saved to cache
2026-03-26 11:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d29afe1b-2159-59e3-8bab-ccf69dbf7215
2026-03-26 11:54:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d29afe1b-2159-59e3-8bab-ccf69dbf7215 sending to next pipeline
2026-03-26 11:54:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879d3a5c90>
2026-03-26 11:54:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56c1f992-2c85-5030-b10a-cb78e8b401b5/56c1f992-2c85-5030-b10a-cb78e8b401b5_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F497e898ff7504fb184b452b2e593f311.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/497e898ff7504fb184b452b2e593f311.jpg saved to cache
2026-03-26 11:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 56c1f992-2c85-5030-b10a-cb78e8b401b5
2026-03-26 11:54:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 56c1f992-2c85-5030-b10a-cb78e8b401b5 sending to next pipeline
2026-03-26 11:54:46 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 1ef5e51e-d19b-53c1-b1c4-bad60eda3904 with identifier 202603160735798
2026-03-26 11:54:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:46 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 1ef5e51e-d19b-53c1-b1c4-bad60eda3904
2026-03-26 11:54:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/ab3b3257d2bd4532ba42d13445fcaf03.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'The Vauxhall Corsa i Turbo SE is a 2015 model that boasts a '
                '1.0L Petrol Engine, meeting the stringent Euro 6 emission '
                'standards. This SE trim variant comes equipped with a range '
                'of convenient features, including a heated steering wheel and '
                "heated front seats, perfect for chilly drives. You'll also "
                'appreciate the air conditioning system, which keeps you '
                'comfortable on long journeys. The Corsa also features music '
                'streaming via Bluetooth, allowing you to connect your device '
                'and enjoy your favourite tunes on the go. Additionally, the '
                'vehicle is fitted with front and rear parking sensors, making '
                'navigating tight spaces a breeze.\n'
                '\n'
                'This Vauxhall Corsa i Turbo SE is a great choice for those '
                'looking for a fuel-efficient vehicle, with a impressive fuel '
                "economy of up to 66mpg. It's also a low insurance group, "
                'making it an attractive option for new drivers or those on a '
                'budget. With low CO2 emissions, you can drive with a clear '
                "conscience, knowing you're doing your part for the "
                'environment. These impressive credentials make the Corsa i '
                'Turbo SE stand out from other similar vehicles in its class, '
                'offering a winning combination of practicality, comfort, and '
                'eco-friendliness.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 89,
 'fuel_type': 'Petrol',
 'id': '1ef5e51e-d19b-53c1-b1c4-bad60eda3904',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603160735798',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Vauxhall',
 'model': 'Corsa',
 'odometer': 71000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 47,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ef5e51e-d19b-53c1-b1c4-bad60eda3904/1ef5e51e-d19b-53c1-b1c4-bad60eda3904_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 388280,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/ab3b3257d2bd4532ba42d13445fcaf03.jpg',
             'Width': 2048}],
 'price': 4499,
 'price_includes_vat': True,
 'registration_date': '2015-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Corsa 1.0i Turbo ecoFLEX SE Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'SE',
 'year': 2015}
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603160735798%27 HTTP/1.1" 200 None
2026-03-26 11:54:46 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603160735798: {'created_time': 1774526086.965199, 'last_price_update_time': 1774526086.965209}
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603160735798') HTTP/1.1" 204 0
2026-03-26 11:54:46 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2bbe9438-c917-59d3-a3ae-775e800c26b8 with identifier 202603110597597
2026-03-26 11:54:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:46 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2bbe9438-c917-59d3-a3ae-775e800c26b8
2026-03-26 11:54:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/a91faf4dcbdf4211ade3dd41135eedc6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Red',
 'currency': 'GBP',
 'description': '**********************APPOINTMENTS '
                'ONLY*********************This 2023 Vauxhall Corsa Turbo GS is '
                'a standout choice, boasting a clear vehicle history and '
                'having had only one owner from new. This Euro 6 compliant '
                '1.2L petrol model comes in the desirable GS trim, offering a '
                'refined driving experience. You can drive with confidence '
                'knowing it has an MOT valid until January 2027 and a 3 month '
                'warranty for your peace of mind. Notable features include a '
                'stylish Chrome Effect Exhaust Tailpipe Extension, convenient '
                'Shift Paddles for manual gear selection, and Automatic '
                'Lighting Control for effortless illumination. The Multimedia '
                'Infotainment System seamlessly integrates with Android Auto '
                'and Apple CarPlay, while Bluetooth connectivity keeps you '
                'connected on the go. Bright LED Headlights and Daytime '
                'Running Lights ensure excellent visibility.\n'
                '\n'
                'Experience impressive performance with this Corsa, achieving '
                '0-60mph in just 8.2 seconds, a highlight that shows its '
                'responsiveness compared to other vehicles. Its fuel economy '
                'is also a significant advantage, delivering an excellent 54 '
                'mpg, which is better than many comparable cars. Furthermore, '
                'this model benefits from low CO2 emissions, making it an '
                'environmentally conscious choice.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 128,
 'fuel_type': 'Petrol',
 'id': '2bbe9438-c917-59d3-a3ae-775e800c26b8',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603110597597',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Vauxhall',
 'model': 'Corsa',
 'odometer': 25000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 49,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bbe9438-c917-59d3-a3ae-775e800c26b8/2bbe9438-c917-59d3-a3ae-775e800c26b8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333841,
             'Height': 1341,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/a91faf4dcbdf4211ade3dd41135eedc6.jpg',
             'Width': 2048}],
 'price': 12499,
 'price_includes_vat': True,
 'registration_date': '2023-01-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Corsa 1.2 Turbo GS Auto Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'GS',
 'year': 2023}
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110597597%27 HTTP/1.1" 200 None
2026-03-26 11:54:47 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603110597597: {'created_time': 1774526087.015108, 'last_price_update_time': 1774526087.015118}
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603110597597') HTTP/1.1" 204 0
2026-03-26 11:54:47 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 75c686e6-95b1-5769-950c-c51a3691c7fa with identifier 202603160739965
2026-03-26 11:54:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:47 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 75c686e6-95b1-5769-950c-c51a3691c7fa
2026-03-26 11:54:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/1f69f5bf5dfa477b911fa36177bb5af5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'White',
 'currency': 'GBP',
 'description': '***********************APPOINTMENTS '
                'ONLY*****************Enjoy peace of mind with this 2019 Fiat '
                '500X FireFly Turbo Cross Plus, boasting an MOT valid until '
                'March 2027 and a clear vehicle history check. This Euro 6 '
                'compliant 1.0L petrol model, presented in the Cross Plus '
                'trim, comes with a 3 month warranty for added reassurance.\n'
                '\n'
                'Experience seamless connectivity with Apple CarPlay and '
                'Android Auto, displayed on the 7in HD touchscreen DAB radio '
                'which also features 3D navigation, Bluetooth, USB and Aux in '
                'ports. Stay comfortable in all conditions with automatic dual '
                'zone climate control and illuminate your journey with LED '
                'headlights. Parking is made easier with rear parking sensors '
                'and rear parking assistance. This model also benefits from '
                'low CO2 emissions.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 120,
 'fuel_type': 'Petrol',
 'id': '75c686e6-95b1-5769-950c-c51a3691c7fa',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603160739965',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 87000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75c686e6-95b1-5769-950c-c51a3691c7fa/75c686e6-95b1-5769-950c-c51a3691c7fa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 564613,
             'Height': 1690,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/1f69f5bf5dfa477b911fa36177bb5af5.jpg',
             'Width': 2048}],
 'price': 6499,
 'price_includes_vat': True,
 'registration_date': '2019-05-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500X 1.0 FireFly Turbo MultiAir Cross Plus Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Cross Plus',
 'year': 2019}
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603160739965%27 HTTP/1.1" 200 None
2026-03-26 11:54:47 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603160739965: {'created_time': 1774526087.061224, 'last_price_update_time': 1774526087.061237}
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603160739965') HTTP/1.1" 204 0
2026-03-26 11:54:47 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d29afe1b-2159-59e3-8bab-ccf69dbf7215 with identifier 202603100577484
2026-03-26 11:54:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:47 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d29afe1b-2159-59e3-8bab-ccf69dbf7215
2026-03-26 11:54:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/9d983b31a724495293ec633a452eceb0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Black',
 'currency': 'GBP',
 'description': '**************************APPOINTMENTS '
                'ONLY*************************This 2021 Vauxhall Corsa Turbo '
                'SRi Premium boasts a clear vehicle history, offering you '
                'peace of mind. This stylish hatchback is equipped with a 1.2 '
                'litre Euro 6 petrol engine, known for its efficiency and '
                'lower CO2 emissions. The SRi Premium trim level includes '
                'convenient features such as shift paddles for a more engaging '
                'drive, a Sight and Light Pack with automatic headlights, and '
                "keyless entry and start for effortless access. You'll also "
                'appreciate the refrigerant air conditioning, ensuring a '
                'comfortable cabin temperature.\n'
                '\n'
                'The performance of this Corsa is noteworthy, with an '
                'impressive 0 to 60 miles per hour acceleration time of just '
                '8.2 seconds. These highlights, combined with its Euro 6 '
                'compliant engine and low CO2 emissions, demonstrate how this '
                'Vauxhall Corsa offers a superior driving experience compared '
                'to many other vehicles in its class. A 3 month warranty is '
                'included for added reassurance.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 128,
 'fuel_type': 'Petrol',
 'id': 'd29afe1b-2159-59e3-8bab-ccf69dbf7215',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603100577484',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Vauxhall',
 'model': 'Corsa',
 'odometer': 53000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 49,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d29afe1b-2159-59e3-8bab-ccf69dbf7215/d29afe1b-2159-59e3-8bab-ccf69dbf7215_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 404413,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/9d983b31a724495293ec633a452eceb0.jpg',
             'Width': 2048}],
 'price': 10999,
 'price_includes_vat': True,
 'registration_date': '2021-04-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Corsa 1.2 Turbo SRi Premium Auto Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'SRi Premium',
 'year': 2021}
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603100577484%27 HTTP/1.1" 200 None
2026-03-26 11:54:47 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603100577484: {'created_time': 1774526087.114487, 'last_price_update_time': 1774526087.114498}
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603100577484') HTTP/1.1" 204 0
2026-03-26 11:54:47 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 56c1f992-2c85-5030-b10a-cb78e8b401b5 with identifier 202603100569572
2026-03-26 11:54:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:47 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 56c1f992-2c85-5030-b10a-cb78e8b401b5
2026-03-26 11:54:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/497e898ff7504fb184b452b2e593f311.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Black',
 'currency': 'GBP',
 'description': '********************APPOINTMENTS ONLY*****************This '
                '2017 Kia Sportage GDi 2 offers excellent peace of mind with '
                'its MOT valid until February 2027 and a clear vehicle history '
                'check. This Euro 6 compliant 1.6 litre petrol model comes '
                "with a 3 month warranty for added reassurance. Inside, you'll "
                'find a comfortable cabin equipped with Dual Automatic Air '
                'Conditioning featuring an ioniser for cleaner air, and '
                'Bluetooth connectivity for seamless music streaming and '
                'handsfree calls. Parking is made easier with rear parking '
                'sensors and a reversing camera system, while automatic '
                'headlights ensure optimal visibility in varying conditions.\n'
                '\n'
                'The Kia Sportage GDi 2 stands out with its impressive fuel '
                'economy, achieving up to 45 miles per gallon, which is better '
                'than many similar vehicles. It also benefits from a low '
                'insurance group, making it an economical choice for everyday '
                'driving. Furthermore, the generous boot space provides ample '
                'room for shopping, luggage, or sports equipment, '
                'demonstrating its practicality for families and individuals '
                'alike.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.6L',
 'engine_horse_power': 130,
 'fuel_type': 'Petrol',
 'id': '56c1f992-2c85-5030-b10a-cb78e8b401b5',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603100569572',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 95000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 47,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56c1f992-2c85-5030-b10a-cb78e8b401b5/56c1f992-2c85-5030-b10a-cb78e8b401b5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 420666,
             'Height': 1498,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/497e898ff7504fb184b452b2e593f311.jpg',
             'Width': 2048}],
 'price': 6999,
 'price_includes_vat': True,
 'registration_date': '2017-09-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Sportage 1.6 GDi 2 Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': '2',
 'year': 2017}
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603100569572%27 HTTP/1.1" 200 None
2026-03-26 11:54:47 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603100569572: {'created_time': 1774526087.169672, 'last_price_update_time': 1774526087.169688}
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603100569572') HTTP/1.1" 204 0
2026-03-26 11:54:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/9b5d576f6ba2420181fa4117c2128858.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:47 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:47 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b36ca4fa-9b35-5fb2-9a1a-338e1fa19729 with identifier: 202601289480879
2026-03-26 11:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b36ca4fa-9b35-5fb2-9a1a-338e1fa19729
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F97c260a86f6b4f5187c03ecfbf629ea0.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/97c260a86f6b4f5187c03ecfbf629ea0.jpg not downloaded yet
2026-03-26 11:54:47 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:47 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c5d82cb1-5ce1-5070-9242-3a89c3a6be0f with identifier: 202602200084458
2026-03-26 11:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c5d82cb1-5ce1-5070-9242-3a89c3a6be0f
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd5ac1a24735145aa89ab1579d60c043d.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d5ac1a24735145aa89ab1579d60c043d.jpg not downloaded yet
2026-03-26 11:54:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/4f24881397074469a75e3048f7401ca9.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:47 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:47 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b6d47cd5-0a79-5543-a317-4eacc1c13412 with identifier: 202601289480728
2026-03-26 11:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b6d47cd5-0a79-5543-a317-4eacc1c13412
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7a80fb5b2c5e41ca8c9bf90d4efd63c2.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7a80fb5b2c5e41ca8c9bf90d4efd63c2.jpg not downloaded yet
2026-03-26 11:54:47 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:47 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ad4a38a8-df8d-536d-bc8a-88acb90898d5 with identifier: 202602119844624
2026-03-26 11:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ad4a38a8-df8d-536d-bc8a-88acb90898d5
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3ed7b43e06e54866ace28235fb2f12d4.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3ed7b43e06e54866ace28235fb2f12d4.jpg not downloaded yet
2026-03-26 11:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879d3b0d10>
2026-03-26 11:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4ee2dcd-a113-5888-9684-05de12149f86/b4ee2dcd-a113-5888-9684-05de12149f86_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc3e9a0485fe6452f8ca9875640c6d518.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c3e9a0485fe6452f8ca9875640c6d518.jpg saved to cache
2026-03-26 11:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b4ee2dcd-a113-5888-9684-05de12149f86
2026-03-26 11:54:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b4ee2dcd-a113-5888-9684-05de12149f86 sending to next pipeline
2026-03-26 11:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879dec1350>
2026-03-26 11:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7a7eda1-3b44-5a81-b00b-19178bcc7936/c7a7eda1-3b44-5a81-b00b-19178bcc7936_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fba93b20b0f1d4ff4abb6680a94fea3d3.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ba93b20b0f1d4ff4abb6680a94fea3d3.jpg saved to cache
2026-03-26 11:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c7a7eda1-3b44-5a81-b00b-19178bcc7936
2026-03-26 11:54:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c7a7eda1-3b44-5a81-b00b-19178bcc7936 sending to next pipeline
2026-03-26 11:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879deb3a10>
2026-03-26 11:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a676e2-8178-5215-83c1-020f676d01c0/79a676e2-8178-5215-83c1-020f676d01c0_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F456b4982f1834dc9b19c46bb9dae575a.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/456b4982f1834dc9b19c46bb9dae575a.jpg saved to cache
2026-03-26 11:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 79a676e2-8178-5215-83c1-020f676d01c0
2026-03-26 11:54:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 79a676e2-8178-5215-83c1-020f676d01c0 sending to next pipeline
2026-03-26 11:54:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/aef1fe3d3d934cee84e7a309e24cb50a.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:47 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:47 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: cc9cb1c0-bdf1-5e98-8f25-fa3f216825de with identifier: 202601249394730
2026-03-26 11:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cc9cb1c0-bdf1-5e98-8f25-fa3f216825de
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F165a3bca88b9415bafd0091db6e17d93.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/165a3bca88b9415bafd0091db6e17d93.jpg not downloaded yet
2026-03-26 11:54:47 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:47 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d51f248f-d591-54ac-b3e1-d69ad2e8d083 with identifier: 202602119844476
2026-03-26 11:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d51f248f-d591-54ac-b3e1-d69ad2e8d083
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F871fa95e68ca4be5b578170deaa5c94e.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/871fa95e68ca4be5b578170deaa5c94e.jpg not downloaded yet
2026-03-26 11:54:47 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b4ee2dcd-a113-5888-9684-05de12149f86 with identifier 202603080513797
2026-03-26 11:54:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:47 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b4ee2dcd-a113-5888-9684-05de12149f86
2026-03-26 11:54:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/c3e9a0485fe6452f8ca9875640c6d518.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Red',
 'currency': 'GBP',
 'description': '***********************APPOINTMENTS '
                'ONLY****************Discover this 2019 Hyundai KONA T GDi '
                'Premium SE, a stylish and well equipped compact SUV. This '
                'Euro 6 compliant model boasts a 1.0 litre petrol engine and '
                'offers excellent fuel economy, achieving up to 52 miles per '
                'gallon. The Premium SE trim level ensures a comfortable and '
                'convenient driving experience with features such as Bluetooth '
                'connectivity for seamless phone integration, a helpful Head '
                'Up Display to keep your eyes on the road, and Smart Key '
                'keyless entry with an engine start stop button for effortless '
                "access and ignition. You'll also benefit from Park Distance "
                'Warning for the front of the vehicle, making parking '
                'manoeuvres simpler and safer.\n'
                '\n'
                'This Hyundai KONA stands out with its low CO2 emissions and '
                'low insurance group, indicating that it is more economical to '
                'run and insure compared to many other vehicles in its class. '
                'The inclusion of Apple CarPlay further enhances its appeal, '
                'allowing you to connect your iPhone and access your favourite '
                "apps, music, and navigation directly through the car's "
                'infotainment system. This combination of efficiency, advanced '
                'technology, and practical features makes the KONA T GDi '
                'Premium SE a compelling choice for those seeking a versatile '
                'and cost effective compact SUV.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 118,
 'fuel_type': 'Petrol',
 'id': 'b4ee2dcd-a113-5888-9684-05de12149f86',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603080513797',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Hyundai',
 'model': 'KONA',
 'odometer': 72000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 54,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee2dcd-a113-5888-9684-05de12149f86/b4ee2dcd-a113-5888-9684-05de12149f86_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369228,
             'Height': 1424,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/c3e9a0485fe6452f8ca9875640c6d518.jpg',
             'Width': 2048}],
 'price': 8499,
 'price_includes_vat': True,
 'registration_date': '2019-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Kona 1.0 T-GDi Blue Drive Premium SE Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Premium SE',
 'year': 2019}
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603080513797%27 HTTP/1.1" 200 None
2026-03-26 11:54:47 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603080513797: {'created_time': 1774526087.650272, 'last_price_update_time': 1774526087.650281}
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603080513797') HTTP/1.1" 204 0
2026-03-26 11:54:47 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c7a7eda1-3b44-5a81-b00b-19178bcc7936 with identifier 202603100569374
2026-03-26 11:54:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:47 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c7a7eda1-3b44-5a81-b00b-19178bcc7936
2026-03-26 11:54:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/ba93b20b0f1d4ff4abb6680a94fea3d3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'Purple',
 'currency': 'GBP',
 'description': '**********************APPOINTMENTS '
                'ONLY**********************This 2017 DS 3 PureTech Chic '
                'presents an exceptional ownership proposition with only two '
                'previous owners and a remarkably low mileage of 56,000 miles '
                'for its age. This stylish hatchback is powered by an '
                'efficient 1.2 litre Euro 6 compliant petrol engine, ensuring '
                'a smooth and economical driving experience.  It comes with a '
                'clear vehicle history check and an MOT valid until March '
                '2027, offering peace of mind for the new owner.  For added '
                'convenience, this DS 3 features air conditioning to keep you '
                'comfortable in all conditions and Bluetooth handsfree with '
                'USB connectivity for seamless phone integration and media '
                'streaming. A three month warranty is also included for your '
                'reassurance.\n'
                '\n'
                'The DS 3 PureTech Chic stands out with its impressive fuel '
                'economy, achieving an excellent 61 miles per gallon, which is '
                'a significant advantage over many other vehicles in its '
                'class. Furthermore, its low CO2 emissions contribute to a '
                'more environmentally friendly drive and potentially lower '
                'road tax. The low insurance group rating also means that '
                'running costs are kept to a minimum, making this DS 3 a very '
                'sensible choice for a wide range of drivers.',
 'doors_number': 3,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 81,
 'fuel_type': 'Petrol',
 'id': 'c7a7eda1-3b44-5a81-b00b-19178bcc7936',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603100569374',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'DS AUTOMOBILES',
 'model': 'DS 3',
 'odometer': 56000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 40,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7a7eda1-3b44-5a81-b00b-19178bcc7936/c7a7eda1-3b44-5a81-b00b-19178bcc7936_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 401551,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/ba93b20b0f1d4ff4abb6680a94fea3d3.jpg',
             'Width': 2048}],
 'price': 4499,
 'price_includes_vat': True,
 'registration_date': '2017-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS Automobiles DS 3 1.2 PureTech Chic Euro 6 3dr',
 'transmission': 'manual',
 'trim': 'Chic',
 'year': 2017}
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603100569374%27 HTTP/1.1" 200 None
2026-03-26 11:54:47 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603100569374: {'created_time': 1774526087.700164, 'last_price_update_time': 1774526087.700176}
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603100569374') HTTP/1.1" 204 0
2026-03-26 11:54:47 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 79a676e2-8178-5215-83c1-020f676d01c0 with identifier 202603010308243
2026-03-26 11:54:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:47 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 79a676e2-8178-5215-83c1-020f676d01c0
2026-03-26 11:54:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/456b4982f1834dc9b19c46bb9dae575a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'color': 'Grey',
 'currency': 'GBP',
 'description': '***********************APPOINTMENT '
                'ONLY*******************This 2019 Mercedes Benz GLA GLA180 AMG '
                'Line Edition offers a compelling blend of style and '
                'practicality. Powered by a 1.6 litre petrol engine, this Euro '
                '6 compliant vehicle is presented in the sought after AMG Line '
                'Edition trim. You can drive with confidence thanks to the '
                'reversing camera with 180 degree view and parking assistance, '
                'while the headlamp assist automatically activates the high '
                'performance LED headlights in dark conditions. Inside, you '
                'will appreciate the comfort of heated front seats and the '
                'convenience of THERMOTRONIC luxury automatic climate control '
                'with a two zone display, ensuring a pleasant environment for '
                'all occupants.\n'
                '\n'
                'The Mercedes Benz GLA GLA180 AMG Line Edition stands out with '
                'its impressive acceleration, reaching 0 to 62 miles per hour '
                'in just 8.7 seconds, demonstrating its responsive '
                'performance. This model also benefits from a low insurance '
                'group, making it an economical choice for many drivers. '
                'Furthermore, the generous boot space provides ample room for '
                'luggage or shopping, highlighting its versatility for '
                'everyday use and longer journeys. These features collectively '
                'indicate how this GLA offers a superior experience compared '
                'to other vehicles in its class.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'fuel_type': 'Petrol',
 'id': '79a676e2-8178-5215-83c1-020f676d01c0',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603010308243',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Mercedes-Benz',
 'model': 'GLA',
 'odometer': 62000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 47,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a676e2-8178-5215-83c1-020f676d01c0/79a676e2-8178-5215-83c1-020f676d01c0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341842,
             'Height': 1424,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/456b4982f1834dc9b19c46bb9dae575a.jpg',
             'Width': 2048}],
 'price': 13999,
 'price_includes_vat': True,
 'registration_date': '2019-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA 1.6 GLA180 AMG Line Edition 7G-DCT Euro 6 (s/s) '
          '5dr',
 'transmission': 'automatic',
 'trim': 'AMG Line Edition',
 'year': 2019}
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603010308243%27 HTTP/1.1" 200 None
2026-03-26 11:54:47 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603010308243: {'created_time': 1774526087.747843, 'last_price_update_time': 1774526087.747853}
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603010308243') HTTP/1.1" 204 0
2026-03-26 11:54:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/586a505276e64778ba46fb8d94f63731.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/e490e62afcf845bf8926f906d9c73ce1.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879dec3410>
2026-03-26 11:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a508d186-acf7-5eeb-b652-bf9c6ef4a69b/a508d186-acf7-5eeb-b652-bf9c6ef4a69b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9b5d576f6ba2420181fa4117c2128858.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9b5d576f6ba2420181fa4117c2128858.jpg saved to cache
2026-03-26 11:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a508d186-acf7-5eeb-b652-bf9c6ef4a69b
2026-03-26 11:54:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a508d186-acf7-5eeb-b652-bf9c6ef4a69b sending to next pipeline
2026-03-26 11:54:47 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:47 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 518e7364-3003-50a7-84e3-5ed6946474c9 with identifier: 202601219310748
2026-03-26 11:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 518e7364-3003-50a7-84e3-5ed6946474c9
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F20d6142503954f219f5792bb2bb760a6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/20d6142503954f219f5792bb2bb760a6.jpg not downloaded yet
2026-03-26 11:54:47 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:47 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bddf277-f4ae-5e6b-b421-a395571f55e4 with identifier: 202602109811125
2026-03-26 11:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7bddf277-f4ae-5e6b-b421-a395571f55e4
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffa693b0e71c54f2fa2d612f411712f4a.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fa693b0e71c54f2fa2d612f411712f4a.jpg not downloaded yet
2026-03-26 11:54:47 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a508d186-acf7-5eeb-b652-bf9c6ef4a69b with identifier 202602270265589
2026-03-26 11:54:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:47 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a508d186-acf7-5eeb-b652-bf9c6ef4a69b
2026-03-26 11:54:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/9b5d576f6ba2420181fa4117c2128858.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Grey',
 'currency': 'GBP',
 'description': '********************APPOINTMENTS ONLY*****************This '
                '2021 Tesla Model 3 Long Range presents an exceptional '
                'ownership proposition with just one owner and remarkably low '
                'mileage for its age, having covered only 30,000 miles. As an '
                'electric vehicle, it boasts a substantial 78 kWh battery '
                'offering a maximum range of 360 miles when new, and benefits '
                'from Four Wheel Drive for confident handling. Charging is '
                'convenient, with a full charge at home taking approximately '
                '12 hours using a 7kW charger, while rapid public charging can '
                'achieve 80% capacity in as little as 26 minutes. This Model 3 '
                'comes with a 3 month warranty and its MOT is valid until '
                'November 2026, ensuring peace of mind.\n'
                '\n'
                'Experience impressive performance with the Model 3 Long '
                'Range, capable of accelerating from 0 to 60mph in a swift 4.2 '
                'seconds, a figure that sets it apart from many comparable '
                "vehicles. You'll also appreciate the generous boot space, "
                'offering ample room for luggage and shopping. Inside, the '
                'cabin is equipped with a suite of desirable features designed '
                'for comfort and convenience, including 12 way power '
                'adjustable front and rear heated seats, a heated steering '
                'wheel, and keyless entry and go. For added ease and safety, '
                'it features Adaptive Cruise Control and front parking sensors '
                'with parking assistance.',
 'doors_number': 4,
 'engine_horse_power': 341,
 'fuel_type': 'Electric',
 'id': 'a508d186-acf7-5eeb-b652-bf9c6ef4a69b',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602270265589',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Tesla',
 'model': 'Model 3',
 'odometer': 30000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 47,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a508d186-acf7-5eeb-b652-bf9c6ef4a69b/a508d186-acf7-5eeb-b652-bf9c6ef4a69b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 293227,
             'Height': 1212,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/9b5d576f6ba2420181fa4117c2128858.jpg',
             'Width': 2048}],
 'price': 19499,
 'price_includes_vat': True,
 'registration_date': '2021-09-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Tesla Model 3 (Dual Motor) Long Range Auto 4WDE 4dr',
 'transmission': 'automatic',
 'trim': 'Long Range',
 'year': 2021}
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602270265589%27 HTTP/1.1" 200 None
2026-03-26 11:54:47 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602270265589: {'created_time': 1774526087.956569, 'last_price_update_time': 1774526087.956578}
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602270265589') HTTP/1.1" 204 0
2026-03-26 11:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879e925a10>
2026-03-26 11:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffde341c-61f4-572d-bb3c-bb5770d90a68/ffde341c-61f4-572d-bb3c-bb5770d90a68_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4f24881397074469a75e3048f7401ca9.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4f24881397074469a75e3048f7401ca9.jpg saved to cache
2026-03-26 11:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ffde341c-61f4-572d-bb3c-bb5770d90a68
2026-03-26 11:54:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ffde341c-61f4-572d-bb3c-bb5770d90a68 sending to next pipeline
2026-03-26 11:54:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879d3e9010>
2026-03-26 11:54:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c74fdc86-c137-57ad-8a1b-cb23a36477c0/c74fdc86-c137-57ad-8a1b-cb23a36477c0_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Faef1fe3d3d934cee84e7a309e24cb50a.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/aef1fe3d3d934cee84e7a309e24cb50a.jpg saved to cache
2026-03-26 11:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c74fdc86-c137-57ad-8a1b-cb23a36477c0
2026-03-26 11:54:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c74fdc86-c137-57ad-8a1b-cb23a36477c0 sending to next pipeline
2026-03-26 11:54:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b83c1f71-7a7a-5ead-9c6a-4b3f213d6691 with identifier: 202601159177369
2026-03-26 11:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b83c1f71-7a7a-5ead-9c6a-4b3f213d6691
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff31388ca21b7452099ced8b6728c8518.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f31388ca21b7452099ced8b6728c8518.jpg not downloaded yet
2026-03-26 11:54:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: fcfd2ca3-29ed-502c-a204-afdc868b86ab with identifier: 202602039644497
2026-03-26 11:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fcfd2ca3-29ed-502c-a204-afdc868b86ab
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc13e68c4469b4a34859c4645e0b1cbcc.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c13e68c4469b4a34859c4645e0b1cbcc.jpg not downloaded yet
2026-03-26 11:54:48 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ffde341c-61f4-572d-bb3c-bb5770d90a68 with identifier 202603040392968
2026-03-26 11:54:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:48 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ffde341c-61f4-572d-bb3c-bb5770d90a68
2026-03-26 11:54:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/4f24881397074469a75e3048f7401ca9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Black',
 'currency': 'GBP',
 'description': '**********************APPOINTMENTS '
                'ONLY********************This 2021 BMW 2 Series Gran Coupe '
                '218i Sport is a superb example, having had only one owner '
                'from new and boasting a clear vehicle history check. This '
                'Euro 6 compliant model features a responsive 1.5L petrol '
                'engine and comes with a 3 month warranty for your peace of '
                "mind. Inside, you'll find the Sport trim offering a "
                'comfortable driving experience with features like a folding '
                'front armrest with storage, and a through loading system for '
                'added practicality. The BMW Live Cockpit Plus, enhanced '
                'Bluetooth hands-free functionality with USB audio interface, '
                'and Bluetooth audio streaming all ensure seamless '
                'connectivity on every journey.\n'
                '\n'
                'This particular 218i Sport stands out with its impressive '
                'fuel economy, achieving up to 50 miles per gallon, which '
                'indicates it is more economical than many similar vehicles. '
                'Furthermore, its low CO2 emissions and low insurance group '
                'highlight its cost effectiveness for everyday use, making it '
                'an attractive choice for those seeking a stylish and '
                'efficient premium car. A 12 month MOT will be provided upon '
                'purchase, ensuring its roadworthiness.',
 'doors_number': 4,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 134,
 'fuel_type': 'Petrol',
 'id': 'ffde341c-61f4-572d-bb3c-bb5770d90a68',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603040392968',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'BMW',
 'model': '2 Series Gran Coupe',
 'odometer': 65000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 51,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffde341c-61f4-572d-bb3c-bb5770d90a68/ffde341c-61f4-572d-bb3c-bb5770d90a68_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333718,
             'Height': 1406,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/4f24881397074469a75e3048f7401ca9.jpg',
             'Width': 2048}],
 'price': 13999,
 'price_includes_vat': True,
 'registration_date': '2021-01-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2 Series Gran Coupe 1.5 218i Sport DCT Euro 6 (s/s) 4dr',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2021}
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040392968%27 HTTP/1.1" 200 None
2026-03-26 11:54:48 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603040392968: {'created_time': 1774526088.228533, 'last_price_update_time': 1774526088.228541}
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603040392968') HTTP/1.1" 204 0
2026-03-26 11:54:48 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c74fdc86-c137-57ad-8a1b-cb23a36477c0 with identifier 202603060464883
2026-03-26 11:54:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:48 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c74fdc86-c137-57ad-8a1b-cb23a36477c0
2026-03-26 11:54:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/aef1fe3d3d934cee84e7a309e24cb50a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Black',
 'currency': 'GBP',
 'description': '***********************APPOINTMENTS '
                'ONLY******************Boasting exceptionally low mileage for '
                'its 2017 registration, this Audi A3 TFSI SE presents a '
                'compelling proposition. This Euro 6 compliant model, powered '
                'by a 1.5 litre petrol engine, comes with a 3 month warranty '
                'and an MOT valid until September 2026, offering peace of '
                'mind. Notable features include air conditioning, rear parking '
                'sensors for easier manoeuvring, and a light and rain sensor '
                "that automatically adjusts the headlights. You'll also "
                'appreciate the convenience of a Bluetooth interface for '
                'seamless phone connectivity and striking Xenon headlights '
                'with LED daytime running lights.\n'
                '\n'
                'This Audi A3 TFSI SE excels with its impressive fuel economy, '
                'achieving a remarkable 59 miles per gallon, which indicates '
                'it is more economical than many similar vehicles. Its '
                'acceleration is also noteworthy, reaching 0 to 62 miles per '
                'hour in just 8.2 seconds, demonstrating a good balance of '
                'performance. Furthermore, this model benefits from low CO2 '
                'emissions and generous boot space, making it a practical and '
                'efficient choice for everyday driving and longer journeys.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 148,
 'fuel_type': 'Petrol',
 'id': 'c74fdc86-c137-57ad-8a1b-cb23a36477c0',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603060464883',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 48000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 50,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c74fdc86-c137-57ad-8a1b-cb23a36477c0/c74fdc86-c137-57ad-8a1b-cb23a36477c0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 295731,
             'Height': 1273,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/aef1fe3d3d934cee84e7a309e24cb50a.jpg',
             'Width': 2048}],
 'price': 11499,
 'price_includes_vat': True,
 'registration_date': '2017-09-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 1.5 TFSI CoD SE Sportback S Tronic Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'SE',
 'year': 2017}
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603060464883%27 HTTP/1.1" 200 None
2026-03-26 11:54:48 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603060464883: {'created_time': 1774526088.290575, 'last_price_update_time': 1774526088.290586}
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603060464883') HTTP/1.1" 204 0
2026-03-26 11:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/5217d1e22b5b4717ab57e445c25aedfa.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/6e036f127f284f21b2414d3426689147.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 37e904f5-4485-5dd4-b76e-45dce556df90 with identifier: 202601149151006
2026-03-26 11:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 37e904f5-4485-5dd4-b76e-45dce556df90
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4c5cd6d071274c349d85f59ed9f2e714.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4c5cd6d071274c349d85f59ed9f2e714.jpg not downloaded yet
2026-03-26 11:54:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: da642ecd-af89-5b36-bc41-f06231583c67 with identifier: 202601319571902
2026-03-26 11:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item da642ecd-af89-5b36-bc41-f06231583c67
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1b5d469172c0436da38d87559a9a7d4d.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1b5d469172c0436da38d87559a9a7d4d.jpg not downloaded yet
2026-03-26 11:54:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879d398450>
2026-03-26 11:54:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1552da9-74ca-5a70-b7de-693271ede6a2/d1552da9-74ca-5a70-b7de-693271ede6a2_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F586a505276e64778ba46fb8d94f63731.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/586a505276e64778ba46fb8d94f63731.jpg saved to cache
2026-03-26 11:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d1552da9-74ca-5a70-b7de-693271ede6a2
2026-03-26 11:54:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d1552da9-74ca-5a70-b7de-693271ede6a2 sending to next pipeline
2026-03-26 11:54:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879e9e34d0>
2026-03-26 11:54:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8dcdf31-a53d-5650-9afa-8f22589138c6/e8dcdf31-a53d-5650-9afa-8f22589138c6_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe490e62afcf845bf8926f906d9c73ce1.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e490e62afcf845bf8926f906d9c73ce1.jpg saved to cache
2026-03-26 11:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8dcdf31-a53d-5650-9afa-8f22589138c6
2026-03-26 11:54:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8dcdf31-a53d-5650-9afa-8f22589138c6 sending to next pipeline
2026-03-26 11:54:48 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d1552da9-74ca-5a70-b7de-693271ede6a2 with identifier 202602270264810
2026-03-26 11:54:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:48 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d1552da9-74ca-5a70-b7de-693271ede6a2
2026-03-26 11:54:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/586a505276e64778ba46fb8d94f63731.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 25,
 'color': 'Blue',
 'currency': 'GBP',
 'description': '**************************APPOINTMENTS '
                'ONLY**************************This 2021 Audi A3 TFSIe S line '
                'offers a clear vehicle history, providing peace of mind for '
                'its next owner. This particular model is a Euro 6 compliant, '
                '1.4 litre petrol plug in hybrid, presented in the sporty S '
                'line trim. It comes with a 3 month warranty for added '
                'security. Notable features include a Bluetooth interface for '
                'seamless phone connectivity, and striking LED headlights with '
                'dynamic rear indicators that enhance both visibility and '
                'style.\n'
                '\n'
                'Inside, you will appreciate the convenience of dual zone '
                'electronic climate control, ensuring comfort for all '
                'occupants. The light and rain sensor automatically manages '
                'the headlights, while the Audi Smartphone Interface, '
                'compatible with Apple CarPlay, keeps you connected on the go. '
                'These features collectively demonstrate the advanced '
                'technology and thoughtful design that set this Audi A3 apart '
                'from other vehicles in its class.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.4L',
 'engine_horse_power': 201,
 'fuel_type': 'Petrol Plug-in Hybrid',
 'id': 'd1552da9-74ca-5a70-b7de-693271ede6a2',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602270264810',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 65000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 49,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1552da9-74ca-5a70-b7de-693271ede6a2/d1552da9-74ca-5a70-b7de-693271ede6a2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354596,
             'Height': 1337,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/586a505276e64778ba46fb8d94f63731.jpg',
             'Width': 2048}],
 'price': 14999,
 'price_includes_vat': True,
 'registration_date': '2021-05-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 1.4 TFSIe 40 S line Sportback S Tronic Euro 6 (s/s) 5dr '
          '13kWh',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2021}
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602270264810%27 HTTP/1.1" 200 None
2026-03-26 11:54:48 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602270264810: {'created_time': 1774526088.623364, 'last_price_update_time': 1774526088.623374}
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602270264810') HTTP/1.1" 204 0
2026-03-26 11:54:48 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e8dcdf31-a53d-5650-9afa-8f22589138c6 with identifier 202602250205097
2026-03-26 11:54:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:48 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e8dcdf31-a53d-5650-9afa-8f22589138c6
2026-03-26 11:54:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/e490e62afcf845bf8926f906d9c73ce1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Red',
 'currency': 'GBP',
 'description': '**********************APPOINTMENTS '
                'ONLY********************With an exceptionally low mileage of '
                'just 18,000 miles for a 2020 model, this Kia Rio T GDi GT '
                'Line presents a superb opportunity. This Euro 6 compliant 1.0 '
                'litre petrol hatchback boasts the desirable GT Line trim, '
                'offering a blend of style and practicality. You can connect '
                'your smartphone seamlessly with Apple CarPlay and Android '
                'Auto, both featuring voice control, and stream your favourite '
                'music via Bluetooth. Parking is made easier with the '
                'integrated reversing camera system, complete with dynamic '
                "guidelines, and you'll stay comfortable on every journey "
                'thanks to the air conditioning. This vehicle comes with a '
                'clear vehicle history check and a 3 month warranty for your '
                'peace of mind.\n'
                '\n'
                'The Kia Rio GT Line is designed to impress, and its '
                'highlights demonstrate its superiority over other vehicles in '
                'its class. Its brisk acceleration, achieving 0 to 60 miles '
                'per hour in just 10.1 seconds, ensures a responsive driving '
                'experience. Furthermore, its low insurance group rating means '
                'more money in your pocket, and the generous boot space '
                'provides ample room for shopping or luggage, making it a '
                'truly versatile choice for everyday life.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 118,
 'fuel_type': 'Petrol',
 'id': 'e8dcdf31-a53d-5650-9afa-8f22589138c6',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602250205097',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 18000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 49,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8dcdf31-a53d-5650-9afa-8f22589138c6/e8dcdf31-a53d-5650-9afa-8f22589138c6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336522,
             'Height': 1391,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/e490e62afcf845bf8926f906d9c73ce1.jpg',
             'Width': 2048}],
 'price': 12999,
 'price_includes_vat': True,
 'registration_date': '2020-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA RIO 1.0 T-GDi GT-Line DCT Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'GT-Line',
 'year': 2020}
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602250205097%27 HTTP/1.1" 200 None
2026-03-26 11:54:48 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602250205097: {'created_time': 1774526088.671061, 'last_price_update_time': 1774526088.671071}
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602250205097') HTTP/1.1" 204 0
2026-03-26 11:54:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ebf53fc-a0d7-5e9b-b9a6-a4543f2f5314 with identifier: 202512108514159
2026-03-26 11:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6ebf53fc-a0d7-5e9b-b9a6-a4543f2f5314
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3771bcee30824d70bd03fd6689e87ed6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3771bcee30824d70bd03fd6689e87ed6.jpg not downloaded yet
2026-03-26 11:54:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 793adec0-ccc9-5cf1-ace7-360fd225325c with identifier: 202601309559753
2026-03-26 11:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 793adec0-ccc9-5cf1-ace7-360fd225325c
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F48c9eb74752e476ebb30334d44e72579.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/48c9eb74752e476ebb30334d44e72579.jpg not downloaded yet
2026-03-26 11:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/d5ac1a24735145aa89ab1579d60c043d.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/97c260a86f6b4f5187c03ecfbf629ea0.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/7a80fb5b2c5e41ca8c9bf90d4efd63c2.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/3ed7b43e06e54866ace28235fb2f12d4.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: faa5c35f-df26-58d1-8aa2-bc08f8a3978f with identifier: 202512058406853
2026-03-26 11:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item faa5c35f-df26-58d1-8aa2-bc08f8a3978f
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F821c884298454f3bbcc5bd59be26f852.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/821c884298454f3bbcc5bd59be26f852.jpg not downloaded yet
2026-03-26 11:54:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 4930b0df-883c-5c54-96ca-3d44e2fb573c with identifier: 202601299517146
2026-03-26 11:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4930b0df-883c-5c54-96ca-3d44e2fb573c
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdb902af8c93b4065889bd40fc7bb3aa2.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/db902af8c93b4065889bd40fc7bb3aa2.jpg not downloaded yet
2026-03-26 11:54:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879e924390>
2026-03-26 11:54:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcdcad5c-6747-535d-9e4a-4f9f233aa509/bcdcad5c-6747-535d-9e4a-4f9f233aa509_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5217d1e22b5b4717ab57e445c25aedfa.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5217d1e22b5b4717ab57e445c25aedfa.jpg saved to cache
2026-03-26 11:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bcdcad5c-6747-535d-9e4a-4f9f233aa509
2026-03-26 11:54:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bcdcad5c-6747-535d-9e4a-4f9f233aa509 sending to next pipeline
2026-03-26 11:54:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879d3992d0>
2026-03-26 11:54:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfbee9d7-efee-55b0-8b01-2a111188b8e2/cfbee9d7-efee-55b0-8b01-2a111188b8e2_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6e036f127f284f21b2414d3426689147.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6e036f127f284f21b2414d3426689147.jpg saved to cache
2026-03-26 11:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cfbee9d7-efee-55b0-8b01-2a111188b8e2
2026-03-26 11:54:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cfbee9d7-efee-55b0-8b01-2a111188b8e2 sending to next pipeline
2026-03-26 11:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/871fa95e68ca4be5b578170deaa5c94e.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:48 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: bcdcad5c-6747-535d-9e4a-4f9f233aa509 with identifier 202602200086914
2026-03-26 11:54:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:48 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item bcdcad5c-6747-535d-9e4a-4f9f233aa509
2026-03-26 11:54:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/5217d1e22b5b4717ab57e445c25aedfa.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Blue',
 'currency': 'GBP',
 'description': '**************************APPOINTMENTS '
                'ONLY**************************Discover this exceptional 2016 '
                'Vauxhall Corsa i Energy, boasting remarkably low mileage for '
                'its age at just 45,000 miles and having had only two owners. '
                'This Euro 6 compliant 1.4 litre petrol model comes with a '
                'clear vehicle history check and is offered with a 3 month '
                "warranty for your peace of mind. Inside, you'll find a "
                'comfortable cabin equipped with electrically heated front '
                'seats and air conditioning with an air recirculation '
                'facility. The R4.0 IntelliLink touch screen infotainment '
                'system provides seamless Bluetooth connectivity, allowing you '
                'to stay connected on the go. The Sight and Light Pack One '
                'ensures automatic headlights are activated when needed, '
                'enhancing your driving experience.\n'
                '\n'
                'This Vauxhall Corsa i Energy stands out with its impressive '
                'fuel economy, achieving up to 60 miles per gallon, which is a '
                'significant advantage for everyday driving costs. '
                'Furthermore, its low insurance group rating means that '
                'running this vehicle is also very affordable. These '
                'highlights, combined with its well maintained provenance and '
                'desirable features, make this Corsa a compelling choice '
                'compared to other vehicles in its class.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.4L',
 'engine_horse_power': 89,
 'fuel_type': 'Petrol',
 'id': 'bcdcad5c-6747-535d-9e4a-4f9f233aa509',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602200086914',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Vauxhall',
 'model': 'Corsa',
 'odometer': 45000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 44,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcdcad5c-6747-535d-9e4a-4f9f233aa509/bcdcad5c-6747-535d-9e4a-4f9f233aa509_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324413,
             'Height': 1448,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/5217d1e22b5b4717ab57e445c25aedfa.jpg',
             'Width': 2048}],
 'price': 7999,
 'price_includes_vat': True,
 'registration_date': '2016-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Corsa 1.4i ecoFLEX Energy Easytronic Euro 6 (s/s) 5dr '
          '(a/c)',
 'transmission': 'automatic',
 'trim': 'Energy',
 'year': 2016}
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602200086914%27 HTTP/1.1" 200 None
2026-03-26 11:54:48 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602200086914: {'created_time': 1774526088.970967, 'last_price_update_time': 1774526088.970977}
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602200086914') HTTP/1.1" 204 0
2026-03-26 11:54:48 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: cfbee9d7-efee-55b0-8b01-2a111188b8e2 with identifier 202601289488731
2026-03-26 11:54:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:49 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item cfbee9d7-efee-55b0-8b01-2a111188b8e2
2026-03-26 11:54:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/6e036f127f284f21b2414d3426689147.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 34,
 'color': 'Blue',
 'currency': 'GBP',
 'description': '***************************APPOINTMENTS '
                'ONLY*****************************This 2020 Vauxhall Grandland '
                'X Ultimate Nav presents an exceptional opportunity with its '
                'remarkably low mileage of just 34,000 miles. This four wheel '
                'drive, Euro 6 compliant, 1.6 litre petrol plug in hybrid '
                'model combines efficiency with performance. It boasts a suite '
                'of premium features designed for comfort and convenience, '
                'including the Winter Pack One with heated seats and steering '
                'wheel, Keyless Entry and Engine Start Stop Button with a '
                'power tailgate, and the Sight and Light Pack for automatic '
                'headlights. Further enhancing the driving experience are the '
                'Premium LED Adaptive Forward Lighting and a Denon Premium '
                'Sound System.\n'
                '\n'
                'The performance of this Grandland X is truly noteworthy, '
                'accelerating from 0 to 60mph in a swift 5.9 seconds. This '
                'impressive acceleration, combined with its plug in hybrid '
                'technology and four wheel drive capability, sets it apart '
                'from many other vehicles in its class. These elements '
                'together signify a superior driving experience, offering both '
                'dynamic responsiveness and the benefits of hybrid power.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.6L',
 'engine_horse_power': 298,
 'fuel_type': 'Petrol Plug-in Hybrid',
 'id': 'cfbee9d7-efee-55b0-8b01-2a111188b8e2',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601289488731',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Vauxhall',
 'model': 'Grandland X',
 'odometer': 34000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 50,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfbee9d7-efee-55b0-8b01-2a111188b8e2/cfbee9d7-efee-55b0-8b01-2a111188b8e2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349041,
             'Height': 1426,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/6e036f127f284f21b2414d3426689147.jpg',
             'Width': 2048}],
 'price': 12499,
 'price_includes_vat': True,
 'registration_date': '2020-01-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Grandland X 1.6 13.2kWh Ultimate Nav Auto 4WD Euro 6 (s/s) '
          '5dr Hybrid4',
 'transmission': 'automatic',
 'trim': 'Ultimate Nav',
 'year': 2020}
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601289488731%27 HTTP/1.1" 200 None
2026-03-26 11:54:49 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601289488731: {'created_time': 1774526089.025793, 'last_price_update_time': 1774526089.025808}
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601289488731') HTTP/1.1" 204 0
2026-03-26 11:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/165a3bca88b9415bafd0091db6e17d93.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:49 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:49 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 718de9cb-0976-5c27-b962-9f83452bad72 with identifier: 202512038317605
2026-03-26 11:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 718de9cb-0976-5c27-b962-9f83452bad72
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe0733965caa7454e882d4fe0fe4a1b70.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e0733965caa7454e882d4fe0fe4a1b70.jpg not downloaded yet
2026-03-26 11:54:49 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:49 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c3225160-91cf-5225-9d5e-e4e69360fad6 with identifier: 202601299516923
2026-03-26 11:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c3225160-91cf-5225-9d5e-e4e69360fad6
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Facfdbd8c9d4e4d20adc69ff04af8ebc1.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/acfdbd8c9d4e4d20adc69ff04af8ebc1.jpg not downloaded yet
2026-03-26 11:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/fa693b0e71c54f2fa2d612f411712f4a.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879e7d2310>
2026-03-26 11:54:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5d82cb1-5ce1-5070-9242-3a89c3a6be0f/c5d82cb1-5ce1-5070-9242-3a89c3a6be0f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd5ac1a24735145aa89ab1579d60c043d.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d5ac1a24735145aa89ab1579d60c043d.jpg saved to cache
2026-03-26 11:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c5d82cb1-5ce1-5070-9242-3a89c3a6be0f
2026-03-26 11:54:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c5d82cb1-5ce1-5070-9242-3a89c3a6be0f sending to next pipeline
2026-03-26 11:54:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879d237490>
2026-03-26 11:54:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b36ca4fa-9b35-5fb2-9a1a-338e1fa19729/b36ca4fa-9b35-5fb2-9a1a-338e1fa19729_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F97c260a86f6b4f5187c03ecfbf629ea0.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/97c260a86f6b4f5187c03ecfbf629ea0.jpg saved to cache
2026-03-26 11:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b36ca4fa-9b35-5fb2-9a1a-338e1fa19729
2026-03-26 11:54:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b36ca4fa-9b35-5fb2-9a1a-338e1fa19729 sending to next pipeline
2026-03-26 11:54:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879d239ad0>
2026-03-26 11:54:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d47cd5-0a79-5543-a317-4eacc1c13412/b6d47cd5-0a79-5543-a317-4eacc1c13412_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7a80fb5b2c5e41ca8c9bf90d4efd63c2.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7a80fb5b2c5e41ca8c9bf90d4efd63c2.jpg saved to cache
2026-03-26 11:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b6d47cd5-0a79-5543-a317-4eacc1c13412
2026-03-26 11:54:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b6d47cd5-0a79-5543-a317-4eacc1c13412 sending to next pipeline
2026-03-26 11:54:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879d245750>
2026-03-26 11:54:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4a38a8-df8d-536d-bc8a-88acb90898d5/ad4a38a8-df8d-536d-bc8a-88acb90898d5_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3ed7b43e06e54866ace28235fb2f12d4.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3ed7b43e06e54866ace28235fb2f12d4.jpg saved to cache
2026-03-26 11:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ad4a38a8-df8d-536d-bc8a-88acb90898d5
2026-03-26 11:54:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ad4a38a8-df8d-536d-bc8a-88acb90898d5 sending to next pipeline
2026-03-26 11:54:49 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c5d82cb1-5ce1-5070-9242-3a89c3a6be0f with identifier 202602200084458
2026-03-26 11:54:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:49 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c5d82cb1-5ce1-5070-9242-3a89c3a6be0f
2026-03-26 11:54:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/d5ac1a24735145aa89ab1579d60c043d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Red',
 'currency': 'GBP',
 'description': '**************************APPOINTMENTS '
                'ONLY************************Discover this exceptional 2018 '
                'Peugeot 2008 Allure, boasting remarkably low mileage for its '
                'age at just 26,000 miles. This Euro 6 compliant 1.2 litre '
                'petrol model offers a clear vehicle history and comes with a '
                '3 month warranty for your peace of mind. Its MOT is valid '
                'until January 2027, ensuring long term roadworthiness. '
                "Inside, you'll find a 7in multifunction colour touchscreen "
                'with steering wheel mounted controls, compatible with Apple '
                'CarPlay, and Bluetooth connectivity. Comfort is assured with '
                'automatic dual zone air conditioning, and parking is made '
                'easier with rear parking aid sensors. The Visibility Pack '
                'includes automatic headlights, adding to the convenience.\n'
                '\n'
                'This Peugeot 2008 Allure stands out with its impressive fuel '
                'economy, achieving an excellent 59 miles per gallon, which '
                'indicates it is more economical than many similar vehicles. '
                'Furthermore, its low insurance group and low CO2 emissions '
                'highlight its cost effectiveness and environmental '
                'consideration compared to other cars in its class.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 108,
 'fuel_type': 'Petrol',
 'id': 'c5d82cb1-5ce1-5070-9242-3a89c3a6be0f',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602200084458',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 26000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 46,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5d82cb1-5ce1-5070-9242-3a89c3a6be0f/c5d82cb1-5ce1-5070-9242-3a89c3a6be0f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 427174,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/d5ac1a24735145aa89ab1579d60c043d.jpg',
             'Width': 2048}],
 'price': 9499,
 'price_includes_vat': True,
 'registration_date': '2018-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure EAT Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2018}
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602200084458%27 HTTP/1.1" 200 None
2026-03-26 11:54:49 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602200084458: {'created_time': 1774526089.501303, 'last_price_update_time': 1774526089.501313}
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602200084458') HTTP/1.1" 204 0
2026-03-26 11:54:49 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b36ca4fa-9b35-5fb2-9a1a-338e1fa19729 with identifier 202601289480879
2026-03-26 11:54:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:49 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b36ca4fa-9b35-5fb2-9a1a-338e1fa19729
2026-03-26 11:54:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/97c260a86f6b4f5187c03ecfbf629ea0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'This Volkswagen Golf TDI Style from 2020 offers excellent '
                'peace of mind with its MOT valid until October 2026 and a '
                'clear vehicle history check, having had only one owner. This '
                'Euro 6 compliant 2.0 litre diesel model comes with a 3 month '
                "warranty for added reassurance. Inside, you'll find a Mobile "
                'Phone Interface with Wireless Inductive Charging, ensuring '
                'your devices stay powered up on the go. The Climate Control '
                'system features 3Zone Electronic Air Conditioning with '
                'Automatic Air Recirculation, providing a comfortable '
                'environment for all occupants, further enhanced by the Lounge '
                'Pack which includes independent rear air conditioning.\n'
                '\n'
                'Experience impressive performance with this Golf, achieving '
                '0-62mph in just 8.8 seconds, a figure that demonstrates its '
                'responsiveness compared to many other vehicles in its class. '
                'Furthermore, its fuel economy is a standout feature, '
                'achieving an excellent 61 mpg, making it an economical choice '
                'for your daily journeys. The vehicle also benefits from '
                'Automatic Headlight Activation with separate LED Daytime '
                'Running Lights and an Automatic Coming Home leaving function, '
                'along with Adaptive Cruise Control ACC with Speed Limiter and '
                'Front Assist, all designed to make your driving experience '
                'smoother and more convenient.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 148,
 'fuel_type': 'Diesel',
 'id': 'b36ca4fa-9b35-5fb2-9a1a-338e1fa19729',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601289480879',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Volkswagen',
 'model': 'Golf',
 'odometer': 68000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 50,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b36ca4fa-9b35-5fb2-9a1a-338e1fa19729/b36ca4fa-9b35-5fb2-9a1a-338e1fa19729_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 379635,
             'Height': 1463,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/97c260a86f6b4f5187c03ecfbf629ea0.jpg',
             'Width': 2048}],
 'price': 14999,
 'price_includes_vat': True,
 'registration_date': '2020-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf 2.0 TDI Style DSG Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2020}
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601289480879%27 HTTP/1.1" 200 None
2026-03-26 11:54:49 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601289480879: {'created_time': 1774526089.553, 'last_price_update_time': 1774526089.553011}
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601289480879') HTTP/1.1" 204 0
2026-03-26 11:54:49 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b6d47cd5-0a79-5543-a317-4eacc1c13412 with identifier 202601289480728
2026-03-26 11:54:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:49 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b6d47cd5-0a79-5543-a317-4eacc1c13412
2026-03-26 11:54:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/7a80fb5b2c5e41ca8c9bf90d4efd63c2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Blue',
 'currency': 'GBP',
 'description': '*********************APPOINTMENTS '
                'ONLY********************This 2023 Vauxhall Grandland Turbo '
                'Ultimate is a superb example, having had only one owner from '
                'new. It boasts a responsive 1.2 litre petrol engine and meets '
                'Euro 6 emissions standards. This model comes equipped with '
                'advanced features such as Adaptive IntelliLux LED Pixel '
                'Headlights for optimal visibility, a 360 degree panoramic '
                'parking camera system to aid manoeuvring, and Highway '
                'Integration Assist for relaxed long distance driving. Inside, '
                "you'll appreciate the convenience of a wireless charger and "
                'the comfort offered by the Winter Pack, which includes heated '
                'seats and a heated steering wheel.\n'
                '\n'
                'The Grandland Turbo Ultimate offers a generous boot space, '
                'making it ideal for families or those who need ample room for '
                'luggage. Its low insurance group rating also means it is '
                'economical to run. To ensure your peace of mind, a 12 month '
                'MOT will be provided on purchase, and the vehicle comes with '
                'a 3 month warranty. These highlights demonstrate how this '
                'Grandland offers a compelling package of technology, '
                'practicality, and value.LB70WDC',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 128,
 'fuel_type': 'Petrol',
 'id': 'b6d47cd5-0a79-5543-a317-4eacc1c13412',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601289480728',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Vauxhall',
 'model': 'Grandland',
 'odometer': 55000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 52,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6d47cd5-0a79-5543-a317-4eacc1c13412/b6d47cd5-0a79-5543-a317-4eacc1c13412_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361655,
             'Height': 1508,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/7a80fb5b2c5e41ca8c9bf90d4efd63c2.jpg',
             'Width': 2048}],
 'price': 13499,
 'price_includes_vat': True,
 'registration_date': '2023-01-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Grandland 1.2 Turbo Ultimate Auto Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Ultimate',
 'year': 2023}
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601289480728%27 HTTP/1.1" 200 None
2026-03-26 11:54:49 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601289480728: {'created_time': 1774526089.600273, 'last_price_update_time': 1774526089.600282}
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601289480728') HTTP/1.1" 204 0
2026-03-26 11:54:49 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ad4a38a8-df8d-536d-bc8a-88acb90898d5 with identifier 202602119844624
2026-03-26 11:54:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:49 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ad4a38a8-df8d-536d-bc8a-88acb90898d5
2026-03-26 11:54:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/3ed7b43e06e54866ace28235fb2f12d4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Grey',
 'currency': 'GBP',
 'description': '********************APPOINTMENTS '
                'ONLY***********************With only one owner and a '
                'remarkably low mileage of 15,000 miles for a 2021 model, this '
                'Peugeot E-208 GT Premium presents an exceptional opportunity. '
                'This electric hatchback boasts a 50 kWh battery offering a '
                'maximum range of 232 miles when new, making it ideal for both '
                'daily commutes and longer journeys. Charging is convenient, '
                'with a full charge at home on a 7kW charger taking '
                'approximately 7 hours and 30 minutes, while rapid public '
                'charging can replenish the battery from empty to 80% in just '
                '30 minutes. The vehicle comes with a 3 month warranty and its '
                'MOT is valid until October 2026, with a clear vehicle history '
                'check confirming its excellent condition.\n'
                '\n'
                'The GT Premium trim level is packed with desirable features '
                'that enhance the driving experience. The innovative PEUGEOT '
                '3D i-Cockpit with its configurable 3D head up instrument '
                'panel provides a futuristic and clear display of driving '
                'information. Comfort is assured with heated front seats for '
                'both occupants, and connectivity is seamless thanks to the '
                'Bluetooth telephone facility. Parking is made effortless with '
                'the Visio Park 1 system, which includes a 180 degree colour '
                'reversing camera and front and rear parking sensors. The '
                'Visibility Pack ensures you are always prepared, with '
                'automatic headlights for changing light conditions. These '
                'features collectively demonstrate how this E-208 GT Premium '
                'offers a superior and more refined driving experience '
                'compared to other vehicles in its class.',
 'doors_number': 5,
 'engine_horse_power': 134,
 'fuel_type': 'Electric',
 'id': 'ad4a38a8-df8d-536d-bc8a-88acb90898d5',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602119844624',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Peugeot',
 'model': 'E-208',
 'odometer': 15000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 51,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4a38a8-df8d-536d-bc8a-88acb90898d5/ad4a38a8-df8d-536d-bc8a-88acb90898d5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351865,
             'Height': 1375,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/3ed7b43e06e54866ace28235fb2f12d4.jpg',
             'Width': 2048}],
 'price': 11999,
 'price_includes_vat': True,
 'registration_date': '2021-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot E-208 50kWh GT Premium Auto 5dr',
 'transmission': 'automatic',
 'trim': 'GT Premium',
 'year': 2021}
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602119844624%27 HTTP/1.1" 200 None
2026-03-26 11:54:49 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602119844624: {'created_time': 1774526089.647624, 'last_price_update_time': 1774526089.647634}
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602119844624') HTTP/1.1" 204 0
2026-03-26 11:54:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879d247990>
2026-03-26 11:54:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d51f248f-d591-54ac-b3e1-d69ad2e8d083/d51f248f-d591-54ac-b3e1-d69ad2e8d083_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F871fa95e68ca4be5b578170deaa5c94e.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/871fa95e68ca4be5b578170deaa5c94e.jpg saved to cache
2026-03-26 11:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d51f248f-d591-54ac-b3e1-d69ad2e8d083
2026-03-26 11:54:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d51f248f-d591-54ac-b3e1-d69ad2e8d083 sending to next pipeline
2026-03-26 11:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/20d6142503954f219f5792bb2bb760a6.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:49 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d51f248f-d591-54ac-b3e1-d69ad2e8d083 with identifier 202602119844476
2026-03-26 11:54:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:49 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d51f248f-d591-54ac-b3e1-d69ad2e8d083
2026-03-26 11:54:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/871fa95e68ca4be5b578170deaa5c94e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'White',
 'currency': 'GBP',
 'description': '************************APPOINTMENTS '
                'ONLY********************This 2022 Tesla Model Y Long Range is '
                'a superb example, having had only one owner since new. As a '
                'fully electric vehicle, it offers a smooth and quiet driving '
                'experience, powered by an 85 kWh battery that provides an '
                'impressive maximum range of 331 miles. This Four Wheel Drive '
                'model also benefits from a suite of convenient features, '
                'including LED headlights for excellent visibility, a heated '
                'steering wheel for comfort on colder days, and heated rear '
                "seats for passengers. You'll also appreciate the ease of "
                'wireless phone charging and the assistance of front parking '
                'sensors.\n'
                '\n'
                'The highlights of this Model Y Long Range truly set it apart. '
                'Its 0-60mph acceleration in just 4.8 seconds demonstrates its '
                'brisk performance, a notable advantage over many comparable '
                'vehicles. Furthermore, the substantial boot space offers '
                'exceptional practicality for everyday use and longer '
                'journeys. When it comes to charging, you can achieve a full '
                'charge at home using a 7kW charger in approximately 12 hours, '
                'or benefit from rapid charging on the go, reaching 80% '
                'capacity from empty in as little as 25 minutes at a public '
                'charging station.',
 'doors_number': 5,
 'engine_horse_power': 384,
 'fuel_type': 'Electric',
 'id': 'd51f248f-d591-54ac-b3e1-d69ad2e8d083',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602119844476',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Tesla',
 'model': 'Model Y',
 'odometer': 31000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d51f248f-d591-54ac-b3e1-d69ad2e8d083/d51f248f-d591-54ac-b3e1-d69ad2e8d083_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215165,
             'Height': 1255,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/871fa95e68ca4be5b578170deaa5c94e.jpg',
             'Width': 2048}],
 'price': 22999,
 'price_includes_vat': True,
 'registration_date': '2022-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Tesla Model Y (Dual Motor) Long Range Auto 4WDE 5dr',
 'transmission': 'automatic',
 'trim': 'Long Range',
 'year': 2022}
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602119844476%27 HTTP/1.1" 200 None
2026-03-26 11:54:49 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602119844476: {'created_time': 1774526089.743375, 'last_price_update_time': 1774526089.743384}
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602119844476') HTTP/1.1" 204 0
2026-03-26 11:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:54:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879de75490>
2026-03-26 11:54:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc9cb1c0-bdf1-5e98-8f25-fa3f216825de/cc9cb1c0-bdf1-5e98-8f25-fa3f216825de_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F165a3bca88b9415bafd0091db6e17d93.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/165a3bca88b9415bafd0091db6e17d93.jpg saved to cache
2026-03-26 11:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cc9cb1c0-bdf1-5e98-8f25-fa3f216825de
2026-03-26 11:54:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cc9cb1c0-bdf1-5e98-8f25-fa3f216825de sending to next pipeline
2026-03-26 11:54:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87a05bce90>
2026-03-26 11:54:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bddf277-f4ae-5e6b-b421-a395571f55e4/7bddf277-f4ae-5e6b-b421-a395571f55e4_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffa693b0e71c54f2fa2d612f411712f4a.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fa693b0e71c54f2fa2d612f411712f4a.jpg saved to cache
2026-03-26 11:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7bddf277-f4ae-5e6b-b421-a395571f55e4
2026-03-26 11:54:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7bddf277-f4ae-5e6b-b421-a395571f55e4 sending to next pipeline
2026-03-26 11:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/1b5d469172c0436da38d87559a9a7d4d.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/4c5cd6d071274c349d85f59ed9f2e714.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/f31388ca21b7452099ced8b6728c8518.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:49 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: cc9cb1c0-bdf1-5e98-8f25-fa3f216825de with identifier 202601249394730
2026-03-26 11:54:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:49 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item cc9cb1c0-bdf1-5e98-8f25-fa3f216825de
2026-03-26 11:54:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/165a3bca88b9415bafd0091db6e17d93.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'With only 56,000 miles on the clock, this 2018 Volkswagen '
                'Golf TSI EVO SE represents excellent value for its age, '
                'having been owned by just two careful keepers. This Euro 6 '
                'compliant model boasts a responsive 1.5 litre petrol engine '
                "and comes equipped with the SE trim level. Inside, you'll "
                'find the Composition Media System, complete with Bluetooth '
                'connectivity for hands free calls and music streaming. For '
                'added convenience, it features Car Net App Connect, allowing '
                'seamless integration with both Android Auto and Apple '
                'CarPlay. The SE trim also includes manual air conditioning to '
                'keep you comfortable, and a dusk sensor that automatically '
                'activates the headlights when light levels drop.\n'
                '\n'
                'This Volkswagen Golf is designed to impress with its '
                'performance and efficiency. Its acceleration from 0 to 60 '
                'miles per hour in just 8.8 seconds offers an engaging driving '
                'experience, while its impressive fuel economy of 59 miles per '
                'gallon highlights its cost effectiveness. Furthermore, its '
                'low CO2 emissions are better for the environment. The Golf '
                'also offers generous boot space, making it a practical choice '
                'for families or those who need extra room for luggage. '
                'Adaptive Cruise Control, which includes standard cruise '
                'control functionality, further enhances the driving '
                'experience by helping to maintain a set speed and distance '
                'from the vehicle ahead.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 128,
 'fuel_type': 'Petrol',
 'id': 'cc9cb1c0-bdf1-5e98-8f25-fa3f216825de',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601249394730',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Volkswagen',
 'model': 'Golf',
 'odometer': 56000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 48,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc9cb1c0-bdf1-5e98-8f25-fa3f216825de/cc9cb1c0-bdf1-5e98-8f25-fa3f216825de_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276336,
             'Height': 1388,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/165a3bca88b9415bafd0091db6e17d93.jpg',
             'Width': 2048}],
 'price': 7999,
 'price_includes_vat': True,
 'registration_date': '2018-01-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf 1.5 TSI EVO BlueMotion Tech SE Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'SE',
 'year': 2018}
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601249394730%27 HTTP/1.1" 200 None
2026-03-26 11:54:49 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601249394730: {'created_time': 1774526089.93076, 'last_price_update_time': 1774526089.93077}
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601249394730') HTTP/1.1" 204 0
2026-03-26 11:54:49 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7bddf277-f4ae-5e6b-b421-a395571f55e4 with identifier 202602109811125
2026-03-26 11:54:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:49 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7bddf277-f4ae-5e6b-b421-a395571f55e4
2026-03-26 11:54:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/fa693b0e71c54f2fa2d612f411712f4a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'color': 'Red',
 'currency': 'GBP',
 'description': '*************************APPOINTMENTS '
                'ONLY******************Discover this exceptional 2019 Citroen '
                'C1 VTi Flair with an incredibly low mileage of just 7000 '
                'miles, offering outstanding value. This well maintained '
                'example boasts a clear vehicle history check and comes with a '
                '3 month warranty for your peace of mind. Under the bonnet, '
                "you'll find an efficient 1.0 litre petrol engine, compliant "
                'with Euro 6 emissions standards. Inside, the Flair trim level '
                'enhances your driving experience with a vibrant 7in Touch '
                'Drive Interface that seamlessly integrates with Android Auto '
                'and Apple CarPlay, keeping you connected on the go.\n'
                '\n'
                'This Citroen C1 Flair stands out with its impressive fuel '
                'economy, achieving a remarkable 55 miles per gallon, which '
                'indicates it is more economical than many similar vehicles. '
                'Furthermore, its low CO2 emissions and low insurance group '
                'highlight its affordability and efficiency, making it a '
                'sensible choice for many drivers. Enjoy your journeys with '
                'the convenience of air conditioning, DAB digital radio, '
                'Bluetooth handsfree connectivity, and a handy reversing '
                'camera to assist with parking.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 71,
 'fuel_type': 'Petrol',
 'id': '7bddf277-f4ae-5e6b-b421-a395571f55e4',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602109811125',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Citroen',
 'model': 'C1',
 'odometer': 7000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 47,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bddf277-f4ae-5e6b-b421-a395571f55e4/7bddf277-f4ae-5e6b-b421-a395571f55e4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318929,
             'Height': 1474,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/fa693b0e71c54f2fa2d612f411712f4a.jpg',
             'Width': 2048}],
 'price': 9999,
 'price_includes_vat': True,
 'registration_date': '2019-03-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Citroen C1 1.0 VTi Flair ETG5 Euro 6 5dr',
 'transmission': 'automatic',
 'trim': 'Flair',
 'year': 2019}
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602109811125%27 HTTP/1.1" 200 None
2026-03-26 11:54:49 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602109811125: {'created_time': 1774526089.978261, 'last_price_update_time': 1774526089.978271}
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602109811125') HTTP/1.1" 204 0
2026-03-26 11:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/c13e68c4469b4a34859c4645e0b1cbcc.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/48c9eb74752e476ebb30334d44e72579.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879e768cd0>
2026-03-26 11:54:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_518e7364-3003-50a7-84e3-5ed6946474c9/518e7364-3003-50a7-84e3-5ed6946474c9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F20d6142503954f219f5792bb2bb760a6.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/20d6142503954f219f5792bb2bb760a6.jpg saved to cache
2026-03-26 11:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 518e7364-3003-50a7-84e3-5ed6946474c9
2026-03-26 11:54:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 518e7364-3003-50a7-84e3-5ed6946474c9 sending to next pipeline
2026-03-26 11:54:50 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:50 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7735f4b7-eedb-51a6-bdbb-9042bf44d5c4 with identifier: 202511268154863
2026-03-26 11:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7735f4b7-eedb-51a6-bdbb-9042bf44d5c4
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe7136ac3c8cf42609d26a76933085b6a.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e7136ac3c8cf42609d26a76933085b6a.jpg not downloaded yet
2026-03-26 11:54:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/3771bcee30824d70bd03fd6689e87ed6.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:50 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 518e7364-3003-50a7-84e3-5ed6946474c9 with identifier 202601219310748
2026-03-26 11:54:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:50 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 518e7364-3003-50a7-84e3-5ed6946474c9
2026-03-26 11:54:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/20d6142503954f219f5792bb2bb760a6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blue',
 'currency': 'GBP',
 'description': '********************APPOINTMENTS ONLY******************This '
                '2023 Polestar 2 Long Range presents a superb opportunity, '
                'having been owned by just one person and boasting a clear '
                'vehicle history check. This electric vehicle offers a '
                'substantial battery total capacity of 78 kWh, providing a '
                'maximum range of 341 miles when new. For convenience, a full '
                'charge at home using a 7kW charger takes approximately 12 '
                'hours, while rapid public charging can replenish the battery '
                'from empty to 80% in as little as 40 minutes. The car is '
                'equipped with a Rear View Camera for parking assistance, '
                'Apple CarPlay and an Infotainment System powered by Android, '
                'and heated front seats for added comfort. Adaptive LED '
                'headlights ensure excellent visibility, and the MOT is valid '
                'until January 2027.\n'
                '\n'
                'The Polestar 2 Long Range stands out with its impressive '
                'performance, accelerating from 0 to 60mph in just 7.0 '
                'seconds, demonstrating its dynamic capability. This '
                'acceleration figure indicates a more responsive driving '
                'experience compared to many similar vehicles. Furthermore, '
                'the generous boot space offers practicality for everyday use '
                'and longer journeys, setting it apart in its class. The '
                'vehicle comes with a 3 month warranty, offering peace of mind '
                'for its next owner.',
 'doors_number': 5,
 'engine_horse_power': 228,
 'fuel_type': 'Electric',
 'id': '518e7364-3003-50a7-84e3-5ed6946474c9',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601219310748',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Polestar',
 'model': 'Polestar 2',
 'odometer': 52000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 48,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_518e7364-3003-50a7-84e3-5ed6946474c9/518e7364-3003-50a7-84e3-5ed6946474c9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305260,
             'Height': 1328,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/20d6142503954f219f5792bb2bb760a6.jpg',
             'Width': 2048}],
 'price': 16499,
 'price_includes_vat': True,
 'registration_date': '2023-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Polestar Polestar 2 Single Motor 78kWh Long Range Fastback Auto FWD '
          '5dr',
 'transmission': 'automatic',
 'trim': 'Long Range',
 'year': 2023}
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601219310748%27 HTTP/1.1" 200 None
2026-03-26 11:54:50 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601219310748: {'created_time': 1774526090.135559, 'last_price_update_time': 1774526090.135576}
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601219310748') HTTP/1.1" 204 0
2026-03-26 11:54:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/db902af8c93b4065889bd40fc7bb3aa2.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:50 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:50 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: bb3b6191-8a0f-563e-a9c6-89e7382b64ef with identifier: 202511208023779
2026-03-26 11:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bb3b6191-8a0f-563e-a9c6-89e7382b64ef
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbddf4174fadb41788b345e7f58e980f4.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bddf4174fadb41788b345e7f58e980f4.jpg not downloaded yet
2026-03-26 11:54:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87a059de50>
2026-03-26 11:54:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da642ecd-af89-5b36-bc41-f06231583c67/da642ecd-af89-5b36-bc41-f06231583c67_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1b5d469172c0436da38d87559a9a7d4d.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1b5d469172c0436da38d87559a9a7d4d.jpg saved to cache
2026-03-26 11:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item da642ecd-af89-5b36-bc41-f06231583c67
2026-03-26 11:54:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item da642ecd-af89-5b36-bc41-f06231583c67 sending to next pipeline
2026-03-26 11:54:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87a1958510>
2026-03-26 11:54:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37e904f5-4485-5dd4-b76e-45dce556df90/37e904f5-4485-5dd4-b76e-45dce556df90_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4c5cd6d071274c349d85f59ed9f2e714.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4c5cd6d071274c349d85f59ed9f2e714.jpg saved to cache
2026-03-26 11:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 37e904f5-4485-5dd4-b76e-45dce556df90
2026-03-26 11:54:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 37e904f5-4485-5dd4-b76e-45dce556df90 sending to next pipeline
2026-03-26 11:54:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879e885650>
2026-03-26 11:54:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b83c1f71-7a7a-5ead-9c6a-4b3f213d6691/b83c1f71-7a7a-5ead-9c6a-4b3f213d6691_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff31388ca21b7452099ced8b6728c8518.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f31388ca21b7452099ced8b6728c8518.jpg saved to cache
2026-03-26 11:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b83c1f71-7a7a-5ead-9c6a-4b3f213d6691
2026-03-26 11:54:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b83c1f71-7a7a-5ead-9c6a-4b3f213d6691 sending to next pipeline
2026-03-26 11:54:50 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: da642ecd-af89-5b36-bc41-f06231583c67 with identifier 202601319571902
2026-03-26 11:54:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:50 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item da642ecd-af89-5b36-bc41-f06231583c67
2026-03-26 11:54:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/1b5d469172c0436da38d87559a9a7d4d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 248,
 'color': 'Green',
 'currency': 'GBP',
 'description': '****************************APPOINTMENTS '
                'ONLY**************************This Land Rover Freelander S '
                'from 2004 offers excellent peace of mind with an MOT valid '
                'until December 2026 and a clear vehicle history check. This '
                'capable Four Wheel Drive model is powered by a reliable 1.8 '
                'litre petrol engine, making it a practical choice for various '
                'driving needs. As an S variant, it comes with a '
                'straightforward specification designed for everyday use.\n'
                '\n'
                'The Freelander S is also noted for its low insurance group, '
                'which can help to keep running costs down. This, combined '
                'with its robust Four Wheel Drive system and the assurance of '
                'a clear vehicle history, presents a compelling package for '
                'anyone seeking a dependable and accessible Land Rover.',
 'doors_number': 5,
 'emission_standard': 'Euro 3',
 'engine': '1.8L',
 'engine_horse_power': 115,
 'fuel_type': 'Petrol',
 'id': 'da642ecd-af89-5b36-bc41-f06231583c67',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601319571902',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Land Rover',
 'model': 'Freelander',
 'odometer': 116000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 46,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da642ecd-af89-5b36-bc41-f06231583c67/da642ecd-af89-5b36-bc41-f06231583c67_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 380022,
             'Height': 1504,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/1b5d469172c0436da38d87559a9a7d4d.jpg',
             'Width': 2048}],
 'price': 1999,
 'price_includes_vat': True,
 'registration_date': '2004-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Freelander 1.8 S Station Wagon 5dr',
 'transmission': 'manual',
 'trim': 'S',
 'year': 2004}
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601319571902%27 HTTP/1.1" 200 None
2026-03-26 11:54:50 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601319571902: {'created_time': 1774526090.514709, 'last_price_update_time': 1774526090.514718}
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601319571902') HTTP/1.1" 204 0
2026-03-26 11:54:50 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 37e904f5-4485-5dd4-b76e-45dce556df90 with identifier 202601149151006
2026-03-26 11:54:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:50 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 37e904f5-4485-5dd4-b76e-45dce556df90
2026-03-26 11:54:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/4c5cd6d071274c349d85f59ed9f2e714.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Blue',
 'currency': 'GBP',
 'description': '*************************APPOINTMENTS ONLY**************This '
                '2020 BMW 3 Series 320d SE boasts exceptionally low mileage '
                'for its age, having covered just 47,000 miles, and comes with '
                'a clear vehicle history check. This Euro 6 compliant model '
                'features a 2.0L diesel engine and is presented in the SE '
                'trim. It benefits from the SE Plus Package, which includes '
                'heated seats for added comfort, and Extended LED Headlights '
                'for enhanced visibility. Connectivity is seamless with the '
                'Connected Package Plus, offering Apple CarPlay integration, '
                'and Bluetooth Hands Free with USB Audio Interface. Parking is '
                'made effortless thanks to the Parking Assistant, which '
                'incorporates front and rear sensors along with a rear '
                'camera.\n'
                '\n'
                'This BMW 320d SE offers a compelling blend of performance and '
                'efficiency, highlighted by its impressive fuel economy of 55 '
                'mpg. Its low CO2 emissions and low insurance group further '
                'contribute to its affordability and appeal. For drivers '
                'seeking a responsive experience, the 0-62mph acceleration in '
                'just 6.8 seconds demonstrates its dynamic capabilities. These '
                'highlights collectively indicate that this vehicle offers a '
                'superior ownership proposition compared to other similar '
                'models on the market.',
 'doors_number': 4,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 187,
 'fuel_type': 'Diesel',
 'id': '37e904f5-4485-5dd4-b76e-45dce556df90',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601149151006',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'BMW',
 'model': '3 Series',
 'odometer': 47000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 48,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37e904f5-4485-5dd4-b76e-45dce556df90/37e904f5-4485-5dd4-b76e-45dce556df90_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332650,
             'Height': 1369,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/4c5cd6d071274c349d85f59ed9f2e714.jpg',
             'Width': 2048}],
 'price': 16499,
 'price_includes_vat': True,
 'registration_date': '2020-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 Series 2.0 320d SE Auto Euro 6 (s/s) 4dr',
 'transmission': 'automatic',
 'trim': 'SE',
 'year': 2020}
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149151006%27 HTTP/1.1" 200 None
2026-03-26 11:54:50 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601149151006: {'created_time': 1774526090.562968, 'last_price_update_time': 1774526090.562976}
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601149151006') HTTP/1.1" 204 0
2026-03-26 11:54:50 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b83c1f71-7a7a-5ead-9c6a-4b3f213d6691 with identifier 202601159177369
2026-03-26 11:54:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:50 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b83c1f71-7a7a-5ead-9c6a-4b3f213d6691
2026-03-26 11:54:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/f31388ca21b7452099ced8b6728c8518.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Grey',
 'currency': 'GBP',
 'description': '********************APPOINTMENTS '
                'ONLY*************************This 2020 Fiat 500 Star is '
                'presented with a clear vehicle history check, offering you '
                'peace of mind. This stylish hatchback features a 1.2 litre '
                'Euro 6 petrol engine and comes with a 3 month warranty for '
                'added security. The Star trim level includes a fixed glass '
                'roof with a sunblind, allowing you to enjoy the open sky.\n'
                '\n'
                'You will find convenience and connectivity at your fingertips '
                'with this Fiat 500. It boasts automatic climate control to '
                'keep you comfortable in all conditions, and seamless '
                'integration with your smartphone through Apple CarPlay and '
                'Android Auto. The 7 inch HD touchscreen radio provides 3D '
                'navigation, Bluetooth connectivity, USB port, and DAB radio. '
                'Parking is made easier with rear parking sensors, and this '
                'model benefits from a low insurance group, indicating it is '
                'more economical to run than many similar vehicles. A 12 month '
                'MOT will be provided upon purchase, ensuring its '
                'roadworthiness.',
 'doors_number': 3,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 69,
 'fuel_type': 'Petrol',
 'id': 'b83c1f71-7a7a-5ead-9c6a-4b3f213d6691',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601159177369',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Fiat',
 'model': '500',
 'odometer': 31000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 46,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b83c1f71-7a7a-5ead-9c6a-4b3f213d6691/b83c1f71-7a7a-5ead-9c6a-4b3f213d6691_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312917,
             'Height': 1532,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/f31388ca21b7452099ced8b6728c8518.jpg',
             'Width': 2048}],
 'price': 10499,
 'price_includes_vat': True,
 'registration_date': '2020-05-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 Star Dualogic Euro 6 (s/s) 3dr',
 'transmission': 'automatic',
 'trim': 'Star',
 'year': 2020}
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601159177369%27 HTTP/1.1" 200 None
2026-03-26 11:54:50 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601159177369: {'created_time': 1774526090.620671, 'last_price_update_time': 1774526090.62068}
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601159177369') HTTP/1.1" 204 0
2026-03-26 11:54:50 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:50 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e8329ed-2f11-57a7-8a65-84ff9694d154 with identifier: 202511057686600
2026-03-26 11:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2e8329ed-2f11-57a7-8a65-84ff9694d154
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff6c96e5a25854bad83a2be25170b801f.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f6c96e5a25854bad83a2be25170b801f.jpg not downloaded yet
2026-03-26 11:54:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879d306090>
2026-03-26 11:54:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcfd2ca3-29ed-502c-a204-afdc868b86ab/fcfd2ca3-29ed-502c-a204-afdc868b86ab_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc13e68c4469b4a34859c4645e0b1cbcc.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c13e68c4469b4a34859c4645e0b1cbcc.jpg saved to cache
2026-03-26 11:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fcfd2ca3-29ed-502c-a204-afdc868b86ab
2026-03-26 11:54:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fcfd2ca3-29ed-502c-a204-afdc868b86ab sending to next pipeline
2026-03-26 11:54:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879e874d10>
2026-03-26 11:54:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_793adec0-ccc9-5cf1-ace7-360fd225325c/793adec0-ccc9-5cf1-ace7-360fd225325c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F48c9eb74752e476ebb30334d44e72579.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/48c9eb74752e476ebb30334d44e72579.jpg saved to cache
2026-03-26 11:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 793adec0-ccc9-5cf1-ace7-360fd225325c
2026-03-26 11:54:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 793adec0-ccc9-5cf1-ace7-360fd225325c sending to next pipeline
2026-03-26 11:54:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879d335e90>
2026-03-26 11:54:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ebf53fc-a0d7-5e9b-b9a6-a4543f2f5314/6ebf53fc-a0d7-5e9b-b9a6-a4543f2f5314_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3771bcee30824d70bd03fd6689e87ed6.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3771bcee30824d70bd03fd6689e87ed6.jpg saved to cache
2026-03-26 11:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6ebf53fc-a0d7-5e9b-b9a6-a4543f2f5314
2026-03-26 11:54:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6ebf53fc-a0d7-5e9b-b9a6-a4543f2f5314 sending to next pipeline
2026-03-26 11:54:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879d23f810>
2026-03-26 11:54:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4930b0df-883c-5c54-96ca-3d44e2fb573c/4930b0df-883c-5c54-96ca-3d44e2fb573c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdb902af8c93b4065889bd40fc7bb3aa2.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/db902af8c93b4065889bd40fc7bb3aa2.jpg saved to cache
2026-03-26 11:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4930b0df-883c-5c54-96ca-3d44e2fb573c
2026-03-26 11:54:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4930b0df-883c-5c54-96ca-3d44e2fb573c sending to next pipeline
2026-03-26 11:54:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/821c884298454f3bbcc5bd59be26f852.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:50 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:50 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 32ab5536-8324-5528-8ed3-e1de9d03ca4f with identifier: 202510157166316
2026-03-26 11:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 32ab5536-8324-5528-8ed3-e1de9d03ca4f
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7352fdfcc8e54ee5b8c3fe42d8459be2.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7352fdfcc8e54ee5b8c3fe42d8459be2.jpg not downloaded yet
2026-03-26 11:54:50 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: fcfd2ca3-29ed-502c-a204-afdc868b86ab with identifier 202602039644497
2026-03-26 11:54:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:50 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item fcfd2ca3-29ed-502c-a204-afdc868b86ab
2026-03-26 11:54:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/c13e68c4469b4a34859c4645e0b1cbcc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'color': 'Red',
 'currency': 'GBP',
 'description': '****************************APPOINTMENTS '
                'ONLY***********************This 2020 Hyundai TUCSON CRDi N '
                'Line presents an exceptional opportunity with its remarkably '
                'low mileage of just 37512 miles. This Euro 6 compliant 1.6L '
                'Diesel Hybrid is presented in the sporty N Line trim, '
                'offering a blend of style and efficiency. Key features '
                'include automatic headlights with a dusk sensor, dual zone '
                'climate control for personalised comfort, and a smart key '
                "system for keyless entry and engine start-stop. You'll also "
                'appreciate the convenience of a wireless phone charging pad '
                'and front and rear parking sensors, making every journey '
                'smoother and more secure.\n'
                '\n'
                'This TUCSON stands out with its impressive fuel economy, '
                'achieving up to 50 mpg, which is a significant advantage for '
                'running costs. Its low insurance group rating further '
                'contributes to its affordability, making it an attractive '
                'choice for many drivers. Additionally, its low CO2 emissions '
                'highlight its environmental consideration. These factors '
                'combined indicate that this Hyundai TUCSON offers a superior '
                'ownership experience compared to many other vehicles in its '
                'class, all backed by a 3 month warranty for your peace of '
                'mind.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.6L',
 'engine_horse_power': 134,
 'fuel_type': 'Diesel Hybrid',
 'id': 'fcfd2ca3-29ed-502c-a204-afdc868b86ab',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602039644497',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Hyundai',
 'model': 'TUCSON',
 'odometer': 37512,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 51,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcfd2ca3-29ed-502c-a204-afdc868b86ab/fcfd2ca3-29ed-502c-a204-afdc868b86ab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 430329,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/c13e68c4469b4a34859c4645e0b1cbcc.jpg',
             'Width': 2048}],
 'price': 15499,
 'price_includes_vat': True,
 'registration_date': '2020-08-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 CRDi MHEV N Line DCT Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'N Line',
 'year': 2020}
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602039644497%27 HTTP/1.1" 200 None
2026-03-26 11:54:50 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602039644497: {'created_time': 1774526090.981953, 'last_price_update_time': 1774526090.981961}
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602039644497') HTTP/1.1" 204 0
2026-03-26 11:54:50 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 793adec0-ccc9-5cf1-ace7-360fd225325c with identifier 202601309559753
2026-03-26 11:54:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:51 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 793adec0-ccc9-5cf1-ace7-360fd225325c
2026-03-26 11:54:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/48c9eb74752e476ebb30334d44e72579.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'color': 'Grey',
 'currency': 'GBP',
 'description': '******************APPOINTMENTS ONLY********************This '
                '2020 Vauxhall Corsa Turbo SE is a superb example, having had '
                'only one owner from new and boasting a clear vehicle history '
                'check. This Euro 6 compliant 1.2 litre petrol model comes in '
                'the SE trim, offering a refined driving experience. You can '
                'stay connected and entertained with the Bluetooth mobile '
                'phone portal and Bluetooth A2DP audio streaming, while the '
                'LED headlights ensure excellent visibility. Comfort is '
                'assured with air conditioning, and parking is made easier '
                'thanks to the front camera system.\n'
                '\n'
                'The Corsa Turbo SE stands out with its impressive '
                'performance, achieving 0 to 60 miles per hour in just 9.3 '
                'seconds, demonstrating its responsiveness. Furthermore, its '
                'low CO2 emissions highlight its efficiency, making it a more '
                'environmentally conscious choice compared to many other '
                'vehicles in its class. This particular Corsa also comes with '
                'a 3 month warranty for your peace of mind.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 99,
 'fuel_type': 'Petrol',
 'id': '793adec0-ccc9-5cf1-ace7-360fd225325c',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601309559753',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Vauxhall',
 'model': 'Corsa',
 'odometer': 54000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 42,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_793adec0-ccc9-5cf1-ace7-360fd225325c/793adec0-ccc9-5cf1-ace7-360fd225325c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 423175,
             'Height': 1540,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/48c9eb74752e476ebb30334d44e72579.jpg',
             'Width': 2048}],
 'price': 7499,
 'price_includes_vat': True,
 'registration_date': '2020-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Corsa 1.2 Turbo SE Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'SE',
 'year': 2020}
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601309559753%27 HTTP/1.1" 200 None
2026-03-26 11:54:51 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601309559753: {'created_time': 1774526091.033503, 'last_price_update_time': 1774526091.033512}
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601309559753') HTTP/1.1" 204 0
2026-03-26 11:54:51 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 6ebf53fc-a0d7-5e9b-b9a6-a4543f2f5314 with identifier 202512108514159
2026-03-26 11:54:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:51 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 6ebf53fc-a0d7-5e9b-b9a6-a4543f2f5314
2026-03-26 11:54:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/3771bcee30824d70bd03fd6689e87ed6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Blue',
 'currency': 'GBP',
 'description': '*****************************APPOINTMENTS '
                'ONLY**********************This 2020 Volkswagen Golf eTSI Life '
                'presents a compelling proposition with its remarkably low '
                'mileage of just 37,000 miles for its age. This particular '
                'Golf is a 1.5 litre petrol hybrid, adhering to the Euro 6 '
                'emission class. It comes equipped with practical features '
                'designed for everyday convenience, including front and rear '
                'parking sensors with parking assistance, and a 1 zone air '
                'conditioning system. The vehicle also benefits from LED '
                'headlights that incorporate turn signals, and automatic '
                'headlight activation with a manual coming home and automatic '
                'leaving function.\n'
                '\n'
                'Experience a responsive drive with this Golf, capable of '
                'accelerating from 0 to 62 miles per hour in a swift 8.5 '
                'seconds. This performance, combined with its advanced '
                'features, sets it apart. The adaptive cruise control with '
                'speed limiter and front assist offers a more relaxed and '
                'safer driving experience, intelligently managing your speed '
                'and distance to the vehicle ahead. These elements '
                "collectively highlight the Golf eTSI Life's sophisticated "
                'engineering and thoughtful design, making it a distinguished '
                'choice.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 148,
 'fuel_type': 'Petrol Hybrid',
 'id': '6ebf53fc-a0d7-5e9b-b9a6-a4543f2f5314',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512108514159',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Volkswagen',
 'model': 'Golf',
 'odometer': 37000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 46,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ebf53fc-a0d7-5e9b-b9a6-a4543f2f5314/6ebf53fc-a0d7-5e9b-b9a6-a4543f2f5314_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336015,
             'Height': 1273,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/3771bcee30824d70bd03fd6689e87ed6.jpg',
             'Width': 2048}],
 'price': 14999,
 'price_includes_vat': True,
 'registration_date': '2020-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf 1.5 eTSI MHEV Life DSG Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2020}
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512108514159%27 HTTP/1.1" 200 None
2026-03-26 11:54:51 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512108514159: {'created_time': 1774526091.082278, 'last_price_update_time': 1774526091.082287}
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512108514159') HTTP/1.1" 204 0
2026-03-26 11:54:51 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 4930b0df-883c-5c54-96ca-3d44e2fb573c with identifier 202601299517146
2026-03-26 11:54:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:51 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 4930b0df-883c-5c54-96ca-3d44e2fb573c
2026-03-26 11:54:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/db902af8c93b4065889bd40fc7bb3aa2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 43,
 'color': 'Blue',
 'currency': 'GBP',
 'description': '**************************APPOINTMENTS '
                'ONLY**********************Discover this 2021 BMW X1 25e M '
                'Sport, a sophisticated plug in hybrid that offers an '
                'exceptional blend of performance and efficiency. This Four '
                'Wheel Drive model boasts a 1.5L Petrol Plug-in Hybrid engine, '
                "meeting Euro 6 emissions standards. Inside, you'll find the "
                'luxurious M Sport trim featuring Black perforated Dakota '
                'leather with striking blue contrast stitching. The vehicle is '
                'equipped with the Technology Pack I, which includes Bluetooth '
                'connectivity, LED headlights, a rear parking camera, and '
                'wireless phone charging. Additionally, the Comfort Pack II '
                'adds convenience with keyless entry, memory seats, and a '
                'heated steering wheel, while Technology Pack II enhances the '
                'driving experience with a Head Up Display. For added '
                'versatility, a detachable towbar is also fitted.\n'
                '\n'
                'This BMW X1 25e M Sport stands out with its comprehensive '
                'package of desirable features. The inclusion of both '
                'Technology Packs ensures you have access to the latest in '
                'driver assistance and infotainment, while the Comfort Pack II '
                'elevates the interior experience. The plug in hybrid '
                'technology provides an efficient way to drive, and the Four '
                'Wheel Drive system offers assured handling in various '
                'conditions. These elements combine to make this X1 a '
                'compelling choice for those seeking a premium, versatile, and '
                'technologically advanced compact SUV.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 217,
 'fuel_type': 'Petrol Plug-in Hybrid',
 'id': '4930b0df-883c-5c54-96ca-3d44e2fb573c',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601299517146',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 82000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 50,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4930b0df-883c-5c54-96ca-3d44e2fb573c/4930b0df-883c-5c54-96ca-3d44e2fb573c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 300211,
             'Height': 1310,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/db902af8c93b4065889bd40fc7bb3aa2.jpg',
             'Width': 2048}],
 'price': 12499,
 'price_includes_vat': True,
 'registration_date': '2021-09-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 25e 10kWh M Sport Auto xDrive Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601299517146%27 HTTP/1.1" 200 None
2026-03-26 11:54:51 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601299517146: {'created_time': 1774526091.13252, 'last_price_update_time': 1774526091.13253}
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601299517146') HTTP/1.1" 204 0
2026-03-26 11:54:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/e0733965caa7454e882d4fe0fe4a1b70.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/acfdbd8c9d4e4d20adc69ff04af8ebc1.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:51 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:51 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 5712a5e2-6706-5b9f-9f32-393aaf15c465 with identifier: 202510157165059
2026-03-26 11:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5712a5e2-6706-5b9f-9f32-393aaf15c465
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb9812afe7e254666af354c71a60db9a4.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b9812afe7e254666af354c71a60db9a4.jpg not downloaded yet
2026-03-26 11:54:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879e803110>
2026-03-26 11:54:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faa5c35f-df26-58d1-8aa2-bc08f8a3978f/faa5c35f-df26-58d1-8aa2-bc08f8a3978f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F821c884298454f3bbcc5bd59be26f852.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/821c884298454f3bbcc5bd59be26f852.jpg saved to cache
2026-03-26 11:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item faa5c35f-df26-58d1-8aa2-bc08f8a3978f
2026-03-26 11:54:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item faa5c35f-df26-58d1-8aa2-bc08f8a3978f sending to next pipeline
2026-03-26 11:54:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/e7136ac3c8cf42609d26a76933085b6a.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:51 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:51 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ef6b4f5-bcb6-57e8-b259-ed2d4de70d6f with identifier: 202509106220660
2026-03-26 11:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1ef6b4f5-bcb6-57e8-b259-ed2d4de70d6f
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff9b05e21eaed437b9b84ba42bc0515ca.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f9b05e21eaed437b9b84ba42bc0515ca.jpg not downloaded yet
2026-03-26 11:54:51 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: faa5c35f-df26-58d1-8aa2-bc08f8a3978f with identifier 202512058406853
2026-03-26 11:54:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:51 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item faa5c35f-df26-58d1-8aa2-bc08f8a3978f
2026-03-26 11:54:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/821c884298454f3bbcc5bd59be26f852.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'color': 'White',
 'currency': 'GBP',
 'description': '***************************APPOINTMENTS '
                'ONLY*************************This 2015 Toyota AYGO VVT-i '
                'x-pression offers excellent value with a 3 month warranty for '
                'your peace of mind. This stylish hatchback is equipped with a '
                '1.0L petrol engine and features the x-pression trim. Inside, '
                "you'll find convenient Bluetooth connectivity for handsfree "
                'calls and music streaming, along with air conditioning to '
                'keep you comfortable. Parking is made easier thanks to the '
                'integrated rear view camera with parking assistance.\n'
                '\n'
                'The AYGO x-pression stands out with its impressive fuel '
                'economy, achieving up to 69 miles per gallon, which is a '
                'significant advantage for keeping running costs down. '
                'Furthermore, its low insurance group rating means more '
                'savings on your premiums. The vehicle also boasts low CO2 '
                'emissions, highlighting its efficiency and environmental '
                'consideration compared to many other cars in its class.',
 'doors_number': 5,
 'emission_standard': 'Euro 5',
 'engine': '1L',
 'engine_horse_power': 67,
 'fuel_type': 'Petrol',
 'id': 'faa5c35f-df26-58d1-8aa2-bc08f8a3978f',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512058406853',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Toyota',
 'model': 'AYGO',
 'odometer': 59000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 43,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faa5c35f-df26-58d1-8aa2-bc08f8a3978f/faa5c35f-df26-58d1-8aa2-bc08f8a3978f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341746,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/821c884298454f3bbcc5bd59be26f852.jpg',
             'Width': 2048}],
 'price': 3499,
 'price_includes_vat': True,
 'registration_date': '2015-03-25',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 VVT-i x-pression Euro 5 5dr Euro 5',
 'transmission': 'manual',
 'trim': 'x-pression',
 'year': 2015}
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512058406853%27 HTTP/1.1" 200 None
2026-03-26 11:54:51 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512058406853: {'created_time': 1774526091.320743, 'last_price_update_time': 1774526091.320752}
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512058406853') HTTP/1.1" 204 0
2026-03-26 11:54:51 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:51 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e96cecb-e034-5ff3-9aaa-36df80d0d55d with identifier: 202508295858918
2026-03-26 11:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9e96cecb-e034-5ff3-9aaa-36df80d0d55d
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe9798adc6b4d4ac580faa7fd0f14572a.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e9798adc6b4d4ac580faa7fd0f14572a.jpg not downloaded yet
2026-03-26 11:54:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879e95fed0>
2026-03-26 11:54:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_718de9cb-0976-5c27-b962-9f83452bad72/718de9cb-0976-5c27-b962-9f83452bad72_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe0733965caa7454e882d4fe0fe4a1b70.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e0733965caa7454e882d4fe0fe4a1b70.jpg saved to cache
2026-03-26 11:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 718de9cb-0976-5c27-b962-9f83452bad72
2026-03-26 11:54:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 718de9cb-0976-5c27-b962-9f83452bad72 sending to next pipeline
2026-03-26 11:54:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879e803dd0>
2026-03-26 11:54:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3225160-91cf-5225-9d5e-e4e69360fad6/c3225160-91cf-5225-9d5e-e4e69360fad6_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Facfdbd8c9d4e4d20adc69ff04af8ebc1.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/acfdbd8c9d4e4d20adc69ff04af8ebc1.jpg saved to cache
2026-03-26 11:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3225160-91cf-5225-9d5e-e4e69360fad6
2026-03-26 11:54:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3225160-91cf-5225-9d5e-e4e69360fad6 sending to next pipeline
2026-03-26 11:54:51 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:54:51 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 55660ee3-a7cb-5daf-aca9-2e82633eb63e with identifier: 202506223760986
2026-03-26 11:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 55660ee3-a7cb-5daf-aca9-2e82633eb63e
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdeae476c5fb645b7b912a8cda17ed08d.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/deae476c5fb645b7b912a8cda17ed08d.jpg not downloaded yet
2026-03-26 11:54:51 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 718de9cb-0976-5c27-b962-9f83452bad72 with identifier 202512038317605
2026-03-26 11:54:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:51 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 718de9cb-0976-5c27-b962-9f83452bad72
2026-03-26 11:54:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/e0733965caa7454e882d4fe0fe4a1b70.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 86,
 'color': 'Black',
 'currency': 'GBP',
 'description': '***************************APPOINTMENTS '
                'ONLY********************This 2019 Toyota C-HR VVT-h Excel is '
                'presented with a clear vehicle history check, offering you '
                'peace of mind. This stylish hatchback features a 1.8L petrol '
                'hybrid engine, meeting Euro 6 emission standards. As an Excel '
                'trim model, it comes equipped with a range of desirable '
                'features including Adaptive Cruise Control, heated driver and '
                'front passenger seats, and a heated steering wheel for '
                'enhanced comfort. The Toyota Safety Sense suite, which '
                'includes Blind Spot Assistance, and Adaptive LED Headlights '
                'further contribute to a safe and convenient driving '
                'experience.\n'
                '\n'
                'The Toyota C-HR VVT-h Excel stands out with its impressive '
                'fuel economy, achieving a highlight of 58 mpg, which '
                'indicates it is more economical than many similar vehicles. '
                'Its low CO2 emissions and low insurance group also highlight '
                'its cost effectiveness and appeal to a wider range of '
                'drivers. This vehicle comes with a 3 month warranty and a 12 '
                'month MOT provided on purchase, ensuring it is ready for your '
                'journeys.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.8L',
 'engine_horse_power': 120,
 'fuel_type': 'Petrol Hybrid',
 'id': '718de9cb-0976-5c27-b962-9f83452bad72',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512038317605',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 65000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 46,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_718de9cb-0976-5c27-b962-9f83452bad72/718de9cb-0976-5c27-b962-9f83452bad72_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 422337,
             'Height': 1429,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/e0733965caa7454e882d4fe0fe4a1b70.jpg',
             'Width': 2048}],
 'price': 13499,
 'price_includes_vat': True,
 'registration_date': '2019-11-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota C-Hr 1.8 VVT-h Excel CVT Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Excel',
 'year': 2019}
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512038317605%27 HTTP/1.1" 200 None
2026-03-26 11:54:51 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512038317605: {'created_time': 1774526091.566857, 'last_price_update_time': 1774526091.566866}
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512038317605') HTTP/1.1" 204 0
2026-03-26 11:54:51 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c3225160-91cf-5225-9d5e-e4e69360fad6 with identifier 202601299516923
2026-03-26 11:54:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:51 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c3225160-91cf-5225-9d5e-e4e69360fad6
2026-03-26 11:54:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/acfdbd8c9d4e4d20adc69ff04af8ebc1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Black',
 'currency': 'GBP',
 'description': '****************APPOINTMENTS ONLY********************This '
                '2022 Volkswagen Golf TSI Life boasts a clear vehicle history '
                'check, offering you peace of mind. This Euro 6 compliant '
                'model features a 1.5 litre petrol engine and comes with a 3 '
                'month warranty. For added convenience, it includes a dusk '
                'sensor for automatic driving lights, LED self levelling '
                'headlights with daytime running lights, and front and rear '
                'parking sensors. Stay connected and entertained with the '
                'premium USB C cable offering Apple CarPlay and Android Auto '
                'compatibility, and enjoy a comfortable journey with the 1 '
                'zone electronic climate control.\n'
                '\n'
                'Experience impressive efficiency with this Golf, achieving a '
                'highlight of 52 miles per gallon, alongside low CO2 '
                'emissions. Its acceleration from 0 to 62 miles per hour in '
                'just 9.2 seconds demonstrates its capable performance. This '
                'model also offers generous boot space, making it practical '
                'for everyday use and longer trips. The MOT is valid until '
                'January 2027, further enhancing its appeal as a well '
                'maintained and ready to go vehicle.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 128,
 'fuel_type': 'Petrol',
 'id': 'c3225160-91cf-5225-9d5e-e4e69360fad6',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601299516923',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Volkswagen',
 'model': 'Golf',
 'odometer': 29000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 51,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3225160-91cf-5225-9d5e-e4e69360fad6/c3225160-91cf-5225-9d5e-e4e69360fad6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324201,
             'Height': 1283,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/acfdbd8c9d4e4d20adc69ff04af8ebc1.jpg',
             'Width': 2048}],
 'price': 14499,
 'price_includes_vat': True,
 'registration_date': '2022-11-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf 1.5 TSI Life Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2022}
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601299516923%27 HTTP/1.1" 200 None
2026-03-26 11:54:51 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601299516923: {'created_time': 1774526091.615139, 'last_price_update_time': 1774526091.61515}
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601299516923') HTTP/1.1" 204 0
2026-03-26 11:54:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/bddf4174fadb41788b345e7f58e980f4.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879e81d7d0>
2026-03-26 11:54:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7735f4b7-eedb-51a6-bdbb-9042bf44d5c4/7735f4b7-eedb-51a6-bdbb-9042bf44d5c4_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe7136ac3c8cf42609d26a76933085b6a.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e7136ac3c8cf42609d26a76933085b6a.jpg saved to cache
2026-03-26 11:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7735f4b7-eedb-51a6-bdbb-9042bf44d5c4
2026-03-26 11:54:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7735f4b7-eedb-51a6-bdbb-9042bf44d5c4 sending to next pipeline
2026-03-26 11:54:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/f6c96e5a25854bad83a2be25170b801f.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:51 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7735f4b7-eedb-51a6-bdbb-9042bf44d5c4 with identifier 202511268154863
2026-03-26 11:54:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:51 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7735f4b7-eedb-51a6-bdbb-9042bf44d5c4
2026-03-26 11:54:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/e7136ac3c8cf42609d26a76933085b6a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'White',
 'currency': 'GBP',
 'description': '******************************APPOINTMENTS '
                'ONLY***************************This 2023 Honda HR-V h i-MMD '
                'Elegance is a superb example, having had only one owner from '
                'new. This stylish SUV boasts a 1.5L Petrol Hybrid engine, '
                'meeting the Euro 6 emission class. For your peace of mind, it '
                'comes with a 3 month warranty and a fresh 12 month MOT will '
                "be provided upon purchase. Inside, you'll find a host of "
                'convenient features including Wireless Apple CarPlay, '
                'Bluetooth Hands Free Telephone, and Automatic Single Zone '
                'Climate Control. The Elegance trim also includes Adaptive '
                'Cruise Control and Heated Front Seats, ensuring a comfortable '
                'and connected driving experience.\n'
                '\n'
                'Experience the efficiency of this Honda HR-V, which achieves '
                'an impressive 52 mpg, a highlight that demonstrates its '
                'advantage over many other vehicles in its class. Furthermore, '
                'its low CO2 emissions contribute to a more environmentally '
                'conscious drive. This combination of excellent fuel economy '
                'and reduced emissions, alongside its single owner provenance '
                'and desirable features, makes this HR-V a truly compelling '
                'choice for those seeking a modern and economical compact SUV.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 129,
 'fuel_type': 'Petrol Hybrid',
 'id': '7735f4b7-eedb-51a6-bdbb-9042bf44d5c4',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511268154863',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Honda',
 'model': 'HR-V',
 'odometer': 55000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 48,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7735f4b7-eedb-51a6-bdbb-9042bf44d5c4/7735f4b7-eedb-51a6-bdbb-9042bf44d5c4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258130,
             'Height': 1358,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/e7136ac3c8cf42609d26a76933085b6a.jpg',
             'Width': 2048}],
 'price': 16999,
 'price_includes_vat': True,
 'registration_date': '2023-05-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda Hr-V 1.5 h i-MMD Elegance CVT Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2023}
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511268154863%27 HTTP/1.1" 200 None
2026-03-26 11:54:51 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511268154863: {'created_time': 1774526091.728972, 'last_price_update_time': 1774526091.72898}
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511268154863') HTTP/1.1" 204 0
2026-03-26 11:54:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/7352fdfcc8e54ee5b8c3fe42d8459be2.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87a05d6f50>
2026-03-26 11:54:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb3b6191-8a0f-563e-a9c6-89e7382b64ef/bb3b6191-8a0f-563e-a9c6-89e7382b64ef_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbddf4174fadb41788b345e7f58e980f4.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bddf4174fadb41788b345e7f58e980f4.jpg saved to cache
2026-03-26 11:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb3b6191-8a0f-563e-a9c6-89e7382b64ef
2026-03-26 11:54:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb3b6191-8a0f-563e-a9c6-89e7382b64ef sending to next pipeline
2026-03-26 11:54:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/b9812afe7e254666af354c71a60db9a4.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:51 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: bb3b6191-8a0f-563e-a9c6-89e7382b64ef with identifier 202511208023779
2026-03-26 11:54:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:51 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item bb3b6191-8a0f-563e-a9c6-89e7382b64ef
2026-03-26 11:54:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/bddf4174fadb41788b345e7f58e980f4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Grey',
 'currency': 'GBP',
 'description': '***************************APPOINTMENTS '
                'ONLY*********************Discover this exceptional 2016 '
                'Peugeot 2008 Allure, boasting remarkably low mileage for its '
                'age at just 23,000 miles, a testament to its careful '
                'ownership by only two previous keepers. This Euro 6 compliant '
                '1.2 litre petrol model offers a clear vehicle history and '
                "comes with a reassuring 3 months warranty. Inside, you'll "
                'appreciate the comfort of automatic dual zone climate control '
                'and the convenience of rear parking aid with rear sensors, '
                'making manoeuvring a breeze. The automatic headlights ensure '
                'optimal visibility, while Bluetooth connectivity allows for '
                'seamless audio streaming and hands free calls.\n'
                '\n'
                'This Peugeot 2008 Allure stands out with its impressive fuel '
                'economy, achieving a remarkable 64 miles per gallon, which '
                'indicates it is more economical than many similar vehicles. '
                'Furthermore, its low CO2 emissions and low insurance group '
                'highlight its cost effectiveness for everyday driving, making '
                'it a sensible choice for many motorists.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 81,
 'fuel_type': 'Petrol',
 'id': 'bb3b6191-8a0f-563e-a9c6-89e7382b64ef',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511208023779',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 23000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 49,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb3b6191-8a0f-563e-a9c6-89e7382b64ef/bb3b6191-8a0f-563e-a9c6-89e7382b64ef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316584,
             'Height': 1342,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/bddf4174fadb41788b345e7f58e980f4.jpg',
             'Width': 2048}],
 'price': 8499,
 'price_includes_vat': True,
 'registration_date': '2016-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure ETG Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2016}
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511208023779%27 HTTP/1.1" 200 None
2026-03-26 11:54:51 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511208023779: {'created_time': 1774526091.871633, 'last_price_update_time': 1774526091.871642}
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511208023779') HTTP/1.1" 204 0
2026-03-26 11:54:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879e8a63d0>
2026-03-26 11:54:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e8329ed-2f11-57a7-8a65-84ff9694d154/2e8329ed-2f11-57a7-8a65-84ff9694d154_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff6c96e5a25854bad83a2be25170b801f.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f6c96e5a25854bad83a2be25170b801f.jpg saved to cache
2026-03-26 11:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2e8329ed-2f11-57a7-8a65-84ff9694d154
2026-03-26 11:54:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2e8329ed-2f11-57a7-8a65-84ff9694d154 sending to next pipeline
2026-03-26 11:54:51 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2e8329ed-2f11-57a7-8a65-84ff9694d154 with identifier 202511057686600
2026-03-26 11:54:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:52 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2e8329ed-2f11-57a7-8a65-84ff9694d154
2026-03-26 11:54:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/f6c96e5a25854bad83a2be25170b801f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Red',
 'currency': 'GBP',
 'description': '********************************APPOINTMENTS '
                'ONLY*********************This 2022 Vauxhall Corsa Turbo '
                'Ultimate is presented with a full 12 months MOT provided on '
                'purchase, ensuring its roadworthiness. This Euro 6 compliant '
                '1.2 litre petrol model comes with a 3 month warranty for your '
                'peace of mind. The Ultimate trim level offers a sophisticated '
                'driving experience, enhanced by features such as front and '
                'rear parking distance sensors, a panoramic rear view camera '
                'for effortless manoeuvring, and automatic lighting control. '
                "Inside, you'll appreciate the comfort of a heated steering "
                'wheel and the convenience of the Multimedia Navi Pro system, '
                'which seamlessly integrates with Android Auto and Apple '
                'CarPlay, alongside Bluetooth connectivity.\n'
                '\n'
                'Experience impressive efficiency with this Corsa, achieving a '
                'highlight fuel economy of 58 miles per gallon and benefiting '
                'from low CO2 emissions. Its performance is equally '
                'noteworthy, with an acceleration of 0 to 60 miles per hour in '
                'just 9.3 seconds. These highlights demonstrate how this '
                'Vauxhall Corsa Turbo Ultimate offers a compelling combination '
                'of economy, technology, and driving dynamics compared to '
                'other vehicles in its class.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 99,
 'fuel_type': 'Petrol',
 'id': '2e8329ed-2f11-57a7-8a65-84ff9694d154',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511057686600',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Vauxhall',
 'model': 'Corsa',
 'odometer': 10000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 46,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e8329ed-2f11-57a7-8a65-84ff9694d154/2e8329ed-2f11-57a7-8a65-84ff9694d154_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338122,
             'Height': 1316,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/f6c96e5a25854bad83a2be25170b801f.jpg',
             'Width': 2048}],
 'price': 9999,
 'price_includes_vat': True,
 'registration_date': '2022-12-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Corsa 1.2 Turbo Ultimate Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Ultimate',
 'year': 2022}
2026-03-26 11:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511057686600%27 HTTP/1.1" 200 None
2026-03-26 11:54:52 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511057686600: {'created_time': 1774526092.025471, 'last_price_update_time': 1774526092.025482}
2026-03-26 11:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511057686600') HTTP/1.1" 204 0
2026-03-26 11:54:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87a05d7750>
2026-03-26 11:54:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32ab5536-8324-5528-8ed3-e1de9d03ca4f/32ab5536-8324-5528-8ed3-e1de9d03ca4f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7352fdfcc8e54ee5b8c3fe42d8459be2.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7352fdfcc8e54ee5b8c3fe42d8459be2.jpg saved to cache
2026-03-26 11:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 32ab5536-8324-5528-8ed3-e1de9d03ca4f
2026-03-26 11:54:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 32ab5536-8324-5528-8ed3-e1de9d03ca4f sending to next pipeline
2026-03-26 11:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/f9b05e21eaed437b9b84ba42bc0515ca.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/e9798adc6b4d4ac580faa7fd0f14572a.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:52 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 32ab5536-8324-5528-8ed3-e1de9d03ca4f with identifier 202510157166316
2026-03-26 11:54:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:52 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 32ab5536-8324-5528-8ed3-e1de9d03ca4f
2026-03-26 11:54:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/7352fdfcc8e54ee5b8c3fe42d8459be2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'White',
 'currency': 'GBP',
 'description': '***************************APPOINTMENTS '
                'ONL***********************This 2020 Kia Picanto 1.0L Petrol '
                'is presented with a clear vehicle history check, offering you '
                'peace of mind. As a Euro 6 compliant model, it benefits from '
                'low CO2 emissions. This particular Picanto comes with a 3 '
                'month warranty for added security and will be supplied with a '
                'full 12 months MOT upon purchase. It also features Automatic '
                'Headlight Control, ensuring your headlights turn on when '
                'needed.\n'
                '\n'
                'The Kia Picanto is known for its affordability and this model '
                'is no exception, being in a low insurance group. Its '
                'impressive fuel economy of 53 mpg means you can expect fewer '
                'trips to the petrol station, making it a cost effective '
                'choice for your daily journeys. These highlights demonstrate '
                'how this Picanto offers excellent value and efficiency '
                'compared to other vehicles in its class.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 66,
 'fuel_type': 'Petrol',
 'id': '32ab5536-8324-5528-8ed3-e1de9d03ca4f',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510157166316',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 44000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 43,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32ab5536-8324-5528-8ed3-e1de9d03ca4f/32ab5536-8324-5528-8ed3-e1de9d03ca4f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269269,
             'Height': 1366,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/7352fdfcc8e54ee5b8c3fe42d8459be2.jpg',
             'Width': 2048}],
 'price': 6499,
 'price_includes_vat': True,
 'registration_date': '2020-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Picanto 1.0 1 Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': '1',
 'year': 2020}
2026-03-26 11:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510157166316%27 HTTP/1.1" 200 None
2026-03-26 11:54:52 [auto_selling_autotrader.co.uk] INFO: Saving data for 202510157166316: {'created_time': 1774526092.739895, 'last_price_update_time': 1774526092.739906}
2026-03-26 11:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510157166316') HTTP/1.1" 204 0
2026-03-26 11:54:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879e9549d0>
2026-03-26 11:54:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5712a5e2-6706-5b9f-9f32-393aaf15c465/5712a5e2-6706-5b9f-9f32-393aaf15c465_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb9812afe7e254666af354c71a60db9a4.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b9812afe7e254666af354c71a60db9a4.jpg saved to cache
2026-03-26 11:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5712a5e2-6706-5b9f-9f32-393aaf15c465
2026-03-26 11:54:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5712a5e2-6706-5b9f-9f32-393aaf15c465 sending to next pipeline
2026-03-26 11:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/deae476c5fb645b7b912a8cda17ed08d.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:54:52 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 5712a5e2-6706-5b9f-9f32-393aaf15c465 with identifier 202510157165059
2026-03-26 11:54:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:52 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 5712a5e2-6706-5b9f-9f32-393aaf15c465
2026-03-26 11:54:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/b9812afe7e254666af354c71a60db9a4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'color': 'Red',
 'currency': 'GBP',
 'description': '********************APPOINTMENTS '
                'ONLY***********************This 2022 MG HS T GDI Excite '
                'presents an exceptional opportunity with its remarkably low '
                'mileage of just 16,000 miles, having been owned by only one '
                'careful keeper. This Euro 6 compliant 1.5 litre petrol model '
                'combines practicality with modern technology, featuring rear '
                'parking sensors for effortless manoeuvring, adaptive cruise '
                'control for relaxed journeys, and seamless smartphone '
                'integration with both Apple CarPlay and Android Auto. The '
                'Bluetooth connection further enhances your connectivity on '
                'the go.\n'
                '\n'
                'The MG HS T GDI Excite stands out with its impressive '
                'acceleration, reaching 0 to 60 miles per hour in a brisk 9.6 '
                'seconds, indicating a responsive driving experience. Its '
                'position within a low insurance group also highlights its '
                'cost effectiveness, making it an attractive choice for many '
                'drivers. This well maintained vehicle offers a compelling '
                'package of features and performance.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 160,
 'fuel_type': 'Petrol',
 'id': '5712a5e2-6706-5b9f-9f32-393aaf15c465',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510157165059',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'MG',
 'model': 'MG HS',
 'odometer': 16000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 47,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5712a5e2-6706-5b9f-9f32-393aaf15c465/5712a5e2-6706-5b9f-9f32-393aaf15c465_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351098,
             'Height': 1273,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/b9812afe7e254666af354c71a60db9a4.jpg',
             'Width': 2048}],
 'price': 13499,
 'price_includes_vat': True,
 'registration_date': '2022-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MG MG Hs 1.5 T-GDI Excite DCT Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Excite',
 'year': 2022}
2026-03-26 11:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510157165059%27 HTTP/1.1" 200 None
2026-03-26 11:54:52 [auto_selling_autotrader.co.uk] INFO: Saving data for 202510157165059: {'created_time': 1774526092.848678, 'last_price_update_time': 1774526092.848688}
2026-03-26 11:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510157165059') HTTP/1.1" 204 0
2026-03-26 11:54:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87a1d82e10>
2026-03-26 11:54:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ef6b4f5-bcb6-57e8-b259-ed2d4de70d6f/1ef6b4f5-bcb6-57e8-b259-ed2d4de70d6f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff9b05e21eaed437b9b84ba42bc0515ca.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f9b05e21eaed437b9b84ba42bc0515ca.jpg saved to cache
2026-03-26 11:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1ef6b4f5-bcb6-57e8-b259-ed2d4de70d6f
2026-03-26 11:54:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1ef6b4f5-bcb6-57e8-b259-ed2d4de70d6f sending to next pipeline
2026-03-26 11:54:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879e927c90>
2026-03-26 11:54:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e96cecb-e034-5ff3-9aaa-36df80d0d55d/9e96cecb-e034-5ff3-9aaa-36df80d0d55d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe9798adc6b4d4ac580faa7fd0f14572a.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e9798adc6b4d4ac580faa7fd0f14572a.jpg saved to cache
2026-03-26 11:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9e96cecb-e034-5ff3-9aaa-36df80d0d55d
2026-03-26 11:54:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9e96cecb-e034-5ff3-9aaa-36df80d0d55d sending to next pipeline
2026-03-26 11:54:53 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 1ef6b4f5-bcb6-57e8-b259-ed2d4de70d6f with identifier 202509106220660
2026-03-26 11:54:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:53 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 1ef6b4f5-bcb6-57e8-b259-ed2d4de70d6f
2026-03-26 11:54:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/f9b05e21eaed437b9b84ba42bc0515ca.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Black',
 'currency': 'GBP',
 'description': '*****************************APPOINTMENTS '
                'ONLY*****************This 2017 Land Rover Range Rover Evoque '
                'TD4 HSE Dynamic offers a superb blend of style and '
                'capability. As a Euro 6 compliant vehicle, it features a '
                'powerful yet efficient 2.0L Diesel engine paired with a Four '
                'Wheel Drive drivetrain, ensuring confident performance in all '
                'conditions. The HSE Dynamic trim level provides a luxurious '
                'experience, enhanced by desirable features such as heated '
                'front seats for comfort, front passenger seat memory for '
                'personalised driving positions, and Xenon headlamps with a '
                'distinctive LED signature for improved visibility and a '
                'modern look. Connectivity is made simple with Bluetooth audio '
                'streaming, and for added practicality, the vehicle includes '
                'hitching guidance, making towing easier.\n'
                '\n'
                'This Range Rover Evoque excels with its impressive fuel '
                'economy, achieving a highlight of 55 miles per gallon, which '
                'indicates it is more economical than many similar vehicles. '
                'Its acceleration is also noteworthy, reaching 0 to 60 miles '
                'per hour in just 8.5 seconds, demonstrating a strong '
                'performance. Furthermore, the vehicle boasts a large boot '
                'space, offering ample room for luggage or shopping, and its '
                'low CO2 emissions highlight its environmental consideration '
                'compared to other cars in its class.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 178,
 'fuel_type': 'Diesel',
 'id': '1ef6b4f5-bcb6-57e8-b259-ed2d4de70d6f',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509106220660',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Land Rover',
 'model': 'Range Rover Evoque',
 'odometer': 79000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 43,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ef6b4f5-bcb6-57e8-b259-ed2d4de70d6f/1ef6b4f5-bcb6-57e8-b259-ed2d4de70d6f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 412706,
             'Height': 1409,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/f9b05e21eaed437b9b84ba42bc0515ca.jpg',
             'Width': 2048}],
 'price': 10999,
 'price_includes_vat': True,
 'registration_date': '2017-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Evoque 2.0 TD4 HSE Dynamic Auto 4WD Euro 6 '
          '(s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'HSE Dynamic',
 'year': 2017}
2026-03-26 11:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509106220660%27 HTTP/1.1" 200 None
2026-03-26 11:54:53 [auto_selling_autotrader.co.uk] INFO: Saving data for 202509106220660: {'created_time': 1774526093.161378, 'last_price_update_time': 1774526093.161387}
2026-03-26 11:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509106220660') HTTP/1.1" 204 0
2026-03-26 11:54:53 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 9e96cecb-e034-5ff3-9aaa-36df80d0d55d with identifier 202508295858918
2026-03-26 11:54:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:53 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 9e96cecb-e034-5ff3-9aaa-36df80d0d55d
2026-03-26 11:54:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/e9798adc6b4d4ac580faa7fd0f14572a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 182,
 'color': 'Black',
 'currency': 'GBP',
 'description': '**************************APPOINTMENTS '
                'ONLY**********************Discover this 2009 Vauxhall '
                'Insignia Exclusiv, a well presented example of this popular '
                'family car.  Powered by a reliable 1.8 litre petrol engine, '
                'this Insignia offers a comfortable driving experience.  Its '
                'Exclusiv trim level ensures a good range of features for your '
                'convenience and enjoyment.\n'
                '\n'
                'This Vauxhall Insignia Exclusiv stands out with its '
                'exceptionally large boot space, providing ample room for '
                'luggage, shopping, or sports equipment, making it a practical '
                'choice for everyday life. Furthermore, its placement in a low '
                'insurance group indicates that running costs could be more '
                'affordable compared to similar vehicles, offering excellent '
                'value for money.',
 'doors_number': 5,
 'emission_standard': 'Euro 5',
 'engine': '1.8L',
 'engine_horse_power': 138,
 'fuel_type': 'Petrol',
 'id': '9e96cecb-e034-5ff3-9aaa-36df80d0d55d',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202508295858918',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'Vauxhall',
 'model': 'Insignia',
 'odometer': 127000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 32,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e96cecb-e034-5ff3-9aaa-36df80d0d55d/9e96cecb-e034-5ff3-9aaa-36df80d0d55d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308340,
             'Height': 1293,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/e9798adc6b4d4ac580faa7fd0f14572a.jpg',
             'Width': 2048}],
 'price': 999,
 'price_includes_vat': True,
 'registration_date': '2009-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Insignia 1.8 16V Exclusiv Euro 5 5dr',
 'transmission': 'manual',
 'trim': 'Exclusiv',
 'year': 2009}
2026-03-26 11:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508295858918%27 HTTP/1.1" 200 None
2026-03-26 11:54:53 [auto_selling_autotrader.co.uk] INFO: Saving data for 202508295858918: {'created_time': 1774526093.207641, 'last_price_update_time': 1774526093.207654}
2026-03-26 11:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202508295858918') HTTP/1.1" 204 0
2026-03-26 11:54:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:54:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f879e8a56d0>
2026-03-26 11:54:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:54:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:54:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:54:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55660ee3-a7cb-5daf-aca9-2e82633eb63e/55660ee3-a7cb-5daf-aca9-2e82633eb63e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdeae476c5fb645b7b912a8cda17ed08d.jpg') HTTP/1.1" 204 0
2026-03-26 11:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/deae476c5fb645b7b912a8cda17ed08d.jpg saved to cache
2026-03-26 11:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 55660ee3-a7cb-5daf-aca9-2e82633eb63e
2026-03-26 11:54:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 55660ee3-a7cb-5daf-aca9-2e82633eb63e sending to next pipeline
2026-03-26 11:54:53 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 55660ee3-a7cb-5daf-aca9-2e82633eb63e with identifier 202506223760986
2026-03-26 11:54:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:53 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 55660ee3-a7cb-5daf-aca9-2e82633eb63e
2026-03-26 11:54:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/deae476c5fb645b7b912a8cda17ed08d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'White',
 'currency': 'GBP',
 'description': '***********************APPOINTMENTS '
                'ONLY********************With a MOT valid until June 2026, '
                'this 2022 BMW 2 Series Gran Coupe 218i M Sport is ready to '
                'drive away. The M Sport trim adds a touch of sporty '
                'sophistication to this stylish vehicle, which is powered by a '
                'responsive 1.5L petrol engine and meets stringent Euro 6 '
                "emission standards. Inside, you'll find the luxurious "
                'Perforated Dakota Leather seats in Magma Red with Grey '
                'Highlight, creating a comfortable and visually striking '
                'cabin. Stay connected and entertained with Bluetooth audio '
                'streaming for compatible devices. Manoeuvring is made easy '
                'with Parking Assistant, including a rear camera and front and '
                'rear sensors, plus BMW Gesture Control.\n'
                '\n'
                'This BMW 2 Series Gran Coupe stands out with its impressive '
                'fuel economy of 49 mpg, meaning fewer trips to the petrol '
                'station. It also falls into a low insurance group and boasts '
                'low CO2 emissions, potentially saving you money on running '
                'costs compared to similar vehicles. For added peace of mind, '
                'this vehicle comes with a 3-month warranty.',
 'doors_number': 4,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 134,
 'fuel_type': 'Petrol',
 'id': '55660ee3-a7cb-5daf-aca9-2e82633eb63e',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202506223760986',
 'listing': 'directbuy',
 'location': 'Egham, Surrey',
 'make': 'BMW',
 'model': '2 Series Gran Coupe',
 'odometer': 57000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 49,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55660ee3-a7cb-5daf-aca9-2e82633eb63e/55660ee3-a7cb-5daf-aca9-2e82633eb63e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263567,
             'Height': 1141,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/deae476c5fb645b7b912a8cda17ed08d.jpg',
             'Width': 2048}],
 'price': 17499,
 'price_includes_vat': True,
 'registration_date': '2022-05-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2 Series Gran Coupe 1.5 218i M Sport DCT Euro 6 (s/s) 4dr',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2022}
2026-03-26 11:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202506223760986%27 HTTP/1.1" 200 None
2026-03-26 11:54:53 [auto_selling_autotrader.co.uk] INFO: Saving data for 202506223760986: {'created_time': 1774526093.33221, 'last_price_update_time': 1774526093.33222}
2026-03-26 11:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202506223760986') HTTP/1.1" 204 0
2026-03-26 11:54:53 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-26 11:54:53 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close cursor: 'SaveToCdlqDbAutoSelling' object has no attribute 'cursor'
2026-03-26 11:54:53 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close connection: 'SaveToCdlqDbAutoSelling' object has no attribute 'conn'
2026-03-26 11:54:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:54:53 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process scrape complete CloudEvent for item 8c3c21fe290a11f18f76c264925fbcfa
2026-03-26 11:54:53 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 11:54:53 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 11:54:53 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 11:54:53 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 11:54:53 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 11:54:53 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.MAPPED: 3> -> <SessionState.END_SENT: 4>
2026-03-26 11:54:53 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPENED: 9> -> <ConnectionState.CLOSE_SENT: 11>
2026-03-26 11:54:53 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.CLOSE_SENT: 11> -> <ConnectionState.END: 13>
2026-03-26 11:54:53 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.END_SENT: 4> -> <SessionState.DISCARDING: 6>
2026-03-26 11:54:53 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 11:54:53 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 11:54:53 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 11:54:53 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 11:54:53 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 11:54:53 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: [AzureBusPipeline] connection closed
2026-03-26 11:54:53 [auto_selling_autotrader.co.uk] INFO: auto_selling_autotrader.co.uk Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 8, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2026-03-26 11:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20last_price_update_time%20lt%201773230093 HTTP/1.1" 200 None
2026-03-26 11:54:54 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (48 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto_selling_autotrader.co.uk/8c3c21fe290a11f18f76c264925fbcfa.jl
2026-03-26 11:54:54 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 388966,
 'downloader/request_count': 56,
 'downloader/request_method_count/GET': 48,
 'downloader/request_method_count/POST': 8,
 'downloader/response_bytes': 18588323,
 'downloader/response_count': 56,
 'downloader/response_status_count/200': 56,
 'elapsed_time_seconds': 19.04831,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 26, 11, 54, 53, 919458, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 48,
 'log_count/DEBUG': 860,
 'log_count/INFO': 745,
 'memusage/max': 146956288,
 'memusage/startup': 146956288,
 'photo_download_count': 48,
 'request_depth_max': 4,
 'response_received_count': 8,
 'scheduler/dequeued': 56,
 'scheduler/dequeued/memory': 56,
 'scheduler/enqueued': 56,
 'scheduler/enqueued/memory': 56,
 'scrape_type/new': 48,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 8,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 1.7048448750865646,
 'scrapy-zyte-api/mean_response_seconds': 2.057180567935575,
 'scrapy-zyte-api/processed': 8,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 8,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 7,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 8,
 'scrapy-zyte-api/request_args/httpRequestBody': 8,
 'scrapy-zyte-api/request_args/httpRequestMethod': 8,
 'scrapy-zyte-api/request_args/httpResponseBody': 8,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 8,
 'scrapy-zyte-api/request_args/url': 8,
 'scrapy-zyte-api/status_codes/200': 8,
 'scrapy-zyte-api/success': 8,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2026, 3, 26, 11, 54, 34, 871148, tzinfo=datetime.timezone.utc)}
2026-03-26 11:54:54 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-26 11:54:54 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f87a1d8f6d0>
2026-03-26 11:54:54 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f87a1d8ff50>