2026-03-26 09:56:39 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-26 09:56:39 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-26 09:56:39 [auto_selling_autotrader.co.uk] INFO: Starting auto_selling_autotrader.co.uk spider
2026-03-26 09:56:39 [auto_selling_autotrader.co.uk] INFO: Quick mode enabled: batching detail requests in groups of 10
2026-03-26 09:56:39 [auto_selling_autotrader.co.uk] INFO: Limiting photo downloads to 1 per item
2026-03-26 09:56:39 [auto_selling_autotrader.co.uk] INFO: _job: 134b8c3628fa11f18f76c264925fbcfa, SCRAPY_JOB: None
2026-03-26 09:56:39 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-26 09:56:39 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-26 09:56:39 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-26 09:56:39 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-26 09:56:39 [scrapy.extensions.telnet] INFO: Telnet Password: 4452812f1a25372a
2026-03-26 09:56:39 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-26 09:56:39 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 3600,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto_selling_autotrader.co.uk/134b8c3628fa11f18f76c264925fbcfa.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-26 09:56:39 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-26 09:56:39 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-26 09:56:39 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-26 09:56:39 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware for auto_selling
2026-03-26 09:56:39 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.auto_selling.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-26 09:56:39 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.post_to_azurebus_auto_selling.AzureBusPipelineAutoSelling',
'crawlers.pipelines.save_to_cdlq_db_auto_selling.SaveToCdlqDbAutoSelling']
2026-03-26 09:56:39 [scrapy.core.engine] INFO: Spider opened
2026-03-26 09:56:39 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-26 09:56:39 [common.service_bus.service_bus_client_factory] INFO: ServiceBusClient initialized via DefaultAzureCredential for alx-production-bus.servicebus.windows.net
2026-03-26 09:56:39 [crawlers.pipelines.base_azure_bus_pipeline] INFO: [AzureBusPipeline] Connected to topic auto.sourcing-v2-quickmode
2026-03-26 09:56:39 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-26 09:56:39 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-26 09:56:39 [scrapy.extensions.memusage] INFO: Peak memory usage is 140MiB
2026-03-26 09:56:39 [scrapy-playwright] INFO: Starting download handler
2026-03-26 09:56:39 [scrapy-playwright] INFO: Starting download handler
2026-03-26 09:56:44 [auto_selling_autotrader.co.uk] INFO: Scraper started with retailer ID: 392172 and multipost_profile_id: b7917232-bbf0-444e-bcb7-ff49d6dd1e29 and job_id: 134b8c3628fa11f18f76c264925fbcfa and url: https://www.autotrader.co.uk/dealers/arc-car-centre-392172
2026-03-26 09:56:44 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 392172, page: 1
2026-03-26 09:56:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 09:56:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: None) ['zyte-api']
2026-03-26 09:56:46 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-26 09:56:46 [auto_selling_autotrader.co.uk] INFO: Page: 1/3, total results: 42
2026-03-26 09:56:46 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-26 09:56:46 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230942602%27 HTTP/1.1" 200 None
2026-03-26 09:56:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603230942602: 1
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230942544%27 HTTP/1.1" 200 None
2026-03-26 09:56:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603230942544: 1
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230942459%27 HTTP/1.1" 200 None
2026-03-26 09:56:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603230942459: 1
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230942331%27 HTTP/1.1" 200 None
2026-03-26 09:56:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603230942331: 1
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230942039%27 HTTP/1.1" 200 None
2026-03-26 09:56:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603230942039: 1
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603170785203%27 HTTP/1.1" 200 None
2026-03-26 09:56:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603170785203: 1
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110619930%27 HTTP/1.1" 200 None
2026-03-26 09:56:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603110619930: 1
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110619839%27 HTTP/1.1" 200 None
2026-03-26 09:56:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603110619839: 1
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040414781%27 HTTP/1.1" 200 None
2026-03-26 09:56:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603040414781: 1
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040414711%27 HTTP/1.1" 200 None
2026-03-26 09:56:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603040414711: 1
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040412487%27 HTTP/1.1" 200 None
2026-03-26 09:56:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603040412487: 1
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602270270824%27 HTTP/1.1" 200 None
2026-03-26 09:56:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602270270824: 1
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602250220778%27 HTTP/1.1" 200 None
2026-03-26 09:56:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602250220778: 1
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602250220684%27 HTTP/1.1" 200 None
2026-03-26 09:56:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602250220684: 1
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602250217647%27 HTTP/1.1" 200 None
2026-03-26 09:56:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602250217647: 1
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602250217290%27 HTTP/1.1" 200 None
2026-03-26 09:56:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602250217290: 1
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602200095095%27 HTTP/1.1" 200 None
2026-03-26 09:56:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602200095095: 1
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602200094909%27 HTTP/1.1" 200 None
2026-03-26 09:56:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602200094909: 1
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602200094638%27 HTTP/1.1" 200 None
2026-03-26 09:56:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602200094638: 1
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602190068491%27 HTTP/1.1" 200 None
2026-03-26 09:56:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602190068491: 1
2026-03-26 09:56:46 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-26 09:56:46 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-26 09:56:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 09:56:46 [auto_selling_autotrader.co.uk] INFO: Getting next page: 2
2026-03-26 09:56:46 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 392172, page: 2
2026-03-26 09:56:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 09:56:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 09:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 09:56:48 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-26 09:56:48 [auto_selling_autotrader.co.uk] INFO: Page: 2/3, total results: 42
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602109829578%27 HTTP/1.1" 200 None
2026-03-26 09:56:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602109829578: 1
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602059708621%27 HTTP/1.1" 200 None
2026-03-26 09:56:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602059708621: 1
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602059708271%27 HTTP/1.1" 200 None
2026-03-26 09:56:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602059708271: 1
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602029599747%27 HTTP/1.1" 200 None
2026-03-26 09:56:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602029599747: 1
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601259413634%27 HTTP/1.1" 200 None
2026-03-26 09:56:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601259413634: 1
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601229353671%27 HTTP/1.1" 200 None
2026-03-26 09:56:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601229353671: 1
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601229329531%27 HTTP/1.1" 200 None
2026-03-26 09:56:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601229329531: 1
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601219323649%27 HTTP/1.1" 200 None
2026-03-26 09:56:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601219323649: 1
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601209274802%27 HTTP/1.1" 200 None
2026-03-26 09:56:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601209274802: 1
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601199266001%27 HTTP/1.1" 200 None
2026-03-26 09:56:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601199266001: 1
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601169202939%27 HTTP/1.1" 200 None
2026-03-26 09:56:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601169202939: 1
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601099036863%27 HTTP/1.1" 200 None
2026-03-26 09:56:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601099036863: 1
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512058399904%27 HTTP/1.1" 200 None
2026-03-26 09:56:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512058399904: 1
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512048352833%27 HTTP/1.1" 200 None
2026-03-26 09:56:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512048352833: 1
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511238082124%27 HTTP/1.1" 200 None
2026-03-26 09:56:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511238082124: 1
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511177949989%27 HTTP/1.1" 200 None
2026-03-26 09:56:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511177949989: 1
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511157910608%27 HTTP/1.1" 200 None
2026-03-26 09:56:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511157910608: 1
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511047654940%27 HTTP/1.1" 200 None
2026-03-26 09:56:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511047654940: 1
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510297507401%27 HTTP/1.1" 200 None
2026-03-26 09:56:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202510297507401: 1
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509015951706%27 HTTP/1.1" 200 None
2026-03-26 09:56:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202509015951706: 1
2026-03-26 09:56:48 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-26 09:56:48 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-26 09:56:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 09:56:48 [auto_selling_autotrader.co.uk] INFO: Getting next page: 3
2026-03-26 09:56:48 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 392172, page: 3
2026-03-26 09:56:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 09:56:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 09:56:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 09:56:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b8719d96-5a0d-55f6-909e-5a896d515f62 with identifier: 202603230942602
2026-03-26 09:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b8719d96-5a0d-55f6-909e-5a896d515f62
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb467411d5a4743e684d4a777d5419695.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b467411d5a4743e684d4a777d5419695.jpg not downloaded yet
2026-03-26 09:56:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b7caa6fb-355b-5386-b63f-44d994bf01b8 with identifier: 202603230942544
2026-03-26 09:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b7caa6fb-355b-5386-b63f-44d994bf01b8
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4268ef3c6875497d9fa4f8819d82b13f.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4268ef3c6875497d9fa4f8819d82b13f.jpg not downloaded yet
2026-03-26 09:56:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 8dd92275-45f4-5408-ba1f-45b2a97a1e4b with identifier: 202603230942459
2026-03-26 09:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8dd92275-45f4-5408-ba1f-45b2a97a1e4b
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4268ef3c6875497d9fa4f8819d82b13f.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4268ef3c6875497d9fa4f8819d82b13f.jpg not downloaded yet
2026-03-26 09:56:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: bd545b12-9532-56d0-90e1-eb8fc2f63f25 with identifier: 202603230942331
2026-03-26 09:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bd545b12-9532-56d0-90e1-eb8fc2f63f25
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4268ef3c6875497d9fa4f8819d82b13f.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4268ef3c6875497d9fa4f8819d82b13f.jpg not downloaded yet
2026-03-26 09:56:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c516251-f745-55eb-9a9c-c1bef6eb674e with identifier: 202603230942039
2026-03-26 09:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0c516251-f745-55eb-9a9c-c1bef6eb674e
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4268ef3c6875497d9fa4f8819d82b13f.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4268ef3c6875497d9fa4f8819d82b13f.jpg not downloaded yet
2026-03-26 09:56:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 4de39529-d431-57d8-b199-78104acc0139 with identifier: 202603170785203
2026-03-26 09:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4de39529-d431-57d8-b199-78104acc0139
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4268ef3c6875497d9fa4f8819d82b13f.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4268ef3c6875497d9fa4f8819d82b13f.jpg not downloaded yet
2026-03-26 09:56:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c52d46f-0f6b-532f-b16e-768d201a4bcf with identifier: 202603110619930
2026-03-26 09:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2c52d46f-0f6b-532f-b16e-768d201a4bcf
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6124d1d5255f41f5bccc5a98dbb7ba1e.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6124d1d5255f41f5bccc5a98dbb7ba1e.jpg not downloaded yet
2026-03-26 09:56:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ba5030b-445c-5fac-9d61-797dce3f8af1 with identifier: 202603110619839
2026-03-26 09:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3ba5030b-445c-5fac-9d61-797dce3f8af1
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9d278090be5c4cef8107c1a972f3465b.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9d278090be5c4cef8107c1a972f3465b.jpg not downloaded yet
2026-03-26 09:56:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 502307bf-f13c-5e59-ab05-10b9b92516f9 with identifier: 202603040414781
2026-03-26 09:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 502307bf-f13c-5e59-ab05-10b9b92516f9
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4329e3d6c2744f238950b7cafac3d72c.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4329e3d6c2744f238950b7cafac3d72c.jpg not downloaded yet
2026-03-26 09:56:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 70d9506c-f18c-55d4-a04e-789cd690f5c0 with identifier: 202603040414711
2026-03-26 09:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 70d9506c-f18c-55d4-a04e-789cd690f5c0
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F09bcd20bdbd44841b64664f89257beea.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/09bcd20bdbd44841b64664f89257beea.jpg not downloaded yet
2026-03-26 09:56:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 09:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/4268ef3c6875497d9fa4f8819d82b13f.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/4268ef3c6875497d9fa4f8819d82b13f.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/4268ef3c6875497d9fa4f8819d82b13f.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/4268ef3c6875497d9fa4f8819d82b13f.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/4268ef3c6875497d9fa4f8819d82b13f.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/b467411d5a4743e684d4a777d5419695.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/09bcd20bdbd44841b64664f89257beea.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:49 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:49 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c4aff77-fc80-52b5-ab2b-210f2b6e1be2 with identifier: 202603040412487
2026-03-26 09:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8c4aff77-fc80-52b5-ab2b-210f2b6e1be2
2026-03-26 09:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbb61a132b0164401a57086e17dc51a44.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bb61a132b0164401a57086e17dc51a44.jpg not downloaded yet
2026-03-26 09:56:49 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:49 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ac90d288-7bdf-586a-8f61-2ee75005478c with identifier: 202602270270824
2026-03-26 09:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ac90d288-7bdf-586a-8f61-2ee75005478c
2026-03-26 09:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb5b81239ef504725bc3ac04288994b6b.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b5b81239ef504725bc3ac04288994b6b.jpg not downloaded yet
2026-03-26 09:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/9d278090be5c4cef8107c1a972f3465b.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/6124d1d5255f41f5bccc5a98dbb7ba1e.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:49 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:49 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 178b9381-b340-5960-be09-724a0612d9c4 with identifier: 202602250220778
2026-03-26 09:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 178b9381-b340-5960-be09-724a0612d9c4
2026-03-26 09:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Faaa9aebe294b475e9597ad9a92427d24.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/aaa9aebe294b475e9597ad9a92427d24.jpg not downloaded yet
2026-03-26 09:56:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-26 09:56:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-26 09:56:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f2363e10>
2026-03-26 09:56:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-26 09:56:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-26 09:56:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-26 09:56:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dd92275-45f4-5408-ba1f-45b2a97a1e4b/8dd92275-45f4-5408-ba1f-45b2a97a1e4b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4268ef3c6875497d9fa4f8819d82b13f.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4268ef3c6875497d9fa4f8819d82b13f.jpg saved to cache
2026-03-26 09:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8dd92275-45f4-5408-ba1f-45b2a97a1e4b
2026-03-26 09:56:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8dd92275-45f4-5408-ba1f-45b2a97a1e4b sending to next pipeline
2026-03-26 09:56:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f243f250>
2026-03-26 09:56:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd545b12-9532-56d0-90e1-eb8fc2f63f25/bd545b12-9532-56d0-90e1-eb8fc2f63f25_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4268ef3c6875497d9fa4f8819d82b13f.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4268ef3c6875497d9fa4f8819d82b13f.jpg saved to cache
2026-03-26 09:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bd545b12-9532-56d0-90e1-eb8fc2f63f25
2026-03-26 09:56:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bd545b12-9532-56d0-90e1-eb8fc2f63f25 sending to next pipeline
2026-03-26 09:56:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f2377a90>
2026-03-26 09:56:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7caa6fb-355b-5386-b63f-44d994bf01b8/b7caa6fb-355b-5386-b63f-44d994bf01b8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4268ef3c6875497d9fa4f8819d82b13f.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4268ef3c6875497d9fa4f8819d82b13f.jpg saved to cache
2026-03-26 09:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b7caa6fb-355b-5386-b63f-44d994bf01b8
2026-03-26 09:56:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b7caa6fb-355b-5386-b63f-44d994bf01b8 sending to next pipeline
2026-03-26 09:56:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f2387bd0>
2026-03-26 09:56:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c516251-f745-55eb-9a9c-c1bef6eb674e/0c516251-f745-55eb-9a9c-c1bef6eb674e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4268ef3c6875497d9fa4f8819d82b13f.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4268ef3c6875497d9fa4f8819d82b13f.jpg saved to cache
2026-03-26 09:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0c516251-f745-55eb-9a9c-c1bef6eb674e
2026-03-26 09:56:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0c516251-f745-55eb-9a9c-c1bef6eb674e sending to next pipeline
2026-03-26 09:56:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f23af490>
2026-03-26 09:56:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4de39529-d431-57d8-b199-78104acc0139/4de39529-d431-57d8-b199-78104acc0139_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4268ef3c6875497d9fa4f8819d82b13f.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4268ef3c6875497d9fa4f8819d82b13f.jpg saved to cache
2026-03-26 09:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4de39529-d431-57d8-b199-78104acc0139
2026-03-26 09:56:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4de39529-d431-57d8-b199-78104acc0139 sending to next pipeline
2026-03-26 09:56:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f2376050>
2026-03-26 09:56:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8719d96-5a0d-55f6-909e-5a896d515f62/b8719d96-5a0d-55f6-909e-5a896d515f62_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb467411d5a4743e684d4a777d5419695.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b467411d5a4743e684d4a777d5419695.jpg saved to cache
2026-03-26 09:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b8719d96-5a0d-55f6-909e-5a896d515f62
2026-03-26 09:56:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b8719d96-5a0d-55f6-909e-5a896d515f62 sending to next pipeline
2026-03-26 09:56:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f2548390>
2026-03-26 09:56:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70d9506c-f18c-55d4-a04e-789cd690f5c0/70d9506c-f18c-55d4-a04e-789cd690f5c0_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F09bcd20bdbd44841b64664f89257beea.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/09bcd20bdbd44841b64664f89257beea.jpg saved to cache
2026-03-26 09:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 70d9506c-f18c-55d4-a04e-789cd690f5c0
2026-03-26 09:56:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 70d9506c-f18c-55d4-a04e-789cd690f5c0 sending to next pipeline
2026-03-26 09:56:50 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:50 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ed8d4e3-882e-5de0-9046-bc068658d49b with identifier: 202602250220684
2026-03-26 09:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1ed8d4e3-882e-5de0-9046-bc068658d49b
2026-03-26 09:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4268ef3c6875497d9fa4f8819d82b13f.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4268ef3c6875497d9fa4f8819d82b13f.jpg already downloaded
2026-03-26 09:56:50 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 8dd92275-45f4-5408-ba1f-45b2a97a1e4b with identifier 202603230942459
2026-03-26 09:56:50 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: None -> <ConnectionState.START: 0>
2026-03-26 09:56:50 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.START: 0> -> <ConnectionState.HDR_SENT: 2>
2026-03-26 09:56:50 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.HDR_SENT: 2>
2026-03-26 09:56:50 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.OPEN_PIPE: 4>
2026-03-26 09:56:50 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.UNMAPPED: 0> -> <SessionState.BEGIN_SENT: 1>
2026-03-26 09:56:50 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-26 09:56:50 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-26 09:56:50 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-26 09:56:50 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-26 09:56:50 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_PIPE: 4> -> <ConnectionState.OPEN_SENT: 7>
2026-03-26 09:56:50 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_SENT: 7> -> <ConnectionState.OPENED: 9>
2026-03-26 09:56:50 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.BEGIN_SENT: 1> -> <SessionState.MAPPED: 3>
2026-03-26 09:56:50 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-26 09:56:50 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-26 09:56:50 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-26 09:56:50 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-26 09:56:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS completed opening with status: <ManagementOpenResult.OK: 1>
2026-03-26 09:56:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-26 09:56:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2013
2026-03-26 09:56:50 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-26 09:56:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774519010
2026-03-26 09:56:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774519010
2026-03-26 09:56:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS Put token result (<ManagementExecuteOperationResult.OK: 0>), status code: 202, status_description: b'Accepted'.
2026-03-26 09:56:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:51 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-26 09:56:51 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-26 09:56:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:51 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 8dd92275-45f4-5408-ba1f-45b2a97a1e4b
2026-03-26 09:56:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/4268ef3c6875497d9fa4f8819d82b13f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 110,
'color': 'Grey',
'currency': 'GBP',
'description': 'This 2011 Citroen C4 HDi VTR+ presents an exceptional '
'opportunity with its remarkably low mileage of just 70,000 '
'miles, especially for a vehicle of its age, and boasts an MOT '
'valid until June 2026. Cambelt & Water pump done @ 67,369 '
'miles on 05/03/2025. 2 keys, only £20.00 pound tax a year. '
'Last owner since 2019. This VTR+ variant is equipped with a '
'1.6 litre diesel engine, offering a compelling blend of '
"efficiency and performance. Inside, you'll find convenient "
'features such as Air Conditioning to keep you comfortable, a '
'Connecting Box with Bluetooth for seamless phone integration, '
'and Rear Parking Sensors to assist with manoeuvring.\n'
'\n'
'The highlights of this Citroen C4 truly set it apart. Its '
'impressive fuel economy of 71 mpg means fewer trips to the '
'petrol station, making it an economical choice for daily '
'driving. Furthermore, its low CO2 emissions contribute to a '
'more environmentally friendly footprint. The low insurance '
'group rating also suggests that running costs will be kept to '
'a minimum. Adding to its practicality, this C4 offers '
'generous boot space, perfect for shopping trips or luggage, '
'making it a versatile and sensible option.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.6L',
'engine_horse_power': 89,
'fuel_type': 'Diesel',
'id': '8dd92275-45f4-5408-ba1f-45b2a97a1e4b',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603230942459',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'Citroen',
'model': 'C4',
'odometer': 70000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 1,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dd92275-45f4-5408-ba1f-45b2a97a1e4b/8dd92275-45f4-5408-ba1f-45b2a97a1e4b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 283617,
'Height': 1152,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4268ef3c6875497d9fa4f8819d82b13f.jpg',
'Width': 1728}],
'price': 2400,
'price_includes_vat': True,
'registration_date': '2011-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 1.6 HDi 16V VTR+ Euro 5 5dr',
'transmission': 'manual',
'trim': 'VTR+',
'year': 2011}
2026-03-26 09:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230942459%27 HTTP/1.1" 200 None
2026-03-26 09:56:51 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603230942459: {'created_time': 1774519011.137565, 'last_price_update_time': 1774519011.137577}
2026-03-26 09:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603230942459') HTTP/1.1" 204 0
2026-03-26 09:56:51 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: bd545b12-9532-56d0-90e1-eb8fc2f63f25 with identifier 202603230942331
2026-03-26 09:56:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:51 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item bd545b12-9532-56d0-90e1-eb8fc2f63f25
2026-03-26 09:56:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/4268ef3c6875497d9fa4f8819d82b13f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 109,
'color': 'Blue',
'currency': 'GBP',
'description': 'This 2015 Ford Focus TDCi Titanium presents an exceptional '
'opportunity with its MOT valid until August 2026 and a full '
'service history, most recently serviced on 29th July 2025 at '
'76,655 miles with 11 Service stamps, £20.00 Tax A year. This '
'1.6L diesel model boasts a clear vehicle history check and a '
"low mileage of just 85,000 miles for its age. Inside, you'll "
'find convenient features such as automatic headlights, '
'Bluetooth for audio streaming, rear parking sensors, and '
'electronic automatic temperature control for a comfortable '
'driving experience.\n'
'\n'
'The Ford Focus TDCi Titanium stands out with its low '
'insurance group, making it an economical choice for many '
'drivers. Furthermore, its generous boot space offers '
'practicality for everyday needs and longer journeys. These '
'highlights demonstrate how this particular Focus offers '
'excellent value and capability compared to other vehicles in '
'its class.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.6L',
'engine_horse_power': 113,
'fuel_type': 'Diesel',
'id': 'bd545b12-9532-56d0-90e1-eb8fc2f63f25',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603230942331',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'Ford',
'model': 'Focus',
'odometer': 85000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 1,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd545b12-9532-56d0-90e1-eb8fc2f63f25/bd545b12-9532-56d0-90e1-eb8fc2f63f25_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 283617,
'Height': 1152,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4268ef3c6875497d9fa4f8819d82b13f.jpg',
'Width': 1728}],
'price': 5195,
'price_includes_vat': True,
'registration_date': '2015-05-20',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 1.6 TDCi Titanium Euro 5 (s/s) 5dr',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2015}
2026-03-26 09:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230942331%27 HTTP/1.1" 200 None
2026-03-26 09:56:51 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603230942331: {'created_time': 1774519011.485384, 'last_price_update_time': 1774519011.485393}
2026-03-26 09:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603230942331') HTTP/1.1" 204 0
2026-03-26 09:56:51 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b7caa6fb-355b-5386-b63f-44d994bf01b8 with identifier 202603230942544
2026-03-26 09:56:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:51 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b7caa6fb-355b-5386-b63f-44d994bf01b8
2026-03-26 09:56:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/4268ef3c6875497d9fa4f8819d82b13f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 129,
'color': 'Silver',
'currency': 'GBP',
'description': 'Benefit from a full 12 months MOT included with this Vauxhall '
'Corsa SXi, a 2013 model that is ready for its next owner. '
'This 1.2 litre petrol hatchback offers a comfortable driving '
'experience, enhanced by its air conditioning system. With '
'partial service history documented, the last service was '
'completed on 1st April 2025 at 86,061 miles, providing a '
'clear record of its maintenance with 9 service stamps, 2 '
'keys.\n'
'\n'
'This Vauxhall Corsa SXi stands out with its low insurance '
'group, making it a cost effective choice for many drivers. '
'The inclusion of air conditioning ensures a pleasant cabin '
'environment in all weather conditions. These factors, '
'combined with the comprehensive MOT, highlight the value and '
'appeal of this particular Corsa.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.2L',
'engine_horse_power': 84,
'fuel_type': 'Petrol',
'id': 'b7caa6fb-355b-5386-b63f-44d994bf01b8',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603230942544',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'Vauxhall',
'model': 'Corsa',
'odometer': 89000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 1,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7caa6fb-355b-5386-b63f-44d994bf01b8/b7caa6fb-355b-5386-b63f-44d994bf01b8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 283617,
'Height': 1152,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4268ef3c6875497d9fa4f8819d82b13f.jpg',
'Width': 1728}],
'price': 2395,
'price_includes_vat': True,
'registration_date': '2013-10-15',
'seats_number': 5,
'seller_name': None,
'title': 'Vauxhall Corsa 1.2 16V SXi Euro 5 5dr (A/C)',
'transmission': 'manual',
'trim': 'SXi',
'year': 2013}
2026-03-26 09:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230942544%27 HTTP/1.1" 200 None
2026-03-26 09:56:51 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603230942544: {'created_time': 1774519011.533279, 'last_price_update_time': 1774519011.533287}
2026-03-26 09:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603230942544') HTTP/1.1" 204 0
2026-03-26 09:56:51 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 0c516251-f745-55eb-9a9c-c1bef6eb674e with identifier 202603230942039
2026-03-26 09:56:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:51 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 0c516251-f745-55eb-9a9c-c1bef6eb674e
2026-03-26 09:56:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/4268ef3c6875497d9fa4f8819d82b13f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 103,
'color': 'Grey',
'currency': 'GBP',
'description': 'With a full service history up to 143,092 miles in August '
'2025 withj 9 service stamps, only £20.00 pound tax a year, 2 '
'keys, this 2016 Nissan Qashqai dCi N-Connecta is a well '
'maintained example. This Euro 6 compliant 1.5L diesel model '
'has had only two owners and boasts an MOT valid until '
'September 2026. The N-Connecta trim level comes equipped with '
'the Smart Vision Pack, which includes front and rear parking '
'sensors, and the Tech Pack, adding a 360 degree camera and '
"Bluetooth connectivity. You'll also benefit from keyless "
'entry via the Intelligent Key and dual zone climate control '
'for your comfort.\n'
'\n'
'This Nissan Qashqai stands out with its impressive fuel '
'economy, achieving a remarkable 74 mpg, which indicates it is '
'more economical than many similar vehicles. Furthermore, its '
'low CO2 emissions and low insurance group highlight its cost '
'effectiveness for everyday driving, making it a sensible '
'choice for many motorists.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 108,
'fuel_type': 'Diesel',
'id': '0c516251-f745-55eb-9a9c-c1bef6eb674e',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603230942039',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 152000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 1,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c516251-f745-55eb-9a9c-c1bef6eb674e/0c516251-f745-55eb-9a9c-c1bef6eb674e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 283617,
'Height': 1152,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4268ef3c6875497d9fa4f8819d82b13f.jpg',
'Width': 1728}],
'price': 3695,
'price_includes_vat': True,
'registration_date': '2016-07-18',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 1.5 dCi N-Connecta 2WD Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'N-Connecta',
'year': 2016}
2026-03-26 09:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230942039%27 HTTP/1.1" 200 None
2026-03-26 09:56:51 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603230942039: {'created_time': 1774519011.597009, 'last_price_update_time': 1774519011.59702}
2026-03-26 09:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603230942039') HTTP/1.1" 204 0
2026-03-26 09:56:51 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 4de39529-d431-57d8-b199-78104acc0139 with identifier 202603170785203
2026-03-26 09:56:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:51 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 4de39529-d431-57d8-b199-78104acc0139
2026-03-26 09:56:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/4268ef3c6875497d9fa4f8819d82b13f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 112,
'color': 'Grey',
'currency': 'GBP',
'description': 'With an MOT valid until September 2026, this Audi A4 TDI SE '
'Technik offers excellent peace of mind for its next owner. '
'Registered in 2014, this 2.0 litre diesel model comes in the '
'SE Technik trim. It benefits from a partial service history, '
'with the last service completed on 6th September 2022 at '
'91,176 miles with 7 service stamps, £35.00 tax a year, 2 '
'keys. Notable features include Acoustic Parking System with '
'rear sensors, Bluetooth interface for mobile telephone '
'preparation, and Electronic 3-zone climate control. The Audi '
'Parking System Plus further enhances convenience with both '
'front and rear parking sensors.\n'
'\n'
'This Audi A4 stands out with its comprehensive parking '
'assistance systems, making manoeuvring in tight spaces '
'significantly easier than many other vehicles in its class. '
'The inclusion of a 3-zone climate control system ensures '
'personalised comfort for all occupants, a feature not always '
'found on comparable cars. Combined with the efficient 2.0 '
'litre diesel engine and the reputable SE Technik '
'specification, this A4 is a well equipped and practical '
'choice for everyday driving.',
'doors_number': 4,
'emission_standard': 'Euro 5',
'engine': '2L',
'engine_horse_power': 141,
'fuel_type': 'Diesel',
'id': '4de39529-d431-57d8-b199-78104acc0139',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603170785203',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'Audi',
'model': 'A4',
'odometer': 125000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 1,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4de39529-d431-57d8-b199-78104acc0139/4de39529-d431-57d8-b199-78104acc0139_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 283617,
'Height': 1152,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4268ef3c6875497d9fa4f8819d82b13f.jpg',
'Width': 1728}],
'price': 4195,
'price_includes_vat': True,
'registration_date': '2014-09-02',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A4 2.0 TDI SE Technik Euro 5 (s/s) 4dr',
'transmission': 'manual',
'trim': 'SE Technik',
'year': 2014}
2026-03-26 09:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603170785203%27 HTTP/1.1" 200 None
2026-03-26 09:56:51 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603170785203: {'created_time': 1774519011.676682, 'last_price_update_time': 1774519011.676691}
2026-03-26 09:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603170785203') HTTP/1.1" 204 0
2026-03-26 09:56:51 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b8719d96-5a0d-55f6-909e-5a896d515f62 with identifier 202603230942602
2026-03-26 09:56:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:51 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b8719d96-5a0d-55f6-909e-5a896d515f62
2026-03-26 09:56:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/b467411d5a4743e684d4a777d5419695.jpg>
{'auction_title': '',
'c_o_2_emission_value': 122,
'color': 'White',
'currency': 'GBP',
'description': 'This 2012 MINI Countryman Cooper SD is presented with a '
'recent service completed on 30th May 2025 at 97,610 miles, '
'offering peace of mind alongside its partial service history '
'with 10 service stamps, 2 keys. Timing chain replaced @ '
'91,610 miles on 30/05/2025. Flywheel & Clutch kit changed on '
'01/08/2023. This 2.0 litre diesel model benefits from a 12 '
'month MOT provided at the point of sale. Inside you will find '
'manual air conditioning to keep you comfortable, basic '
'Bluetooth functionality with USB audio for your entertainment '
'needs, and rear parking distance control to assist with '
'manoeuvring.\n'
'\n'
'The MINI Countryman Cooper SD stands out with its impressive '
'fuel economy, achieving an excellent 61 miles per gallon, '
'which is better than many similar vehicles. Furthermore, its '
'low CO2 emissions and low insurance group rating indicate '
'that running costs for this vehicle are likely to be more '
'economical compared to other cars in its class.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '2L',
'engine_horse_power': 141,
'fuel_type': 'Diesel',
'id': 'b8719d96-5a0d-55f6-909e-5a896d515f62',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603230942602',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'MINI',
'model': 'Countryman',
'odometer': 98000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 48,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8719d96-5a0d-55f6-909e-5a896d515f62/b8719d96-5a0d-55f6-909e-5a896d515f62_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 614424,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b467411d5a4743e684d4a777d5419695.jpg',
'Width': 2048}],
'price': 3550,
'price_includes_vat': True,
'registration_date': '2012-06-06',
'seats_number': 5,
'seller_name': None,
'title': 'MINI Countryman 2.0 Cooper SD Euro 5 (s/s) 5dr',
'transmission': 'manual',
'trim': 'Cooper SD',
'year': 2012}
2026-03-26 09:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230942602%27 HTTP/1.1" 200 None
2026-03-26 09:56:51 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603230942602: {'created_time': 1774519011.725176, 'last_price_update_time': 1774519011.725187}
2026-03-26 09:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603230942602') HTTP/1.1" 204 0
2026-03-26 09:56:51 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 70d9506c-f18c-55d4-a04e-789cd690f5c0 with identifier 202603040414711
2026-03-26 09:56:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:51 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 70d9506c-f18c-55d4-a04e-789cd690f5c0
2026-03-26 09:56:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/09bcd20bdbd44841b64664f89257beea.jpg>
{'auction_title': '',
'c_o_2_emission_value': 100,
'color': 'Silver',
'currency': 'GBP',
'description': 'With an MOT valid until March 2027 and a full service '
'history, only £20.00 pound tax a year, 2 keys, this 2014 '
'Peugeot 308 e-HDi Allure offers excellent peace of mind. This '
'1.6L diesel model, registered in 2014, comes with the Allure '
'trim, featuring a Bluetooth telephone facility, front and '
'rear parking aids including a reversing camera, and automatic '
'dual zone air conditioning for your comfort. Its '
'comprehensive service history, with the last service '
'completed on 2025-03-26 at 87172 miles, ensures it has been '
'well maintained with 12 service stamps.\n'
'\n'
'This Peugeot 308 stands out with its impressive fuel economy, '
'achieving a remarkable 74 mpg, which indicates it is more '
'economical than many similar vehicles. Furthermore, its low '
'CO2 emissions and low insurance group highlight its cost '
'effectiveness for everyday driving. You will also appreciate '
'the generous boot space, making it a practical choice for '
'families or those who need extra room for luggage.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.6L',
'engine_horse_power': 113,
'fuel_type': 'Diesel',
'id': '70d9506c-f18c-55d4-a04e-789cd690f5c0',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603040414711',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'Peugeot',
'model': '308',
'odometer': 93000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 55,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d9506c-f18c-55d4-a04e-789cd690f5c0/70d9506c-f18c-55d4-a04e-789cd690f5c0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 554468,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/09bcd20bdbd44841b64664f89257beea.jpg',
'Width': 2048}],
'price': 3500,
'price_includes_vat': True,
'registration_date': '2014-01-30',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.6 e-HDi Allure Euro 5 (s/s) 5dr',
'transmission': 'manual',
'trim': 'Allure',
'year': 2014}
2026-03-26 09:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040414711%27 HTTP/1.1" 200 None
2026-03-26 09:56:51 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603040414711: {'created_time': 1774519011.776534, 'last_price_update_time': 1774519011.776544}
2026-03-26 09:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603040414711') HTTP/1.1" 204 0
2026-03-26 09:56:51 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 1ed8d4e3-882e-5de0-9046-bc068658d49b with identifier 202602250220684
2026-03-26 09:56:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:51 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 1ed8d4e3-882e-5de0-9046-bc068658d49b
2026-03-26 09:56:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 169,
'color': 'Black',
'currency': 'GBP',
'description': 'With an MOT valid until October 2026, this 2013 Volvo XC60 D5 '
'SE Lux Nav offers excellent peace of mind. This four wheel '
'drive model is powered by a 2.4 litre diesel engine and has '
'had only two owners. Its partial service history includes a '
'last service at 86,211 miles on 21st September 2022 with 10 '
'service stamps, last owner since 2016, Notable features '
'include electronic climate control, xenon headlights with '
'tunnel sensor, a Bluetooth handsfree system, and a power '
"driver's seat with memory for both the seat and exterior "
'mirrors.\n'
'\n'
'The XC60 SE Lux Nav boasts impressive performance, '
'accelerating from 0 to 60 miles per hour in just 7.8 seconds, '
'demonstrating its capability. This acceleration figure '
'indicates a more responsive driving experience compared to '
'many other vehicles in its class. Furthermore, the generous '
'boot space provides ample room for luggage or shopping, '
'making it a practical choice for families or those who '
'require extra carrying capacity.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '2.4L',
'engine_horse_power': 212,
'fuel_type': 'Diesel',
'id': '1ed8d4e3-882e-5de0-9046-bc068658d49b',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602250220684',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'Volvo',
'model': 'XC60',
'odometer': 114000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 1,
'photo_urls': ['https://m.atcdn.co.uk/a/media/4268ef3c6875497d9fa4f8819d82b13f.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4de39529-d431-57d8-b199-78104acc0139/4de39529-d431-57d8-b199-78104acc0139_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 283617,
'Height': 1152,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4268ef3c6875497d9fa4f8819d82b13f.jpg',
'Width': 1728}],
'price': 7795,
'price_includes_vat': True,
'registration_date': '2013-09-01',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC60 2.4 D5 SE Lux Nav Geartronic AWD Euro 5 5dr',
'transmission': 'automatic',
'trim': 'SE Lux Nav',
'year': 2013}
2026-03-26 09:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602250220684%27 HTTP/1.1" 200 None
2026-03-26 09:56:51 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602250220684: {'created_time': 1774519011.838289, 'last_price_update_time': 1774519011.838299}
2026-03-26 09:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602250220684') HTTP/1.1" 204 0
2026-03-26 09:56:51 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:51 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 9070fe8d-9481-53c5-919d-4ed50a1fbf13 with identifier: 202602250217647
2026-03-26 09:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9070fe8d-9481-53c5-919d-4ed50a1fbf13
2026-03-26 09:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F26a9e36655044a2cb315ab7d80811984.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/26a9e36655044a2cb315ab7d80811984.jpg not downloaded yet
2026-03-26 09:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 09:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 09:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 09:56:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f24f5010>
2026-03-26 09:56:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ba5030b-445c-5fac-9d61-797dce3f8af1/3ba5030b-445c-5fac-9d61-797dce3f8af1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9d278090be5c4cef8107c1a972f3465b.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9d278090be5c4cef8107c1a972f3465b.jpg saved to cache
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3ba5030b-445c-5fac-9d61-797dce3f8af1
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3ba5030b-445c-5fac-9d61-797dce3f8af1 sending to next pipeline
2026-03-26 09:56:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f2445210>
2026-03-26 09:56:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c52d46f-0f6b-532f-b16e-768d201a4bcf/2c52d46f-0f6b-532f-b16e-768d201a4bcf_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6124d1d5255f41f5bccc5a98dbb7ba1e.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6124d1d5255f41f5bccc5a98dbb7ba1e.jpg saved to cache
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c52d46f-0f6b-532f-b16e-768d201a4bcf
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2c52d46f-0f6b-532f-b16e-768d201a4bcf sending to next pipeline
2026-03-26 09:56:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 670225ec-5069-579e-8e22-80c8e1dcd6a7 with identifier: 202602250217290
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 670225ec-5069-579e-8e22-80c8e1dcd6a7
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Faffe165647634d3fbf0e566bd1d75e53.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/affe165647634d3fbf0e566bd1d75e53.jpg not downloaded yet
2026-03-26 09:56:52 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 3ba5030b-445c-5fac-9d61-797dce3f8af1 with identifier 202603110619839
2026-03-26 09:56:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:52 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 3ba5030b-445c-5fac-9d61-797dce3f8af1
2026-03-26 09:56:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/9d278090be5c4cef8107c1a972f3465b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 109,
'color': 'Grey',
'currency': 'GBP',
'description': 'This 2014 Ford Focus TDCi Titanium Navigator presents a '
'compelling proposition with its MOT valid until September '
'2026, offering peace of mind for the coming years. This 1.6L '
'diesel model, with a mileage of 90,000 miles, is considered '
'low for its age and benefits from a full service history, '
'with the last service completed on 2025-09-25 at 85,074 miles '
'with 12 service stamps, Only £20.00 tax a year, 2 keys. The '
'Titanium Navigator trim level ensures a well equipped driving '
'experience, featuring convenient Bluetooth handsfree and '
'voice control, automatic headlights, and rear parking sensors '
'to aid manoeuvrability. Inside, you will appreciate the dual '
'zone electronic automatic temperature control for '
'personalised comfort.\n'
'\n'
'The Ford Focus TDCi Titanium Navigator stands out with '
'several key advantages that set it apart from other vehicles '
'in its class. Its low insurance group rating means more '
'affordable running costs, a significant benefit for many '
'drivers. Furthermore, the generous boot space offers '
'practicality for shopping trips, holidays, or carrying larger '
'items, making it a versatile choice for everyday life.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.6L',
'engine_horse_power': 113,
'fuel_type': 'Diesel',
'id': '3ba5030b-445c-5fac-9d61-797dce3f8af1',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603110619839',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'Ford',
'model': 'Focus',
'odometer': 90000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 48,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ba5030b-445c-5fac-9d61-797dce3f8af1/3ba5030b-445c-5fac-9d61-797dce3f8af1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 528381,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9d278090be5c4cef8107c1a972f3465b.jpg',
'Width': 2048}],
'price': 3650,
'price_includes_vat': True,
'registration_date': '2014-03-31',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 1.6 TDCi Titanium Navigator Euro 5 (s/s) 5dr',
'transmission': 'manual',
'trim': 'Titanium Navigator',
'year': 2014}
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110619839%27 HTTP/1.1" 200 None
2026-03-26 09:56:52 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603110619839: {'created_time': 1774519012.104029, 'last_price_update_time': 1774519012.104039}
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603110619839') HTTP/1.1" 204 0
2026-03-26 09:56:52 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2c52d46f-0f6b-532f-b16e-768d201a4bcf with identifier 202603110619930
2026-03-26 09:56:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:52 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2c52d46f-0f6b-532f-b16e-768d201a4bcf
2026-03-26 09:56:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/6124d1d5255f41f5bccc5a98dbb7ba1e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 107,
'color': 'Black',
'currency': 'GBP',
'description': 'This 2015 Volkswagen Polo TSI SE Design offers excellent '
'value with full service history and a recent service '
'completed in June 2025 at 91,882 miles with 9 service stamps '
'and it comes with a full 12 months MOT for your peace of '
'mind. Only £20.00 pound tax a year. Last owner since 2015. '
'This well maintained example, with only two previous owners, '
'features a responsive 1.2 litre petrol engine and is '
"compliant with Euro 6 emissions standards. Inside, you'll "
'find manual air conditioning to keep you comfortable, '
'alongside Bluetooth connectivity for both audio streaming and '
'phone calls, making every journey more enjoyable.\n'
'\n'
'The Polo TSI SE Design stands out with its impressive fuel '
'economy, achieving up to 60 miles per gallon, which is a '
'significant advantage for keeping running costs down. '
'Furthermore, its low CO2 emissions highlight its efficiency '
'compared to many other vehicles in its class. This '
'combination of economical running, desirable features, and '
'solid provenance makes this Volkswagen Polo a sensible and '
'appealing choice.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.2L',
'engine_horse_power': 89,
'fuel_type': 'Petrol',
'id': '2c52d46f-0f6b-532f-b16e-768d201a4bcf',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603110619930',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 97000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 1,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c52d46f-0f6b-532f-b16e-768d201a4bcf/2c52d46f-0f6b-532f-b16e-768d201a4bcf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 243277,
'Height': 1152,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6124d1d5255f41f5bccc5a98dbb7ba1e.jpg',
'Width': 1728}],
'price': 5725,
'price_includes_vat': True,
'registration_date': '2015-06-22',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Polo 1.2 TSI BlueMotion Tech SE Design Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'SE Design',
'year': 2015}
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110619930%27 HTTP/1.1" 200 None
2026-03-26 09:56:52 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603110619930: {'created_time': 1774519012.152298, 'last_price_update_time': 1774519012.152307}
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603110619930') HTTP/1.1" 204 0
2026-03-26 09:56:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 86435a6b-8425-501d-8d49-e31ac2369e2d with identifier: 202602200095095
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 86435a6b-8425-501d-8d49-e31ac2369e2d
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F93bd40d071ae4ca382893c303e2eec72.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/93bd40d071ae4ca382893c303e2eec72.jpg not downloaded yet
2026-03-26 09:56:52 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-26 09:56:52 [auto_selling_autotrader.co.uk] INFO: Page: 3/3, total results: 42
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202306299096495%27 HTTP/1.1" 200 None
2026-03-26 09:56:52 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202306299096495: 1
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202306289028005%27 HTTP/1.1" 200 None
2026-03-26 09:56:52 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202306289028005: 1
2026-03-26 09:56:52 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 2 detail requests (batch 1)
2026-03-26 09:56:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b91b6412-298c-5054-8ba0-e28c48f79acb with identifier: 202602109829578
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b91b6412-298c-5054-8ba0-e28c48f79acb
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9378454c738d4f08a283f591f13ed115.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9378454c738d4f08a283f591f13ed115.jpg not downloaded yet
2026-03-26 09:56:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a2c82336-eb15-5e0e-879c-328af4c9a933 with identifier: 202601169202939
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a2c82336-eb15-5e0e-879c-328af4c9a933
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6de7d6f7af5e440a8aaa34bc7cb6f62e.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6de7d6f7af5e440a8aaa34bc7cb6f62e.jpg not downloaded yet
2026-03-26 09:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/4329e3d6c2744f238950b7cafac3d72c.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: da611718-c0b0-54ac-8842-475bc632a08f with identifier: 202602200094909
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item da611718-c0b0-54ac-8842-475bc632a08f
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4268ef3c6875497d9fa4f8819d82b13f.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4268ef3c6875497d9fa4f8819d82b13f.jpg already downloaded
2026-03-26 09:56:52 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: da611718-c0b0-54ac-8842-475bc632a08f with identifier 202602200094909
2026-03-26 09:56:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:52 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item da611718-c0b0-54ac-8842-475bc632a08f
2026-03-26 09:56:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 99,
'color': 'Black',
'currency': 'GBP',
'description': 'With an MOT valid until June 2026, this 2015 SEAT Leon TDI SE '
'offers excellent peace of mind. This particular Leon is a 1.6 '
'litre diesel model and has had only two owners from new. It '
'benefits from a partial service history, with the last '
'service completed on 16th January 2025 at 1113,581 miles with '
'7 service stamps, only £20.00 tax a year, 2 keys, last owner '
'since 2015, Inside you will find a rear reading light, air '
'conditioning for your comfort, and integrated Bluetooth '
'systems for both handsfree calls and audio streaming.\n'
'\n'
'This SEAT Leon stands out with its impressive fuel economy, '
'achieving an outstanding 86 miles per gallon, which is '
'significantly better than many other vehicles in its class. '
'It also boasts a low CO2 emission rating, contributing to '
'lower running costs and environmental impact. Furthermore, '
'its low insurance group rating means more savings on your '
'annual policy, and the generous boot space provides ample '
'room for luggage or shopping, making it a practical choice '
'for everyday use.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.6L',
'engine_horse_power': 108,
'fuel_type': 'Diesel',
'id': 'da611718-c0b0-54ac-8842-475bc632a08f',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602200094909',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'SEAT',
'model': 'Leon',
'odometer': 119000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 1,
'photo_urls': ['https://m.atcdn.co.uk/a/media/4268ef3c6875497d9fa4f8819d82b13f.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4de39529-d431-57d8-b199-78104acc0139/4de39529-d431-57d8-b199-78104acc0139_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 283617,
'Height': 1152,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4268ef3c6875497d9fa4f8819d82b13f.jpg',
'Width': 1728}],
'price': 3850,
'price_includes_vat': True,
'registration_date': '2015-06-30',
'seats_number': 5,
'seller_name': None,
'title': 'SEAT Leon 1.6 TDI Ecomotive CR SE Euro 5 (s/s) 5dr',
'transmission': 'manual',
'trim': 'SE',
'year': 2015}
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602200094909%27 HTTP/1.1" 200 None
2026-03-26 09:56:52 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602200094909: {'created_time': 1774519012.34124, 'last_price_update_time': 1774519012.341248}
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602200094909') HTTP/1.1" 204 0
2026-03-26 09:56:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b995e0b3-d9ef-5ee0-aa19-48729b1ae4c5 with identifier: 202602059708621
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b995e0b3-d9ef-5ee0-aa19-48729b1ae4c5
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F37430261d850494ba971e2f84b8aab6a.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/37430261d850494ba971e2f84b8aab6a.jpg not downloaded yet
2026-03-26 09:56:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 54c2a0bd-b8db-52eb-adad-371c35cef278 with identifier: 202601099036863
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 54c2a0bd-b8db-52eb-adad-371c35cef278
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0764931fd5b641b58706f2156c704269.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0764931fd5b641b58706f2156c704269.jpg not downloaded yet
2026-03-26 09:56:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 09:56:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: f4e41e35-258c-5b91-8368-cc7b16a5f787 with identifier: 202602200094638
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f4e41e35-258c-5b91-8368-cc7b16a5f787
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4268ef3c6875497d9fa4f8819d82b13f.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4268ef3c6875497d9fa4f8819d82b13f.jpg already downloaded
2026-03-26 09:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/bb61a132b0164401a57086e17dc51a44.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:52 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: f4e41e35-258c-5b91-8368-cc7b16a5f787 with identifier 202602200094638
2026-03-26 09:56:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:52 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item f4e41e35-258c-5b91-8368-cc7b16a5f787
2026-03-26 09:56:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 109,
'color': 'Grey',
'currency': 'GBP',
'description': 'With MOT valid until June 2026, this SEAT Leon TSI FR from '
'2014 offers excellent peace of mind. This well maintained '
'example has had only two owners and benefits from a partial '
'service history, with its last service completed on 3rd June '
'2025 at 95,693 miles with 7 service stamps, only £20.00 pound '
'tax a year, 2 keys. Last owner since 2018, Under the bonnet, '
"you'll find a 1.4 litre petrol engine, compliant with Euro 6 "
'emissions standards. Inside, the FR trim level ensures a '
'comfortable and convenient driving experience, featuring an '
'integrated Bluetooth handsfree system, dual zone climate '
'control, and both front and rear parking sensors with an '
'optical parking system to assist you with manoeuvring.\n'
'\n'
'This SEAT Leon TSI FR stands out with its impressive fuel '
'economy, achieving a highlight of 53 miles per gallon, which '
'is better than many similar vehicles. Its low CO2 emissions '
'also contribute to its appeal. For those needing '
'practicality, the large boot space provides ample room for '
'luggage or shopping. Performance is also a strong point, with '
'a brisk 0-62mph acceleration time of just 8.1 seconds, '
'demonstrating its dynamic capabilities.0',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.4L',
'engine_horse_power': 148,
'fuel_type': 'Petrol',
'id': 'f4e41e35-258c-5b91-8368-cc7b16a5f787',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602200094638',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'SEAT',
'model': 'Leon',
'odometer': 99000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 1,
'photo_urls': ['https://m.atcdn.co.uk/a/media/4268ef3c6875497d9fa4f8819d82b13f.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4de39529-d431-57d8-b199-78104acc0139/4de39529-d431-57d8-b199-78104acc0139_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 283617,
'Height': 1152,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4268ef3c6875497d9fa4f8819d82b13f.jpg',
'Width': 1728}],
'price': 5895,
'price_includes_vat': True,
'registration_date': '2014-07-21',
'seats_number': 5,
'seller_name': None,
'title': 'SEAT Leon 1.4 TSI ACT FR Sport Tourer Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'FR',
'year': 2014}
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602200094638%27 HTTP/1.1" 200 None
2026-03-26 09:56:52 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602200094638: {'created_time': 1774519012.454719, 'last_price_update_time': 1774519012.454729}
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602200094638') HTTP/1.1" 204 0
2026-03-26 09:56:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 39975875-78f4-55ce-b127-e42a50d86252 with identifier: 202602059708271
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 39975875-78f4-55ce-b127-e42a50d86252
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdc7fd5af15d04790ae5f14c59fa25931.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dc7fd5af15d04790ae5f14c59fa25931.jpg not downloaded yet
2026-03-26 09:56:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c71145cf-6c86-5d51-9fab-851476e72021 with identifier: 202512058399904
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c71145cf-6c86-5d51-9fab-851476e72021
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fed0e6a8cec584804844d0bacdde1358b.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ed0e6a8cec584804844d0bacdde1358b.jpg not downloaded yet
2026-03-26 09:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/b5b81239ef504725bc3ac04288994b6b.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a601cd67-eeef-5573-b138-41c6a8278129 with identifier: 202602190068491
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a601cd67-eeef-5573-b138-41c6a8278129
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff0f9ebfc22ef40d687dc58fe11401786.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f0f9ebfc22ef40d687dc58fe11401786.jpg not downloaded yet
2026-03-26 09:56:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f1870a10>
2026-03-26 09:56:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502307bf-f13c-5e59-ab05-10b9b92516f9/502307bf-f13c-5e59-ab05-10b9b92516f9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4329e3d6c2744f238950b7cafac3d72c.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4329e3d6c2744f238950b7cafac3d72c.jpg saved to cache
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 502307bf-f13c-5e59-ab05-10b9b92516f9
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 502307bf-f13c-5e59-ab05-10b9b92516f9 sending to next pipeline
2026-03-26 09:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/aaa9aebe294b475e9597ad9a92427d24.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 82cca6d2-d826-5422-844c-705830a24ddb with identifier: 202602029599747
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 82cca6d2-d826-5422-844c-705830a24ddb
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb688c67c143e46cf84d9b05f855e57cf.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b688c67c143e46cf84d9b05f855e57cf.jpg not downloaded yet
2026-03-26 09:56:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 73cc3dd8-b572-5fb3-8a8d-001a1d8b8998 with identifier: 202512048352833
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 73cc3dd8-b572-5fb3-8a8d-001a1d8b8998
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd65f031527eb43c6a69cb9483772ff6d.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d65f031527eb43c6a69cb9483772ff6d.jpg not downloaded yet
2026-03-26 09:56:52 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 502307bf-f13c-5e59-ab05-10b9b92516f9 with identifier 202603040414781
2026-03-26 09:56:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:52 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 502307bf-f13c-5e59-ab05-10b9b92516f9
2026-03-26 09:56:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/4329e3d6c2744f238950b7cafac3d72c.jpg>
{'auction_title': '',
'c_o_2_emission_value': 121,
'color': 'Blue',
'currency': 'GBP',
'description': 'This 2014 Skoda Octavia TSI Elegance boasts an impressive MOT '
'valid until March 2027, offering peace of mind for the next '
'owner. This well maintained vehicle has had only two owners '
'and benefits from a partial service history, with its last '
'service completed on 8th March 2025 at 108,809 miles with 11 '
"service stamps, 2 keys, Last owner since 2014, Inside you'll "
'find desirable features such as dual zone climate control for '
'personalised comfort, rear parking sensors to aid '
'manoeuvring, and Bluetooth connectivity for seamless phone '
'integration.\n'
'\n'
'The Octavia TSI Elegance is a practical choice, offering '
'generous boot space for all your needs. Its 1.4 litre petrol '
'engine delivers a brisk 0-60mph acceleration in just 8.2 '
'seconds, demonstrating its capable performance. Furthermore, '
'this model stands out with its excellent fuel economy, '
'achieving an impressive 53 miles per gallon, and low CO2 '
'emissions, making it an economical and environmentally '
'conscious option compared to similar vehicles.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.4L',
'engine_horse_power': 138,
'fuel_type': 'Petrol',
'id': '502307bf-f13c-5e59-ab05-10b9b92516f9',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603040414781',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 118000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 56,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502307bf-f13c-5e59-ab05-10b9b92516f9/502307bf-f13c-5e59-ab05-10b9b92516f9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 806840,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4329e3d6c2744f238950b7cafac3d72c.jpg',
'Width': 2048}],
'price': 5295,
'price_includes_vat': True,
'registration_date': '2014-03-25',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA Octavia 1.4 TSI Elegance Euro 5 (s/s) 5dr',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2014}
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040414781%27 HTTP/1.1" 200 None
2026-03-26 09:56:52 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603040414781: {'created_time': 1774519012.724495, 'last_price_update_time': 1774519012.724508}
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603040414781') HTTP/1.1" 204 0
2026-03-26 09:56:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 52c2b6d8-6c5d-565c-adb2-ca85ce0e2025 with identifier: 202601259413634
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 52c2b6d8-6c5d-565c-adb2-ca85ce0e2025
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe9f2e65463454a7c9bd77add83fff40d.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e9f2e65463454a7c9bd77add83fff40d.jpg not downloaded yet
2026-03-26 09:56:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a14ba5d-46fc-5b2c-8efc-09cc07b3d352 with identifier: 202511238082124
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4a14ba5d-46fc-5b2c-8efc-09cc07b3d352
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd8d80810af0e491ab402d52f822ee992.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d8d80810af0e491ab402d52f822ee992.jpg not downloaded yet
2026-03-26 09:56:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f25c2d90>
2026-03-26 09:56:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c4aff77-fc80-52b5-ab2b-210f2b6e1be2/8c4aff77-fc80-52b5-ab2b-210f2b6e1be2_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbb61a132b0164401a57086e17dc51a44.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bb61a132b0164401a57086e17dc51a44.jpg saved to cache
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8c4aff77-fc80-52b5-ab2b-210f2b6e1be2
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8c4aff77-fc80-52b5-ab2b-210f2b6e1be2 sending to next pipeline
2026-03-26 09:56:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f1880250>
2026-03-26 09:56:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac90d288-7bdf-586a-8f61-2ee75005478c/ac90d288-7bdf-586a-8f61-2ee75005478c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb5b81239ef504725bc3ac04288994b6b.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b5b81239ef504725bc3ac04288994b6b.jpg saved to cache
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ac90d288-7bdf-586a-8f61-2ee75005478c
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ac90d288-7bdf-586a-8f61-2ee75005478c sending to next pipeline
2026-03-26 09:56:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 13db7039-6337-5574-92ef-ec13483b211a with identifier: 202601229353671
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 13db7039-6337-5574-92ef-ec13483b211a
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F693f6ebaa8e14576985bab4d923760dd.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/693f6ebaa8e14576985bab4d923760dd.jpg not downloaded yet
2026-03-26 09:56:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f01c70a-75f5-51bc-93f5-48f5f6c4fc35 with identifier: 202511177949989
2026-03-26 09:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3f01c70a-75f5-51bc-93f5-48f5f6c4fc35
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9cd9a4ea19a54d839c47c289258214b0.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9cd9a4ea19a54d839c47c289258214b0.jpg not downloaded yet
2026-03-26 09:56:53 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 8c4aff77-fc80-52b5-ab2b-210f2b6e1be2 with identifier 202603040412487
2026-03-26 09:56:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:53 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 8c4aff77-fc80-52b5-ab2b-210f2b6e1be2
2026-03-26 09:56:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/bb61a132b0164401a57086e17dc51a44.jpg>
{'auction_title': '',
'c_o_2_emission_value': 105,
'color': 'Black',
'currency': 'GBP',
'description': 'With an MOT valid until April 2027, this 2015 Skoda Citigo '
'MPI Monte Carlo offers excellent peace of mind. This stylish '
'Monte Carlo trim Citigo is powered by an efficient 1.0 litre '
'petrol engine. It comes with a clear vehicle history check '
'and has a partial service history, with the last service '
'completed on 21st March 2025 at 58,746 miles with 6 service '
'stamps, Only £20.00 pound tax a year, 2 keys, Notable '
'features include manual air conditioning for your comfort and '
'telephone preparation with Bluetooth connectivity, allowing '
'for hands free calls.\n'
'\n'
'This Skoda Citigo stands out with its impressive fuel '
'economy, achieving up to 63 miles per gallon, which is better '
'than many other vehicles in its class. It also benefits from '
'a low insurance group, making it an economical choice for '
'many drivers. Furthermore, its low CO2 emissions contribute '
'to a more environmentally friendly driving experience.',
'doors_number': 3,
'emission_standard': 'Euro 5',
'engine': '1L',
'engine_horse_power': 59,
'fuel_type': 'Petrol',
'id': '8c4aff77-fc80-52b5-ab2b-210f2b6e1be2',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603040412487',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'Skoda',
'model': 'Citigo',
'odometer': 65000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 42,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c4aff77-fc80-52b5-ab2b-210f2b6e1be2/8c4aff77-fc80-52b5-ab2b-210f2b6e1be2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 708697,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bb61a132b0164401a57086e17dc51a44.jpg',
'Width': 2048}],
'price': 4825,
'price_includes_vat': True,
'registration_date': '2015-04-25',
'seats_number': 4,
'seller_name': None,
'title': 'SKODA Citigo 1.0 MPI Monte Carlo Euro 5 3dr',
'transmission': 'manual',
'trim': 'Monte Carlo',
'year': 2015}
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040412487%27 HTTP/1.1" 200 None
2026-03-26 09:56:53 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603040412487: {'created_time': 1774519013.036584, 'last_price_update_time': 1774519013.036595}
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603040412487') HTTP/1.1" 204 0
2026-03-26 09:56:53 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ac90d288-7bdf-586a-8f61-2ee75005478c with identifier 202602270270824
2026-03-26 09:56:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:53 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ac90d288-7bdf-586a-8f61-2ee75005478c
2026-03-26 09:56:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/b5b81239ef504725bc3ac04288994b6b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 99,
'color': 'Black',
'currency': 'GBP',
'description': 'With an MOT valid until July 2026, this Audi A1 TDI Sport '
'from 2012 offers excellent peace of mind. This stylish '
'hatchback is equipped with a 1.6 litre diesel engine and '
'features a Sport trim, providing a comfortable and engaging '
'driving experience. Cambelt done @ 95,746 miles on '
'01/06/2021, The vehicle comes with partial service history, '
'with the last service completed on 12 February 2026 at '
'123,434 miles with 9 service stamps, only £20.00 tax a year, '
'2 keys. Notable features include air conditioning for your '
'comfort and a Bluetooth interface for mobile telephone '
'preparation, allowing for hands free calls and music '
'streaming.\n'
'\n'
'This Audi A1 stands out with its impressive fuel economy, '
'achieving an outstanding 74 miles per gallon, which is '
'significantly better than many other vehicles in its class. '
'Furthermore, its low CO2 emissions contribute to a more '
'environmentally friendly drive. The A1 also benefits from '
'being in a low insurance group, making it an economical '
'choice for everyday motoring.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.6L',
'engine_horse_power': 104,
'fuel_type': 'Diesel',
'id': 'ac90d288-7bdf-586a-8f61-2ee75005478c',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602270270824',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'Audi',
'model': 'A1',
'odometer': 123000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 52,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac90d288-7bdf-586a-8f61-2ee75005478c/ac90d288-7bdf-586a-8f61-2ee75005478c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 647446,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b5b81239ef504725bc3ac04288994b6b.jpg',
'Width': 2048}],
'price': 3275,
'price_includes_vat': True,
'registration_date': '2012-10-18',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A1 1.6 TDI Sport Sportback Euro 5 (s/s) 5dr',
'transmission': 'manual',
'trim': 'Sport',
'year': 2012}
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602270270824%27 HTTP/1.1" 200 None
2026-03-26 09:56:53 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602270270824: {'created_time': 1774519013.104269, 'last_price_update_time': 1774519013.104278}
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602270270824') HTTP/1.1" 204 0
2026-03-26 09:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/26a9e36655044a2cb315ab7d80811984.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:53 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:53 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 86e3fc2a-bcd7-588d-925b-47024230be6d with identifier: 202601229329531
2026-03-26 09:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 86e3fc2a-bcd7-588d-925b-47024230be6d
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffb1744ed13404f9f9c87801c26d55c3e.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fb1744ed13404f9f9c87801c26d55c3e.jpg not downloaded yet
2026-03-26 09:56:53 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:53 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 01be161a-9122-554e-b09b-a8a859aa817d with identifier: 202511157910608
2026-03-26 09:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 01be161a-9122-554e-b09b-a8a859aa817d
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdbaef1eda9b646d590a0dc98344075fd.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dbaef1eda9b646d590a0dc98344075fd.jpg not downloaded yet
2026-03-26 09:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f188ff50>
2026-03-26 09:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_178b9381-b340-5960-be09-724a0612d9c4/178b9381-b340-5960-be09-724a0612d9c4_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Faaa9aebe294b475e9597ad9a92427d24.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/aaa9aebe294b475e9597ad9a92427d24.jpg saved to cache
2026-03-26 09:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 178b9381-b340-5960-be09-724a0612d9c4
2026-03-26 09:56:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 178b9381-b340-5960-be09-724a0612d9c4 sending to next pipeline
2026-03-26 09:56:53 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 178b9381-b340-5960-be09-724a0612d9c4 with identifier 202602250220778
2026-03-26 09:56:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:53 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 178b9381-b340-5960-be09-724a0612d9c4
2026-03-26 09:56:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/aaa9aebe294b475e9597ad9a92427d24.jpg>
{'auction_title': '',
'c_o_2_emission_value': 127,
'color': 'Blue',
'currency': 'GBP',
'description': 'With an MOT valid until October 2026, this 2015 Volvo V40 T2 '
'R-Design offers peace of mind for the road ahead. This Euro 6 '
'compliant model is powered by a 2.0 litre petrol engine and '
'features a Full service history, with its last service '
'completed on 14th March 2026 at 90,375 miles with 10 service '
'stamps, Cambelt just been done @90,375 miles on 14/03/2026 '
"with a service, 2 keys, last owner since 2019, Inside you'll "
'find a comfortable R-Design trim, equipped with electronic '
'climate control for personalised comfort, a Bluetooth '
'handsfree system for seamless connectivity, and automatic '
'headlights with a tunnel sensor for convenience.\n'
'\n'
'This Volvo V40 T2 R-Design also boasts a low insurance group, '
'making it an economical choice for many drivers. Its generous '
'boot space ensures practicality for everyday needs and longer '
'journeys. Performance is also a strong point, with an '
'acceleration of 0 to 60 miles per hour in just 9.2 seconds, '
'demonstrating its capable and responsive nature compared to '
'other vehicles in its class.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 120,
'fuel_type': 'Petrol',
'id': '178b9381-b340-5960-be09-724a0612d9c4',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602250220778',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'Volvo',
'model': 'V40',
'odometer': 90000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 51,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178b9381-b340-5960-be09-724a0612d9c4/178b9381-b340-5960-be09-724a0612d9c4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 579854,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/aaa9aebe294b475e9597ad9a92427d24.jpg',
'Width': 2048}],
'price': 6195,
'price_includes_vat': True,
'registration_date': '2015-10-30',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo V40 2.0 T2 R-Design Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'R-Design',
'year': 2015}
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602250220778%27 HTTP/1.1" 200 None
2026-03-26 09:56:53 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602250220778: {'created_time': 1774519013.254518, 'last_price_update_time': 1774519013.254527}
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602250220778') HTTP/1.1" 204 0
2026-03-26 09:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/affe165647634d3fbf0e566bd1d75e53.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/6de7d6f7af5e440a8aaa34bc7cb6f62e.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:53 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:53 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b14ffbe-273d-57f2-9156-ea05987d93b9 with identifier: 202601219323649
2026-03-26 09:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4b14ffbe-273d-57f2-9156-ea05987d93b9
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc7b9de5e0cb2431a81b0ab9f5672a4c1.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c7b9de5e0cb2431a81b0ab9f5672a4c1.jpg not downloaded yet
2026-03-26 09:56:53 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:53 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c75038a-e780-5001-ad31-6395feff79eb with identifier: 202511047654940
2026-03-26 09:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0c75038a-e780-5001-ad31-6395feff79eb
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6299b01269aa427796dd41dde47a659e.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6299b01269aa427796dd41dde47a659e.jpg not downloaded yet
2026-03-26 09:56:53 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:53 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e3f32421-e107-5832-a9a2-390d875eb2ef with identifier: 202601209274802
2026-03-26 09:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e3f32421-e107-5832-a9a2-390d875eb2ef
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F970b0fe2a1f14fa0987b5202025327db.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/970b0fe2a1f14fa0987b5202025327db.jpg not downloaded yet
2026-03-26 09:56:53 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:53 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ac2956d9-da42-575f-88c8-621e213c97b3 with identifier: 202510297507401
2026-03-26 09:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ac2956d9-da42-575f-88c8-621e213c97b3
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6e6aec5699f7480fbc32b45dd3024dbb.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6e6aec5699f7480fbc32b45dd3024dbb.jpg not downloaded yet
2026-03-26 09:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/9378454c738d4f08a283f591f13ed115.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f2f74dd0>
2026-03-26 09:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9070fe8d-9481-53c5-919d-4ed50a1fbf13/9070fe8d-9481-53c5-919d-4ed50a1fbf13_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F26a9e36655044a2cb315ab7d80811984.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/26a9e36655044a2cb315ab7d80811984.jpg saved to cache
2026-03-26 09:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9070fe8d-9481-53c5-919d-4ed50a1fbf13
2026-03-26 09:56:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9070fe8d-9481-53c5-919d-4ed50a1fbf13 sending to next pipeline
2026-03-26 09:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/93bd40d071ae4ca382893c303e2eec72.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:53 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:53 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ab21939-c1d7-512b-8e2c-ba681836a83b with identifier: 202601199266001
2026-03-26 09:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6ab21939-c1d7-512b-8e2c-ba681836a83b
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F32e2812896dc4294a6b94e246dbcab9f.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/32e2812896dc4294a6b94e246dbcab9f.jpg not downloaded yet
2026-03-26 09:56:53 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:53 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ddeb5f9-3cc8-5c71-9d26-c378d95a101b with identifier: 202509015951706
2026-03-26 09:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8ddeb5f9-3cc8-5c71-9d26-c378d95a101b
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F203ce993736a4e4a910bfe80109d601a.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/203ce993736a4e4a910bfe80109d601a.jpg not downloaded yet
2026-03-26 09:56:53 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 9070fe8d-9481-53c5-919d-4ed50a1fbf13 with identifier 202602250217647
2026-03-26 09:56:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:53 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 9070fe8d-9481-53c5-919d-4ed50a1fbf13
2026-03-26 09:56:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/26a9e36655044a2cb315ab7d80811984.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'Grey',
'currency': 'GBP',
'description': 'This Skoda Octavia TDI Elegance from 2012 presents a '
'remarkable opportunity with its exceptionally low mileage of '
'just 82,000 miles for a vehicle of its age. It is powered by '
'an efficient 1.6 litre diesel engine and boasts a generous '
'boot space, making it practical for everyday use. This '
'particular model, the Elegance trim, comes equipped with '
'desirable features such as rear parking sensors with parking '
'assistance and dual zone climate control air conditioning, '
'ensuring comfort for all occupants. The MOT is valid until '
'January 2027, offering peace of mind for the coming years.\n'
'\n'
'Further enhancing its appeal, this Octavia falls into a low '
'insurance group, which can contribute to lower running costs. '
'While the service history is partial, the last service was '
'completed on 4th January 2023 at 72,580 miles with 11 Service '
'stamps indicating recent attention. 2 keys, only £35.00 tax '
'a year,These highlights, including the very low mileage and '
'practical features, position this Skoda Octavia as a '
'compelling choice compared to other vehicles in its class.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.6L',
'engine_horse_power': 104,
'fuel_type': 'Diesel',
'id': '9070fe8d-9481-53c5-919d-4ed50a1fbf13',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602250217647',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 82000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 47,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9070fe8d-9481-53c5-919d-4ed50a1fbf13/9070fe8d-9481-53c5-919d-4ed50a1fbf13_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 596656,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/26a9e36655044a2cb315ab7d80811984.jpg',
'Width': 2048}],
'price': 3095,
'price_includes_vat': True,
'registration_date': '2012-05-09',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA Octavia 1.6 TDI Elegance Euro 5 5dr',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2012}
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602250217647%27 HTTP/1.1" 200 None
2026-03-26 09:56:53 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602250217647: {'created_time': 1774519013.546607, 'last_price_update_time': 1774519013.546616}
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602250217647') HTTP/1.1" 204 0
2026-03-26 09:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/ed0e6a8cec584804844d0bacdde1358b.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/37430261d850494ba971e2f84b8aab6a.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f639f790>
2026-03-26 09:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_670225ec-5069-579e-8e22-80c8e1dcd6a7/670225ec-5069-579e-8e22-80c8e1dcd6a7_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Faffe165647634d3fbf0e566bd1d75e53.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/affe165647634d3fbf0e566bd1d75e53.jpg saved to cache
2026-03-26 09:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 670225ec-5069-579e-8e22-80c8e1dcd6a7
2026-03-26 09:56:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 670225ec-5069-579e-8e22-80c8e1dcd6a7 sending to next pipeline
2026-03-26 09:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f1838e10>
2026-03-26 09:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2c82336-eb15-5e0e-879c-328af4c9a933/a2c82336-eb15-5e0e-879c-328af4c9a933_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6de7d6f7af5e440a8aaa34bc7cb6f62e.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6de7d6f7af5e440a8aaa34bc7cb6f62e.jpg saved to cache
2026-03-26 09:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a2c82336-eb15-5e0e-879c-328af4c9a933
2026-03-26 09:56:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a2c82336-eb15-5e0e-879c-328af4c9a933 sending to next pipeline
2026-03-26 09:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/0764931fd5b641b58706f2156c704269.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:53 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 670225ec-5069-579e-8e22-80c8e1dcd6a7 with identifier 202602250217290
2026-03-26 09:56:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:53 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 670225ec-5069-579e-8e22-80c8e1dcd6a7
2026-03-26 09:56:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/affe165647634d3fbf0e566bd1d75e53.jpg>
{'auction_title': '',
'c_o_2_emission_value': 159,
'color': 'Silver',
'currency': 'GBP',
'description': 'This Skoda Yeti TSI SE from 2013 offers exceptional peace of '
'mind with its MOT valid until January 2027 and a full service '
'history, most recently serviced on 19th December 2025 at '
'106,667 miles with 10 service stamps, 2 keys. This well '
'maintained 1.4 litre petrol model has had only two owners and '
'benefits from a clear vehicle history check. Inside, you will '
'find dual zone climate control for personalised comfort and '
'rear parking sensors to assist with manoeuvring.\n'
'\n'
'The SE trim level of this Yeti provides a practical and '
'comfortable driving experience. Its low insurance group '
'rating is a significant advantage, suggesting lower running '
'costs compared to many other vehicles. Combined with its '
'comprehensive service record and long MOT, this Skoda Yeti '
'represents a sensible choice for those seeking a reliable and '
'well cared for compact SUV.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.4L',
'engine_horse_power': 120,
'fuel_type': 'Petrol',
'id': '670225ec-5069-579e-8e22-80c8e1dcd6a7',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602250217290',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'Skoda',
'model': 'Yeti',
'odometer': 107000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 48,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_670225ec-5069-579e-8e22-80c8e1dcd6a7/670225ec-5069-579e-8e22-80c8e1dcd6a7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 701026,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/affe165647634d3fbf0e566bd1d75e53.jpg',
'Width': 2048}],
'price': 4550,
'price_includes_vat': True,
'registration_date': '2013-01-17',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA Yeti 1.4 TSI SE Euro 5 5dr',
'transmission': 'manual',
'trim': 'SE',
'year': 2013}
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602250217290%27 HTTP/1.1" 200 None
2026-03-26 09:56:53 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602250217290: {'created_time': 1774519013.816869, 'last_price_update_time': 1774519013.816879}
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602250217290') HTTP/1.1" 204 0
2026-03-26 09:56:53 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a2c82336-eb15-5e0e-879c-328af4c9a933 with identifier 202601169202939
2026-03-26 09:56:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:53 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a2c82336-eb15-5e0e-879c-328af4c9a933
2026-03-26 09:56:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/6de7d6f7af5e440a8aaa34bc7cb6f62e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 133,
'color': 'Silver',
'currency': 'GBP',
'description': 'This 2005 Toyota Yaris VVT-i Colour Collection boasts an '
'impressive provenance with only two previous owners with last '
'owner since 2013 and an MOT valid until October 2026. '
'Benefitting from partial service history, this reliable '
'hatchback is ready for its next chapter. The 1.3L petrol '
'engine offers a smooth driving experience, making it a '
'practical choice for everyday use.\n'
'\n'
'The Yaris Colour Collection stands out with its excellent '
'fuel economy, achieving an impressive 50 miles per gallon, '
'which indicates it is more economical than many other '
'vehicles in its class. Furthermore, its low CO2 emissions and '
'low insurance group highlight its cost effectiveness, making '
'it an appealing option for budget conscious drivers.',
'doors_number': 5,
'emission_standard': 'Euro 4',
'engine': '1.3L',
'engine_horse_power': 85,
'fuel_type': 'Petrol',
'id': 'a2c82336-eb15-5e0e-879c-328af4c9a933',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601169202939',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 117000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 39,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2c82336-eb15-5e0e-879c-328af4c9a933/a2c82336-eb15-5e0e-879c-328af4c9a933_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 576559,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6de7d6f7af5e440a8aaa34bc7cb6f62e.jpg',
'Width': 2048}],
'price': 1295,
'price_includes_vat': True,
'registration_date': '2005-10-11',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris 1.3 VVT-i Colour Collection 5dr',
'transmission': 'manual',
'trim': 'Colour Collection',
'year': 2005}
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601169202939%27 HTTP/1.1" 200 None
2026-03-26 09:56:53 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601169202939: {'created_time': 1774519013.865794, 'last_price_update_time': 1774519013.865803}
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601169202939') HTTP/1.1" 204 0
2026-03-26 09:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f1ab79d0>
2026-03-26 09:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b91b6412-298c-5054-8ba0-e28c48f79acb/b91b6412-298c-5054-8ba0-e28c48f79acb_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9378454c738d4f08a283f591f13ed115.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9378454c738d4f08a283f591f13ed115.jpg saved to cache
2026-03-26 09:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b91b6412-298c-5054-8ba0-e28c48f79acb
2026-03-26 09:56:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b91b6412-298c-5054-8ba0-e28c48f79acb sending to next pipeline
2026-03-26 09:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f25cb250>
2026-03-26 09:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86435a6b-8425-501d-8d49-e31ac2369e2d/86435a6b-8425-501d-8d49-e31ac2369e2d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F93bd40d071ae4ca382893c303e2eec72.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/93bd40d071ae4ca382893c303e2eec72.jpg saved to cache
2026-03-26 09:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 86435a6b-8425-501d-8d49-e31ac2369e2d
2026-03-26 09:56:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 86435a6b-8425-501d-8d49-e31ac2369e2d sending to next pipeline
2026-03-26 09:56:54 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b91b6412-298c-5054-8ba0-e28c48f79acb with identifier 202602109829578
2026-03-26 09:56:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:54 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b91b6412-298c-5054-8ba0-e28c48f79acb
2026-03-26 09:56:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/9378454c738d4f08a283f591f13ed115.jpg>
{'auction_title': '',
'c_o_2_emission_value': 117,
'color': 'White',
'currency': 'GBP',
'description': 'With an MOT valid until August 2026, this Audi A3 TFSI SE '
'offers excellent peace of mind for its next owner. Registered '
'in 2016, this Euro 6 compliant model features a 1.4 litre '
'petrol engine and comes with a partial service history, with '
'the last service completed on 27 January 2026 at 102,872 '
'miles. Cambelt & Water pump changed @ 72,315 miles on '
"12/04/2024 along with a clutch kit. Inside you'll find "
'convenient features such as air conditioning to keep you '
'comfortable and a Bluetooth interface for mobile telephone '
'preparation, allowing for handsfree calls and music '
'streaming.\n'
'\n'
'PLEASE NOTE !!! THIS AUDI A3 IS MODIFIED .\n'
'\n'
'This Audi A3 SE also boasts a large boot space, providing '
'ample room for shopping, luggage, or sports equipment. When '
'it comes to performance, this model accelerates from 0 to 62 '
'miles per hour in 9.4 seconds, demonstrating a responsive '
'driving experience. These attributes, combined with its Euro '
'6 emissions rating and long MOT, position this A3 as a '
'practical and well maintained choice within its class.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.4L',
'engine_horse_power': 123,
'fuel_type': 'Petrol',
'id': 'b91b6412-298c-5054-8ba0-e28c48f79acb',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602109829578',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'Audi',
'model': 'A3',
'odometer': 103000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 56,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b91b6412-298c-5054-8ba0-e28c48f79acb/b91b6412-298c-5054-8ba0-e28c48f79acb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 769549,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9378454c738d4f08a283f591f13ed115.jpg',
'Width': 2048}],
'price': 5895,
'price_includes_vat': True,
'registration_date': '2016-06-30',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A3 1.4 TFSI SE Sportback Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'SE',
'year': 2016}
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602109829578%27 HTTP/1.1" 200 None
2026-03-26 09:56:54 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602109829578: {'created_time': 1774519014.167499, 'last_price_update_time': 1774519014.167509}
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602109829578') HTTP/1.1" 204 0
2026-03-26 09:56:54 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 86435a6b-8425-501d-8d49-e31ac2369e2d with identifier 202602200095095
2026-03-26 09:56:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:54 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 86435a6b-8425-501d-8d49-e31ac2369e2d
2026-03-26 09:56:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/93bd40d071ae4ca382893c303e2eec72.jpg>
{'auction_title': '',
'c_o_2_emission_value': 105,
'color': 'Black',
'currency': 'GBP',
'description': 'With an MOT valid until January 2027, this Skoda Citigo '
'offers excellent peace of mind for its next owner. Registered '
'in 2016, this MPI Colour Edition model is equipped with a 1.0 '
'litre petrol engine and meets Euro 6 emissions standards. It '
'benefits from partial service history, with the last service '
'completed on 14 January 2025 at 51,658 miles with 8 service '
'stamps, only £20.00 pound tax a year,2 keys, Notable features '
'include manual air conditioning for a comfortable cabin '
'environment and telephone preparation with Bluetooth '
'connectivity, allowing for hands free calls.\n'
'\n'
'This Skoda Citigo stands out with its impressive fuel '
'economy, achieving up to 64 miles per gallon, which is better '
'than many other vehicles in its class. Furthermore, its low '
'CO2 emissions and low insurance group rating contribute to '
'lower running costs, making it a very economical choice for '
'everyday driving.',
'doors_number': 3,
'emission_standard': 'Euro 6',
'engine': '1L',
'engine_horse_power': 59,
'fuel_type': 'Petrol',
'id': '86435a6b-8425-501d-8d49-e31ac2369e2d',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602200095095',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'Skoda',
'model': 'Citigo',
'odometer': 57000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 40,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86435a6b-8425-501d-8d49-e31ac2369e2d/86435a6b-8425-501d-8d49-e31ac2369e2d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 779438,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/93bd40d071ae4ca382893c303e2eec72.jpg',
'Width': 2048}],
'price': 4795,
'price_includes_vat': True,
'registration_date': '2016-03-31',
'seats_number': 4,
'seller_name': None,
'title': 'SKODA Citigo 1.0 MPI Colour Edition Euro 6 3dr',
'transmission': 'manual',
'trim': 'Colour Edition',
'year': 2016}
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602200095095%27 HTTP/1.1" 200 None
2026-03-26 09:56:54 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602200095095: {'created_time': 1774519014.221765, 'last_price_update_time': 1774519014.221775}
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602200095095') HTTP/1.1" 204 0
2026-03-26 09:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/dc7fd5af15d04790ae5f14c59fa25931.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 09:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f2e67150>
2026-03-26 09:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c71145cf-6c86-5d51-9fab-851476e72021/c71145cf-6c86-5d51-9fab-851476e72021_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fed0e6a8cec584804844d0bacdde1358b.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ed0e6a8cec584804844d0bacdde1358b.jpg saved to cache
2026-03-26 09:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c71145cf-6c86-5d51-9fab-851476e72021
2026-03-26 09:56:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c71145cf-6c86-5d51-9fab-851476e72021 sending to next pipeline
2026-03-26 09:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f1872a50>
2026-03-26 09:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b995e0b3-d9ef-5ee0-aa19-48729b1ae4c5/b995e0b3-d9ef-5ee0-aa19-48729b1ae4c5_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F37430261d850494ba971e2f84b8aab6a.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/37430261d850494ba971e2f84b8aab6a.jpg saved to cache
2026-03-26 09:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b995e0b3-d9ef-5ee0-aa19-48729b1ae4c5
2026-03-26 09:56:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b995e0b3-d9ef-5ee0-aa19-48729b1ae4c5 sending to next pipeline
2026-03-26 09:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f1870490>
2026-03-26 09:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54c2a0bd-b8db-52eb-adad-371c35cef278/54c2a0bd-b8db-52eb-adad-371c35cef278_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0764931fd5b641b58706f2156c704269.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0764931fd5b641b58706f2156c704269.jpg saved to cache
2026-03-26 09:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 54c2a0bd-b8db-52eb-adad-371c35cef278
2026-03-26 09:56:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 54c2a0bd-b8db-52eb-adad-371c35cef278 sending to next pipeline
2026-03-26 09:56:54 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c71145cf-6c86-5d51-9fab-851476e72021 with identifier 202512058399904
2026-03-26 09:56:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:54 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c71145cf-6c86-5d51-9fab-851476e72021
2026-03-26 09:56:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/ed0e6a8cec584804844d0bacdde1358b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 122,
'color': 'Black',
'currency': 'GBP',
'description': 'This 2014 Skoda Superb TDI Black Edition presents a '
'compelling proposition with its recent service completed on '
'2025-08-18 at 123,686 miles, supported by partial service '
'history. Cambelt & Water pump just been done @ 127,742 miles '
'on 13/12/2025, Last owner since 2020, This particular model '
'boasts a robust 2.0 litre diesel engine and features a '
"desirable Black Edition trim. Inside, you'll find comfort and "
'convenience with dual zone climate control, heated front '
'seats, and rear parking sensors to aid manoeuvrability. '
'Connectivity is also well catered for with GSM III telephone '
'preparation including Bluetooth.\n'
'\n'
'FINANCE AVAILABLE PLEASE VISIT OUR WEBSITE '
'WWW.ARCQUALITYCARS.CO.UK\n'
'\n'
'The Skoda Superb TDI Black Edition offers a blend of '
'performance and practicality. Its acceleration from 0-60mph '
'in just 8.4 seconds demonstrates its capable engine. This '
'vehicle also stands out with its exceptionally large boot '
'space, providing ample room for luggage or shopping. The '
'automatic headlights, also known as tunnel lights, offer '
'added convenience by illuminating the road automatically when '
'needed, setting it apart from many other vehicles in its '
'class.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '2L',
'engine_horse_power': 168,
'fuel_type': 'Diesel',
'id': 'c71145cf-6c86-5d51-9fab-851476e72021',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512058399904',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'Skoda',
'model': 'Superb',
'odometer': 127000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 48,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c71145cf-6c86-5d51-9fab-851476e72021/c71145cf-6c86-5d51-9fab-851476e72021_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 652985,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ed0e6a8cec584804844d0bacdde1358b.jpg',
'Width': 2048}],
'price': 5395,
'price_includes_vat': True,
'registration_date': '2014-09-17',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA Superb 2.0 TDI Black Edition Euro 5 (s/s) 5dr',
'transmission': 'manual',
'trim': 'Black Edition',
'year': 2014}
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512058399904%27 HTTP/1.1" 200 None
2026-03-26 09:56:54 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512058399904: {'created_time': 1774519014.618834, 'last_price_update_time': 1774519014.618847}
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512058399904') HTTP/1.1" 204 0
2026-03-26 09:56:54 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b995e0b3-d9ef-5ee0-aa19-48729b1ae4c5 with identifier 202602059708621
2026-03-26 09:56:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:54 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b995e0b3-d9ef-5ee0-aa19-48729b1ae4c5
2026-03-26 09:56:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/37430261d850494ba971e2f84b8aab6a.jpg>
{'auction_title': '',
'c_o_2_emission_value': 109,
'color': 'Black',
'currency': 'GBP',
'description': 'This Skoda Fabia TDI SE from 2013 boasts an impressive MOT '
'valid until October 2026, offering you peace of mind for the '
'road ahead. With a full service history, including its last '
'service on 1st July 2025 at 102,093 miles with 12 service '
'stamps, Only £20.00 tax a year, 2 keys, this car has been '
'well cared for. It features a reliable 1.6 litre diesel '
'engine and manual air conditioning for your comfort.\n'
'\n'
'The Fabia TDI SE stands out with its exceptional fuel '
'economy, achieving an impressive 67 miles per gallon, which '
'is significantly better than many other vehicles in its '
'class. Furthermore, its low CO2 emissions and low insurance '
'group rating indicate that running costs are kept to a '
'minimum, making this a sensible and economical choice for '
'everyday driving.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.6L',
'engine_horse_power': 89,
'fuel_type': 'Diesel',
'id': 'b995e0b3-d9ef-5ee0-aa19-48729b1ae4c5',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602059708621',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 108000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 44,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b995e0b3-d9ef-5ee0-aa19-48729b1ae4c5/b995e0b3-d9ef-5ee0-aa19-48729b1ae4c5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 629854,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/37430261d850494ba971e2f84b8aab6a.jpg',
'Width': 2048}],
'price': 2495,
'price_includes_vat': True,
'registration_date': '2013-06-19',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA Fabia 1.6 TDI SE Euro 5 5dr',
'transmission': 'manual',
'trim': 'SE',
'year': 2013}
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602059708621%27 HTTP/1.1" 200 None
2026-03-26 09:56:54 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602059708621: {'created_time': 1774519014.682378, 'last_price_update_time': 1774519014.682389}
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602059708621') HTTP/1.1" 204 0
2026-03-26 09:56:54 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 54c2a0bd-b8db-52eb-adad-371c35cef278 with identifier 202601099036863
2026-03-26 09:56:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:54 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 54c2a0bd-b8db-52eb-adad-371c35cef278
2026-03-26 09:56:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/0764931fd5b641b58706f2156c704269.jpg>
{'auction_title': '',
'c_o_2_emission_value': 35,
'color': 'Grey',
'currency': 'GBP',
'description': 'Arc Car Centre Wakefield is proud to offer this stunning 2020 '
'BMW 330e M Sport Plus Edition finished in beautiful metalic '
'Grey. Offers excellent peace of mind with its MOT valid until '
'July 2026 with 6 months comprehensive warranty. This Euro 6 '
'compliant plug in hybrid features a 2.0L petrol engine and '
'comes with a partial service history, with its last service '
'completed on 12th July 2023. Inside, you will find the very '
'rare luxurious BMW Individual Extended Merino Leather in '
'Fiona Red Black, complemented by the advanced Driving '
'Assistant Professional which includes adaptive cruise '
'control, Loudspeaker system-Harman Kardon.\n'
'\n'
'The M Sport Plus Edition trim level enhances the driving '
'experience with Extended LED Headlights and the BMW Live '
'Cockpit Professional, which includes Bluetooth connectivity. '
'Parking is made effortless thanks to the front and rear Park '
'Distance Control, including parking assistance sensors. These '
'features collectively demonstrate a superior level of '
'specification and driver assistance compared to other '
'vehicles in its class.\n'
'\n'
'PLEASE VISIT OUR WEBSITE FOR FINANCE WWW.ARCQUALITYCARS.CO.UK',
'doors_number': 4,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 288,
'fuel_type': 'Petrol Plug-in Hybrid',
'id': '54c2a0bd-b8db-52eb-adad-371c35cef278',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601099036863',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'BMW',
'model': '3 Series',
'odometer': 75000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 67,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54c2a0bd-b8db-52eb-adad-371c35cef278/54c2a0bd-b8db-52eb-adad-371c35cef278_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 671083,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0764931fd5b641b58706f2156c704269.jpg',
'Width': 2048}],
'price': 18995,
'price_includes_vat': True,
'registration_date': '2020-07-20',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 3 Series 2.0 330e 12kWh M Sport Plus Edition Auto Euro 6 (s/s) '
'4dr',
'transmission': 'automatic',
'trim': 'M Sport Plus Edition',
'year': 2020}
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601099036863%27 HTTP/1.1" 200 None
2026-03-26 09:56:54 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601099036863: {'created_time': 1774519014.75777, 'last_price_update_time': 1774519014.757788}
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601099036863') HTTP/1.1" 204 0
2026-03-26 09:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/b688c67c143e46cf84d9b05f855e57cf.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/f0f9ebfc22ef40d687dc58fe11401786.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f4b80ed0>
2026-03-26 09:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39975875-78f4-55ce-b127-e42a50d86252/39975875-78f4-55ce-b127-e42a50d86252_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdc7fd5af15d04790ae5f14c59fa25931.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dc7fd5af15d04790ae5f14c59fa25931.jpg saved to cache
2026-03-26 09:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 39975875-78f4-55ce-b127-e42a50d86252
2026-03-26 09:56:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 39975875-78f4-55ce-b127-e42a50d86252 sending to next pipeline
2026-03-26 09:56:54 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:54 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e3f4290-b4ba-55f8-82a5-5afca12eb709 with identifier: 202306299096495
2026-03-26 09:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9e3f4290-b4ba-55f8-82a5-5afca12eb709
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa58ad7d62b0d4d45827141c796f1bc7c.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a58ad7d62b0d4d45827141c796f1bc7c.jpg not downloaded yet
2026-03-26 09:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/e9f2e65463454a7c9bd77add83fff40d.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:54 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 39975875-78f4-55ce-b127-e42a50d86252 with identifier 202602059708271
2026-03-26 09:56:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:54 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 39975875-78f4-55ce-b127-e42a50d86252
2026-03-26 09:56:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/dc7fd5af15d04790ae5f14c59fa25931.jpg>
{'auction_title': '',
'c_o_2_emission_value': 120,
'color': 'Silver',
'currency': 'GBP',
'description': 'Enjoy peace of mind with 12 months MOT included with this '
'2013 Ford Fiesta Zetec. Mot till 27.02.2027 This popular '
'hatchback is equipped with a 1.25 litre petrol engine and '
'comes with a partial service history. For your comfort, Only '
'£35.00 tax a year, it features manual air conditioning, '
'ensuring a pleasant driving experience in all seasons.\n'
'\n'
'This Ford Fiesta Zetec stands out with its low insurance '
'group, making it a cost effective choice for many drivers. '
'The combination of its reliable 1.25L engine, the included 12 '
'months MOT, and its economical insurance rating demonstrates '
'its value compared to other vehicles in its class.',
'doors_number': 3,
'emission_standard': 'Euro 5',
'engine': '1.25L',
'engine_horse_power': 81,
'fuel_type': 'Petrol',
'id': '39975875-78f4-55ce-b127-e42a50d86252',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602059708271',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 74000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 46,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39975875-78f4-55ce-b127-e42a50d86252/39975875-78f4-55ce-b127-e42a50d86252_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 556720,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/dc7fd5af15d04790ae5f14c59fa25931.jpg',
'Width': 2048}],
'price': 3695,
'price_includes_vat': True,
'registration_date': '2013-12-11',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.25 Zetec Euro 5 3dr',
'transmission': 'manual',
'trim': 'Zetec',
'year': 2013}
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602059708271%27 HTTP/1.1" 200 None
2026-03-26 09:56:54 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602059708271: {'created_time': 1774519014.961985, 'last_price_update_time': 1774519014.961996}
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602059708271') HTTP/1.1" 204 0
2026-03-26 09:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/d8d80810af0e491ab402d52f822ee992.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:54 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 09:56:54 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 8082d6b2-e73c-5d5b-bd89-cde43d2d3f43 with identifier: 202306289028005
2026-03-26 09:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8082d6b2-e73c-5d5b-bd89-cde43d2d3f43
2026-03-26 09:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6e44931777da4eb5979ddb6f71f07f4c.jpg%27 HTTP/1.1" 200 None
2026-03-26 09:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6e44931777da4eb5979ddb6f71f07f4c.jpg not downloaded yet
2026-03-26 09:56:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/9cd9a4ea19a54d839c47c289258214b0.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/d65f031527eb43c6a69cb9483772ff6d.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f192e410>
2026-03-26 09:56:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82cca6d2-d826-5422-844c-705830a24ddb/82cca6d2-d826-5422-844c-705830a24ddb_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb688c67c143e46cf84d9b05f855e57cf.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b688c67c143e46cf84d9b05f855e57cf.jpg saved to cache
2026-03-26 09:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82cca6d2-d826-5422-844c-705830a24ddb
2026-03-26 09:56:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82cca6d2-d826-5422-844c-705830a24ddb sending to next pipeline
2026-03-26 09:56:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f2493b50>
2026-03-26 09:56:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a601cd67-eeef-5573-b138-41c6a8278129/a601cd67-eeef-5573-b138-41c6a8278129_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff0f9ebfc22ef40d687dc58fe11401786.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f0f9ebfc22ef40d687dc58fe11401786.jpg saved to cache
2026-03-26 09:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a601cd67-eeef-5573-b138-41c6a8278129
2026-03-26 09:56:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a601cd67-eeef-5573-b138-41c6a8278129 sending to next pipeline
2026-03-26 09:56:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/693f6ebaa8e14576985bab4d923760dd.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:55 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 82cca6d2-d826-5422-844c-705830a24ddb with identifier 202602029599747
2026-03-26 09:56:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:55 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 82cca6d2-d826-5422-844c-705830a24ddb
2026-03-26 09:56:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/b688c67c143e46cf84d9b05f855e57cf.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'color': 'White',
'currency': 'GBP',
'description': 'This 2013 Hyundai ix35 CRDi Style is presented with an MOT '
'valid until August 2026, offering peace of mind for the '
'coming years. This 1.7 litre diesel model, with its Style '
'trim, has a partial service history, with its last service '
'completed on 9th August 2024 at 43330 miles. with 5 service '
'stamps, last owner since 2020, It comes equipped with '
'essential features such as air conditioning to keep you '
'comfortable, and reversing sensors to aid with parking.\n'
'\n'
'Further enhancing your driving experience, this ix35 includes '
'heated front and rear outer rear seat bases, perfect for '
'colder journeys. Stay connected on the go with Bluetooth '
'connectivity and voice recognition. These features, combined '
'with its reliable diesel engine and the extended MOT, make '
'this Hyundai ix35 a well considered choice.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.7L',
'engine_horse_power': 113,
'fuel_type': 'Diesel',
'id': '82cca6d2-d826-5422-844c-705830a24ddb',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602029599747',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'Hyundai',
'model': 'ix35',
'odometer': 62000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 48,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82cca6d2-d826-5422-844c-705830a24ddb/82cca6d2-d826-5422-844c-705830a24ddb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 529061,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b688c67c143e46cf84d9b05f855e57cf.jpg',
'Width': 2048}],
'price': 4395,
'price_includes_vat': True,
'registration_date': '2013-10-21',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai ix35 1.7 CRDi Style Euro 5 (s/s) 5dr',
'transmission': 'manual',
'trim': 'Style',
'year': 2013}
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602029599747%27 HTTP/1.1" 200 None
2026-03-26 09:56:55 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602029599747: {'created_time': 1774519015.300538, 'last_price_update_time': 1774519015.300547}
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602029599747') HTTP/1.1" 204 0
2026-03-26 09:56:55 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a601cd67-eeef-5573-b138-41c6a8278129 with identifier 202602190068491
2026-03-26 09:56:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:55 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a601cd67-eeef-5573-b138-41c6a8278129
2026-03-26 09:56:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/f0f9ebfc22ef40d687dc58fe11401786.jpg>
{'auction_title': '',
'c_o_2_emission_value': 102,
'color': 'Black',
'currency': 'GBP',
'description': 'This 2014 Audi A3 TDI S line offers excellent value with a '
'recent service in September 2023 at 69,428 miles, and will '
'come with a full 12 months MOT for your peace of mind. Only '
'£20.00 pound tax a year. Cambelt & water pump done @ 99,846 '
'miles on 02/10/2025, Gearbox last serviced @ 61,198 miles on '
'17/10/2022, This particular A3 is a 1.6 litre diesel model, '
'boasting Euro 6 emissions compliance and a desirable S line '
"trim. Inside you'll find dual zone electronic climate control "
'to keep everyone comfortable, and the convenience of '
'Bluetooth connectivity for your mobile telephone preparation. '
'The Bi-Xenon Plus headlights provide excellent visibility.\n'
'\n'
'This Audi A3 is designed to be economical and practical. Its '
'impressive fuel economy of up to 72 miles per gallon, '
'combined with low CO2 emissions, means it is kinder to your '
'wallet and the environment. Furthermore, its low insurance '
'group rating indicates that running costs are kept to a '
"minimum. You'll also appreciate the generous boot space, "
'making it a versatile choice for everyday use and longer '
'journeys.',
'doors_number': 3,
'emission_standard': 'Euro 6',
'engine': '1.6L',
'engine_horse_power': 108,
'fuel_type': 'Diesel',
'id': 'a601cd67-eeef-5573-b138-41c6a8278129',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602190068491',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'Audi',
'model': 'A3',
'odometer': 103000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 53,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a601cd67-eeef-5573-b138-41c6a8278129/a601cd67-eeef-5573-b138-41c6a8278129_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 710869,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f0f9ebfc22ef40d687dc58fe11401786.jpg',
'Width': 2048}],
'price': 7095,
'price_includes_vat': True,
'registration_date': '2014-11-15',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A3 1.6 TDI S line S Tronic Euro 6 (s/s) 3dr',
'transmission': 'automatic',
'trim': 'S line',
'year': 2014}
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602190068491%27 HTTP/1.1" 200 None
2026-03-26 09:56:55 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602190068491: {'created_time': 1774519015.35409, 'last_price_update_time': 1774519015.354099}
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602190068491') HTTP/1.1" 204 0
2026-03-26 09:56:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/dbaef1eda9b646d590a0dc98344075fd.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f1907790>
2026-03-26 09:56:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52c2b6d8-6c5d-565c-adb2-ca85ce0e2025/52c2b6d8-6c5d-565c-adb2-ca85ce0e2025_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe9f2e65463454a7c9bd77add83fff40d.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e9f2e65463454a7c9bd77add83fff40d.jpg saved to cache
2026-03-26 09:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 52c2b6d8-6c5d-565c-adb2-ca85ce0e2025
2026-03-26 09:56:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 52c2b6d8-6c5d-565c-adb2-ca85ce0e2025 sending to next pipeline
2026-03-26 09:56:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f183bbd0>
2026-03-26 09:56:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a14ba5d-46fc-5b2c-8efc-09cc07b3d352/4a14ba5d-46fc-5b2c-8efc-09cc07b3d352_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd8d80810af0e491ab402d52f822ee992.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d8d80810af0e491ab402d52f822ee992.jpg saved to cache
2026-03-26 09:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4a14ba5d-46fc-5b2c-8efc-09cc07b3d352
2026-03-26 09:56:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4a14ba5d-46fc-5b2c-8efc-09cc07b3d352 sending to next pipeline
2026-03-26 09:56:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f1ad3510>
2026-03-26 09:56:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f01c70a-75f5-51bc-93f5-48f5f6c4fc35/3f01c70a-75f5-51bc-93f5-48f5f6c4fc35_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9cd9a4ea19a54d839c47c289258214b0.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9cd9a4ea19a54d839c47c289258214b0.jpg saved to cache
2026-03-26 09:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f01c70a-75f5-51bc-93f5-48f5f6c4fc35
2026-03-26 09:56:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f01c70a-75f5-51bc-93f5-48f5f6c4fc35 sending to next pipeline
2026-03-26 09:56:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f24a2c50>
2026-03-26 09:56:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73cc3dd8-b572-5fb3-8a8d-001a1d8b8998/73cc3dd8-b572-5fb3-8a8d-001a1d8b8998_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd65f031527eb43c6a69cb9483772ff6d.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d65f031527eb43c6a69cb9483772ff6d.jpg saved to cache
2026-03-26 09:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73cc3dd8-b572-5fb3-8a8d-001a1d8b8998
2026-03-26 09:56:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73cc3dd8-b572-5fb3-8a8d-001a1d8b8998 sending to next pipeline
2026-03-26 09:56:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f639f890>
2026-03-26 09:56:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13db7039-6337-5574-92ef-ec13483b211a/13db7039-6337-5574-92ef-ec13483b211a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F693f6ebaa8e14576985bab4d923760dd.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/693f6ebaa8e14576985bab4d923760dd.jpg saved to cache
2026-03-26 09:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13db7039-6337-5574-92ef-ec13483b211a
2026-03-26 09:56:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 13db7039-6337-5574-92ef-ec13483b211a sending to next pipeline
2026-03-26 09:56:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/fb1744ed13404f9f9c87801c26d55c3e.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:55 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 52c2b6d8-6c5d-565c-adb2-ca85ce0e2025 with identifier 202601259413634
2026-03-26 09:56:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:55 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 52c2b6d8-6c5d-565c-adb2-ca85ce0e2025
2026-03-26 09:56:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/e9f2e65463454a7c9bd77add83fff40d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'Silver',
'currency': 'GBP',
'description': 'This 2009 Ford Ka Studio is presented with an MOT valid until '
'February 2027, offering peace of mind for the coming years. '
'This particular Ka is equipped with a 1.2 litre petrol engine '
'and benefits from a clear vehicle history check. While the '
'service history is partial, the last service was completed on '
'11 June 2024 at 98,482 miles. Clutch kit fitted on 01/03/2025 '
'@105,281 miles.\n'
'\n'
'The Ford Ka Studio is designed to be economical, boasting an '
'impressive fuel economy of 55 miles per gallon. This model '
'also sits within a low insurance group, making it an '
'affordable choice for many drivers. Furthermore, its low CO2 '
'emissions contribute to its cost effectiveness and '
'environmental consideration, indicating it is a more '
'efficient option compared to many other vehicles in its '
'class.',
'doors_number': 3,
'emission_standard': 'Euro 4',
'engine': '1.2L',
'engine_horse_power': 68,
'fuel_type': 'Petrol',
'id': '52c2b6d8-6c5d-565c-adb2-ca85ce0e2025',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601259413634',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'Ford',
'model': 'Ka',
'odometer': 111000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 32,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52c2b6d8-6c5d-565c-adb2-ca85ce0e2025/52c2b6d8-6c5d-565c-adb2-ca85ce0e2025_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 537449,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e9f2e65463454a7c9bd77add83fff40d.jpg',
'Width': 2048}],
'price': 1495,
'price_includes_vat': True,
'registration_date': '2009-05-29',
'seats_number': 4,
'seller_name': None,
'title': 'Ford KA 1.2 Studio Euro 4 3dr',
'transmission': 'manual',
'trim': 'Studio',
'year': 2009}
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601259413634%27 HTTP/1.1" 200 None
2026-03-26 09:56:55 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601259413634: {'created_time': 1774519015.853367, 'last_price_update_time': 1774519015.853377}
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601259413634') HTTP/1.1" 204 0
2026-03-26 09:56:55 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 4a14ba5d-46fc-5b2c-8efc-09cc07b3d352 with identifier 202511238082124
2026-03-26 09:56:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:55 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 4a14ba5d-46fc-5b2c-8efc-09cc07b3d352
2026-03-26 09:56:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/d8d80810af0e491ab402d52f822ee992.jpg>
{'auction_title': '',
'c_o_2_emission_value': 120,
'color': 'Black',
'currency': 'GBP',
'description': 'This 2015 Fiat 500L Lounge offers excellent peace of mind '
'with its MOT valid until December 2026. This 1.6L diesel '
'model has covered a low mileage of 71,000 miles for its age '
'and benefits from a partial service history, with its last '
'service completed on 24th February 2025 at 63,847 miles with '
'5 service stamps, 2 Keys, Only £35.00 pound tax a year, '
'Cambelt & Water pump changed @ 53,992 miles on 06/04/2022, '
'Clutch kit & Flywheel changed on 03/02/2025. The Lounge trim '
'provides a comfortable and well equipped interior, featuring '
'an electric sunroof, automatic dusk sensing headlights, and '
"rear parking sensors for added convenience. You'll also find "
'Bluetooth connectivity for seamless integration of your '
'devices.\n'
'\n'
'FINANCE AVAILABLE PLEASE VISIT WWW.ARCQWUALITYCARS.CO.UK\n'
'\n'
'The Fiat 500L Lounge stands out with its impressive '
'practicality, offering seating for seven passengers and a '
'large boot space, making it ideal for families or those '
'needing extra carrying capacity. Its 1.6L diesel engine '
'delivers a respectable 0-62mph acceleration in 11.1 seconds, '
'providing a balanced performance for everyday driving. These '
'features collectively indicate a vehicle that is well '
'maintained and offers greater versatility compared to many '
'other similar cars on the market.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.6L',
'engine_horse_power': 120,
'fuel_type': 'Diesel',
'id': '4a14ba5d-46fc-5b2c-8efc-09cc07b3d352',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511238082124',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'Fiat',
'model': '500L',
'odometer': 71000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 52,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a14ba5d-46fc-5b2c-8efc-09cc07b3d352/4a14ba5d-46fc-5b2c-8efc-09cc07b3d352_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 654144,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d8d80810af0e491ab402d52f822ee992.jpg',
'Width': 2048}],
'price': 4595,
'price_includes_vat': True,
'registration_date': '2015-03-30',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat 500L 1.6 MultiJet Lounge MPW Euro 5 (s/s) 5dr',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2015}
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511238082124%27 HTTP/1.1" 200 None
2026-03-26 09:56:55 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511238082124: {'created_time': 1774519015.898777, 'last_price_update_time': 1774519015.898786}
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511238082124') HTTP/1.1" 204 0
2026-03-26 09:56:55 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 3f01c70a-75f5-51bc-93f5-48f5f6c4fc35 with identifier 202511177949989
2026-03-26 09:56:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:55 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 3f01c70a-75f5-51bc-93f5-48f5f6c4fc35
2026-03-26 09:56:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/9cd9a4ea19a54d839c47c289258214b0.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'color': 'Grey',
'currency': 'GBP',
'description': 'With an MOT valid until October 2026, this 2018 Audi A3 TFSI '
'S line offers excellent peace of mind. This Euro 6 compliant '
'1.5 litre petrol model presents well with its S line trim, '
'and benefits from a clear vehicle history check. While the '
'service history is partial, the last service was completed on '
'4th October 2025 at 101,201 miles with 7 Services, 2 keys, '
'Just had all round Discs & pads done, Notable features '
'include rear parking sensors for easier manoeuvring, a '
'Bluetooth interface for seamless connectivity, and striking '
'LED headlights with dynamic rear indicators. The auto dimming '
'rear view mirror, coupled with light and rain sensors, '
'enhances driving convenience, as does the dual zone '
'electronic climate control.\n'
'\n'
'FINANCE AVAILABLE ON OUR WEBSITE WWW.ARCQUALITYCARS.CO.UK\n'
'\n'
'This Audi A3 TFSI S line stands out with its impressive fuel '
'economy, achieving a highlighted 54 miles per gallon, making '
'it an economical choice for your daily journeys. Its '
'acceleration from 0 to 62 miles per hour in just 8.2 seconds '
'demonstrates a responsive driving experience. Furthermore, '
'the generous boot space ensures practicality for shopping '
'trips or luggage. These highlights indicate that this Audi A3 '
'offers a compelling combination of efficiency, performance, '
'and usability compared to other vehicles in its class',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 148,
'fuel_type': 'Petrol',
'id': '3f01c70a-75f5-51bc-93f5-48f5f6c4fc35',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511177949989',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'Audi',
'model': 'A3',
'odometer': 100000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 55,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f01c70a-75f5-51bc-93f5-48f5f6c4fc35/3f01c70a-75f5-51bc-93f5-48f5f6c4fc35_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 780243,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9cd9a4ea19a54d839c47c289258214b0.jpg',
'Width': 2048}],
'price': 9195,
'price_includes_vat': True,
'registration_date': '2018-03-15',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A3 1.5 TFSI CoD S line Sportback Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'S line',
'year': 2018}
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511177949989%27 HTTP/1.1" 200 None
2026-03-26 09:56:55 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511177949989: {'created_time': 1774519015.944144, 'last_price_update_time': 1774519015.944154}
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511177949989') HTTP/1.1" 204 0
2026-03-26 09:56:55 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 73cc3dd8-b572-5fb3-8a8d-001a1d8b8998 with identifier 202512048352833
2026-03-26 09:56:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:55 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 73cc3dd8-b572-5fb3-8a8d-001a1d8b8998
2026-03-26 09:56:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/d65f031527eb43c6a69cb9483772ff6d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 144,
'color': 'Grey',
'currency': 'GBP',
'description': 'This 2014 Audi A4 Avant TDI Black Edition offers a compelling '
'blend of performance and premium features, boasting a recent '
'service completed on 3rd June 2025 at 121,309 miles, '
'supported by partial service history with 6 service stamps. '
'This four wheel drive model is equipped with a 2.0 litre '
'diesel engine, delivering an impressive 0-62mph acceleration '
'in just 8.0 seconds. Inside, you will find a sophisticated '
'cabin featuring electronic three zone climate control, a Bang '
'and Olufsen sound system for an exceptional audio experience, '
'and Bluetooth connectivity for seamless mobile telephone '
'integration.\n'
'\n'
'FINANCE AVAILABLE ON OUR WEBSITE WWW.ARCQUALITYCARS.CO.UK\n'
'\n'
'The Black Edition trim enhances the already stylish A4 Avant, '
'and for added convenience, rear parking sensors are included '
'to assist with manoeuvring. The inclusion of an SDHC card '
"reader further adds to the car's practicality. These "
'features, combined with its dynamic performance and the '
'assurance of a recent service, position this Audi A4 Avant '
'TDI Black Edition as a distinguished choice within its class.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '2L',
'engine_horse_power': 175,
'fuel_type': 'Diesel',
'id': '73cc3dd8-b572-5fb3-8a8d-001a1d8b8998',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512048352833',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'Audi',
'model': 'A4 Avant',
'odometer': 129000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 56,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73cc3dd8-b572-5fb3-8a8d-001a1d8b8998/73cc3dd8-b572-5fb3-8a8d-001a1d8b8998_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 863103,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d65f031527eb43c6a69cb9483772ff6d.jpg',
'Width': 2048}],
'price': 7095,
'price_includes_vat': True,
'registration_date': '2014-09-15',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A4 Avant 2.0 TDI Black Edition S Tronic quattro Euro 5 (s/s) '
'5dr',
'transmission': 'automatic',
'trim': 'Black Edition',
'year': 2014}
2026-03-26 09:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512048352833%27 HTTP/1.1" 200 None
2026-03-26 09:56:56 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512048352833: {'created_time': 1774519016.000679, 'last_price_update_time': 1774519016.000688}
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512048352833') HTTP/1.1" 204 0
2026-03-26 09:56:56 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 13db7039-6337-5574-92ef-ec13483b211a with identifier 202601229353671
2026-03-26 09:56:56 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:56 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:56 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 13db7039-6337-5574-92ef-ec13483b211a
2026-03-26 09:56:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/693f6ebaa8e14576985bab4d923760dd.jpg>
{'auction_title': '',
'c_o_2_emission_value': 125,
'color': 'Black',
'currency': 'GBP',
'description': 'This Mercedes-Benz C Class C220 CDI Executive SE from 2012 '
'boasts an impressive MOT valid until September 2026, offering '
'peace of mind for the coming years. With only three previous '
'owners and a partial service history, including a last '
'service recorded at 66,198 miles on 1st April 2021, 2 keys, '
'last owner since 2020, this vehicle has been well looked '
'after. The Executive SE trim level comes equipped with '
'desirable features such as Parktronic for both front and rear '
'parking assistance, a Bluetooth interface for hands-free '
'calls, automatic headlights, and dual zone automatic climate '
'control, ensuring comfort and convenience for both driver and '
'passenger.\n'
'\n'
'This C220 CDI Executive SE stands out with its remarkable '
'fuel economy, achieving an impressive 64 miles per gallon, '
'which is a significant advantage over many other vehicles in '
'its class. Furthermore, its low CO2 emissions contribute to a '
'more environmentally conscious driving experience. These '
'highlights demonstrate the efficiency and thoughtful design '
'of this Mercedes-Benz, making it a compelling choice for '
'those seeking a refined and economical executive saloon.',
'doors_number': 4,
'emission_standard': 'Euro 5',
'engine': '2.1L',
'engine_horse_power': 168,
'fuel_type': 'Diesel',
'id': '13db7039-6337-5574-92ef-ec13483b211a',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601229353671',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'Mercedes-Benz',
'model': 'C Class',
'odometer': 120000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 53,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13db7039-6337-5574-92ef-ec13483b211a/13db7039-6337-5574-92ef-ec13483b211a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 761812,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/693f6ebaa8e14576985bab4d923760dd.jpg',
'Width': 2048}],
'price': 3695,
'price_includes_vat': True,
'registration_date': '2012-08-27',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz C Class 2.1 C220 CDI BlueEfficiency Executive SE '
'G-Tronic+ Euro 5 (s/s) 4dr',
'transmission': 'automatic',
'trim': 'Executive SE',
'year': 2012}
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601229353671%27 HTTP/1.1" 200 None
2026-03-26 09:56:56 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601229353671: {'created_time': 1774519016.047618, 'last_price_update_time': 1774519016.047629}
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601229353671') HTTP/1.1" 204 0
2026-03-26 09:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/6299b01269aa427796dd41dde47a659e.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f24777d0>
2026-03-26 09:56:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01be161a-9122-554e-b09b-a8a859aa817d/01be161a-9122-554e-b09b-a8a859aa817d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdbaef1eda9b646d590a0dc98344075fd.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dbaef1eda9b646d590a0dc98344075fd.jpg saved to cache
2026-03-26 09:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 01be161a-9122-554e-b09b-a8a859aa817d
2026-03-26 09:56:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 01be161a-9122-554e-b09b-a8a859aa817d sending to next pipeline
2026-03-26 09:56:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f2387d50>
2026-03-26 09:56:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86e3fc2a-bcd7-588d-925b-47024230be6d/86e3fc2a-bcd7-588d-925b-47024230be6d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffb1744ed13404f9f9c87801c26d55c3e.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fb1744ed13404f9f9c87801c26d55c3e.jpg saved to cache
2026-03-26 09:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 86e3fc2a-bcd7-588d-925b-47024230be6d
2026-03-26 09:56:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 86e3fc2a-bcd7-588d-925b-47024230be6d sending to next pipeline
2026-03-26 09:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/6e6aec5699f7480fbc32b45dd3024dbb.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/203ce993736a4e4a910bfe80109d601a.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:56 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 01be161a-9122-554e-b09b-a8a859aa817d with identifier 202511157910608
2026-03-26 09:56:56 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:56 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:56 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 01be161a-9122-554e-b09b-a8a859aa817d
2026-03-26 09:56:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/dbaef1eda9b646d590a0dc98344075fd.jpg>
{'auction_title': '',
'c_o_2_emission_value': 116,
'color': 'Blue',
'currency': 'GBP',
'description': 'This 2014 Kia Ceed CRDi 2 presents a compelling option with '
'its partial service history, last serviced at 118,546 miles '
'on 7th January 2025 with 6 service stamps, only £35.00 tax, 2 '
'keys, This 1.6 litre diesel model, in the 2 trim, offers a '
'practical and well equipped driving experience. Notable '
'features include air conditioning to keep you comfortable, '
'rear parking sensors to assist with manoeuvring, and '
'Bluetooth hands free connectivity for safe and convenient '
'calls, along with Bluetooth with music streaming for your '
'entertainment.\n'
'\n'
'The Kia Ceed CRDi 2 stands out with its impressive fuel '
'economy, achieving an excellent 64 miles per gallon, which '
'indicates it is more economical than many other vehicles in '
'its class. Furthermore, its low CO2 emissions contribute to a '
'more environmentally friendly drive. This model also benefits '
'from a low insurance group, suggesting that running costs '
'will be more affordable compared to similar cars.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.6L',
'engine_horse_power': 126,
'fuel_type': 'Diesel',
'id': '01be161a-9122-554e-b09b-a8a859aa817d',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511157910608',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'Kia',
'model': 'Ceed',
'odometer': 122000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 48,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01be161a-9122-554e-b09b-a8a859aa817d/01be161a-9122-554e-b09b-a8a859aa817d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 778851,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/dbaef1eda9b646d590a0dc98344075fd.jpg',
'Width': 2048}],
'price': 2795,
'price_includes_vat': True,
'registration_date': '2014-02-10',
'seats_number': 5,
'seller_name': None,
'title': 'KIA Ceed 1.6 CRDi EcoDynamics 2 Sportswagon Euro 5 (s/s) 5dr',
'transmission': 'manual',
'trim': '2',
'year': 2014}
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511157910608%27 HTTP/1.1" 200 None
2026-03-26 09:56:56 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511157910608: {'created_time': 1774519016.34709, 'last_price_update_time': 1774519016.347099}
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511157910608') HTTP/1.1" 204 0
2026-03-26 09:56:56 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 86e3fc2a-bcd7-588d-925b-47024230be6d with identifier 202601229329531
2026-03-26 09:56:56 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:56 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:56 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 86e3fc2a-bcd7-588d-925b-47024230be6d
2026-03-26 09:56:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/fb1744ed13404f9f9c87801c26d55c3e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 128,
'color': 'Grey',
'currency': 'GBP',
'description': 'This 2017 Vauxhall Astra i Turbo Design is a great find, '
'having been looked after by only two owners and benefiting '
'from a recent service in January 2024 at 82,176 miles with 5 '
'service stamps, 2 keys, last owner since 2019. This Euro 6 '
'compliant 1.4 litre petrol model comes with a 12 month MOT '
"for your peace of mind. Inside, you'll find the R4.0 "
'IntelliLink touch screen infotainment system, complete with '
'Android Auto and Apple CarPlay for seamless smartphone '
'integration, plus Bluetooth connectivity. The car also '
'features Automatic Lighting Control, ensuring your headlights '
'come on when needed, and air conditioning for a comfortable '
'drive.\n'
'\n'
'The Astra i Turbo Design offers a compelling blend of '
'performance and practicality. Its acceleration from 0 to '
'60mph in just 8.6 seconds demonstrates a lively performance '
'that sets it apart from many other vehicles in its class. '
'Furthermore, the generous boot space provides ample room for '
'shopping, luggage, or sports equipment, making it a versatile '
'choice for everyday use and longer journeys.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.4L',
'engine_horse_power': 123,
'fuel_type': 'Petrol',
'id': '86e3fc2a-bcd7-588d-925b-47024230be6d',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601229329531',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'Vauxhall',
'model': 'Astra',
'odometer': 98000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 49,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e3fc2a-bcd7-588d-925b-47024230be6d/86e3fc2a-bcd7-588d-925b-47024230be6d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 639599,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fb1744ed13404f9f9c87801c26d55c3e.jpg',
'Width': 2048}],
'price': 4195,
'price_includes_vat': True,
'registration_date': '2017-12-31',
'seats_number': 5,
'seller_name': None,
'title': 'Vauxhall Astra 1.4i Turbo Design Euro 6 5dr',
'transmission': 'manual',
'trim': 'Design',
'year': 2017}
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601229329531%27 HTTP/1.1" 200 None
2026-03-26 09:56:56 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601229329531: {'created_time': 1774519016.394537, 'last_price_update_time': 1774519016.394547}
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601229329531') HTTP/1.1" 204 0
2026-03-26 09:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/32e2812896dc4294a6b94e246dbcab9f.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/970b0fe2a1f14fa0987b5202025327db.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f2583950>
2026-03-26 09:56:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c75038a-e780-5001-ad31-6395feff79eb/0c75038a-e780-5001-ad31-6395feff79eb_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6299b01269aa427796dd41dde47a659e.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6299b01269aa427796dd41dde47a659e.jpg saved to cache
2026-03-26 09:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0c75038a-e780-5001-ad31-6395feff79eb
2026-03-26 09:56:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0c75038a-e780-5001-ad31-6395feff79eb sending to next pipeline
2026-03-26 09:56:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f2582d90>
2026-03-26 09:56:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac2956d9-da42-575f-88c8-621e213c97b3/ac2956d9-da42-575f-88c8-621e213c97b3_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6e6aec5699f7480fbc32b45dd3024dbb.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6e6aec5699f7480fbc32b45dd3024dbb.jpg saved to cache
2026-03-26 09:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ac2956d9-da42-575f-88c8-621e213c97b3
2026-03-26 09:56:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ac2956d9-da42-575f-88c8-621e213c97b3 sending to next pipeline
2026-03-26 09:56:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f2f76bd0>
2026-03-26 09:56:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ddeb5f9-3cc8-5c71-9d26-c378d95a101b/8ddeb5f9-3cc8-5c71-9d26-c378d95a101b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F203ce993736a4e4a910bfe80109d601a.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/203ce993736a4e4a910bfe80109d601a.jpg saved to cache
2026-03-26 09:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ddeb5f9-3cc8-5c71-9d26-c378d95a101b
2026-03-26 09:56:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ddeb5f9-3cc8-5c71-9d26-c378d95a101b sending to next pipeline
2026-03-26 09:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/c7b9de5e0cb2431a81b0ab9f5672a4c1.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/a58ad7d62b0d4d45827141c796f1bc7c.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:56 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 0c75038a-e780-5001-ad31-6395feff79eb with identifier 202511047654940
2026-03-26 09:56:56 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:56 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:56 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 0c75038a-e780-5001-ad31-6395feff79eb
2026-03-26 09:56:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/6299b01269aa427796dd41dde47a659e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'Silver',
'currency': 'GBP',
'description': 'This 2016 BMW i3 boasts exceptionally low mileage for its '
'age, having covered just 40,000 miles. As an electric '
'vehicle, it offers a clean and efficient driving experience. '
'This particular model comes with a 22 kWh battery, providing '
'a maximum range of 100 miles when new, and can be fully '
'charged at home using a 7kW charger in approximately 3 hours. '
'12 months mot and while the service history is partial, the '
'last service was completed on 21 January 2025 at 38,086 '
'miles. Only £20.00 tax a year, 2 keys, Notable features '
'include a Reversing Assist Camera with Parking Assistance, a '
'Winter Package with heated seats, Comfort Access System for '
'keyless entry, Enhanced Bluetooth Telephone Preparation with '
'USB Audio Interface, and the Media Package BMW Professional.\n'
'\n'
'FINANCE AVAILABLE PLEASE VISIT OUR WEBSITE '
'WWW.ARCQUALITYCARS.CO.UK\n'
'\n'
'The BMW i3 delivers impressive performance, accelerating from '
'0 to 62mph in a swift 7.2 seconds, demonstrating its dynamic '
'capabilities. This acceleration figure is notably quicker '
'than many other electric vehicles in its class, offering a '
'more engaging drive. The inclusion of features like the '
'heated seats and keyless entry further enhances the comfort '
'and convenience, setting it apart from standard models and '
'providing a superior ownership experience.',
'doors_number': 5,
'engine_horse_power': 168,
'fuel_type': 'Electric',
'id': '0c75038a-e780-5001-ad31-6395feff79eb',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511047654940',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'BMW',
'model': 'i3',
'odometer': 40000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 52,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c75038a-e780-5001-ad31-6395feff79eb/0c75038a-e780-5001-ad31-6395feff79eb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 575900,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6299b01269aa427796dd41dde47a659e.jpg',
'Width': 2048}],
'price': 7595,
'price_includes_vat': True,
'registration_date': '2016-01-20',
'seats_number': 4,
'seller_name': None,
'title': 'BMW i3 Auto 5dr',
'transmission': 'automatic',
'year': 2014}
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511047654940%27 HTTP/1.1" 200 None
2026-03-26 09:56:56 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511047654940: {'created_time': 1774519016.742315, 'last_price_update_time': 1774519016.742324}
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511047654940') HTTP/1.1" 204 0
2026-03-26 09:56:56 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ac2956d9-da42-575f-88c8-621e213c97b3 with identifier 202510297507401
2026-03-26 09:56:56 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:56 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:56 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ac2956d9-da42-575f-88c8-621e213c97b3
2026-03-26 09:56:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/6e6aec5699f7480fbc32b45dd3024dbb.jpg>
{'auction_title': '',
'c_o_2_emission_value': 105,
'color': 'Black',
'currency': 'GBP',
'description': 'This 2015 Audi A3 TDI Sport is presented with a clear vehicle '
'history check and benefits from a recent service on 2025 02 '
'03 at 85622 miles, alongside a partial service history with 7 '
'service stamps, 2 keys, Only £20.00 pound tax a year, New '
'clutch kit fitted. This Euro 6 compliant 1.6 litre diesel '
'model offers a smooth driving experience and comes equipped '
'with a Dual Zone Electronic Climate Control system for '
'personalised comfort, Mobile Telephone Preparation with a '
'Bluetooth interface for seamless connectivity, and Full '
'European Map Data to guide your journeys.\n'
'\n'
'FINANCE AVAILABLE PLEASE VISIT OUR WEBSITE '
'WWW.ARCQUALITYCARS.CO.UK\n'
'\n'
'The Audi A3 TDI Sport is a practical choice, boasting a '
'generous boot space perfect for luggage or shopping. Its '
'appeal is further enhanced by its position within a low '
'insurance group, making it an economical option for many '
'drivers. With 12 months MOT provided on purchase, this '
'vehicle offers peace of mind and represents a well maintained '
'example of the popular A3 model.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.6L',
'engine_horse_power': 108,
'fuel_type': 'Diesel',
'id': 'ac2956d9-da42-575f-88c8-621e213c97b3',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510297507401',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'Audi',
'model': 'A3',
'odometer': 90000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 54,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac2956d9-da42-575f-88c8-621e213c97b3/ac2956d9-da42-575f-88c8-621e213c97b3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 594599,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6e6aec5699f7480fbc32b45dd3024dbb.jpg',
'Width': 2048}],
'price': 6895,
'price_includes_vat': True,
'registration_date': '2015-10-30',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A3 1.6 TDI Sport Sportback Euro 6 (s/s) 5dr (Nav)',
'transmission': 'manual',
'trim': 'Sport',
'year': 2015}
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510297507401%27 HTTP/1.1" 200 None
2026-03-26 09:56:56 [auto_selling_autotrader.co.uk] INFO: Saving data for 202510297507401: {'created_time': 1774519016.794771, 'last_price_update_time': 1774519016.794782}
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510297507401') HTTP/1.1" 204 0
2026-03-26 09:56:56 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 8ddeb5f9-3cc8-5c71-9d26-c378d95a101b with identifier 202509015951706
2026-03-26 09:56:56 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:56 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:56 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 8ddeb5f9-3cc8-5c71-9d26-c378d95a101b
2026-03-26 09:56:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/203ce993736a4e4a910bfe80109d601a.jpg>
{'auction_title': '',
'c_o_2_emission_value': 154,
'color': 'Brown',
'currency': 'GBP',
'description': 'This 2013 Honda CR-V i-DTEC SR boasts a recent service in '
'June 2024 at 98,439 miles, with 7 service stamps, with its '
'MOT valid until June 2026, offering peace of mind for its '
'next owner. This capable Four Wheel Drive model is powered by '
'a 2.2 litre diesel engine and comes with a partial service '
'history. Last owner since 2017. new clutch kit fitted in '
"March 2025. Inside, you'll find convenient features such as "
'Bluetooth Hands Free Telephone for seamless connectivity, '
'front and rear parking sensors, and a rear view parking '
'camera to assist with manoeuvring. The CR-V also features '
'Bi-HID headlights with auto levelling for enhanced '
'visibility.\n'
'\n'
'FINANCE AVAILABLE PLEASE VISIT OUR WEBSITE '
'WWW.ARCQUALITYCARS.CO.UK\n'
'\n'
'The Honda CR-V i-DTEC SR stands out with its generous boot '
'space, making it ideal for families or those who need ample '
'room for luggage or shopping. Furthermore, its placement in a '
'low insurance group indicates that running costs are likely '
'to be more affordable compared to similar vehicles. These '
'aspects, combined with its practical features and reliable '
'Honda engineering, make this CR-V a compelling choice for '
'everyday driving.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '2.2L',
'engine_horse_power': 148,
'fuel_type': 'Diesel',
'id': '8ddeb5f9-3cc8-5c71-9d26-c378d95a101b',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509015951706',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'Honda',
'model': 'CR-V',
'odometer': 103000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 51,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ddeb5f9-3cc8-5c71-9d26-c378d95a101b/8ddeb5f9-3cc8-5c71-9d26-c378d95a101b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 627410,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/203ce993736a4e4a910bfe80109d601a.jpg',
'Width': 2048}],
'price': 5495,
'price_includes_vat': True,
'registration_date': '2013-04-30',
'seats_number': 5,
'seller_name': None,
'title': 'Honda Cr-V 2.2 i-DTEC SR 4WD Euro 5 (s/s) 5dr',
'transmission': 'manual',
'trim': 'SR',
'year': 2013}
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509015951706%27 HTTP/1.1" 200 None
2026-03-26 09:56:56 [auto_selling_autotrader.co.uk] INFO: Saving data for 202509015951706: {'created_time': 1774519016.856272, 'last_price_update_time': 1774519016.856283}
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509015951706') HTTP/1.1" 204 0
2026-03-26 09:56:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f4b81810>
2026-03-26 09:56:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ab21939-c1d7-512b-8e2c-ba681836a83b/6ab21939-c1d7-512b-8e2c-ba681836a83b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F32e2812896dc4294a6b94e246dbcab9f.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/32e2812896dc4294a6b94e246dbcab9f.jpg saved to cache
2026-03-26 09:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6ab21939-c1d7-512b-8e2c-ba681836a83b
2026-03-26 09:56:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6ab21939-c1d7-512b-8e2c-ba681836a83b sending to next pipeline
2026-03-26 09:56:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f4b7f850>
2026-03-26 09:56:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3f32421-e107-5832-a9a2-390d875eb2ef/e3f32421-e107-5832-a9a2-390d875eb2ef_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F970b0fe2a1f14fa0987b5202025327db.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/970b0fe2a1f14fa0987b5202025327db.jpg saved to cache
2026-03-26 09:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e3f32421-e107-5832-a9a2-390d875eb2ef
2026-03-26 09:56:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e3f32421-e107-5832-a9a2-390d875eb2ef sending to next pipeline
2026-03-26 09:56:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f2f6f250>
2026-03-26 09:56:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b14ffbe-273d-57f2-9156-ea05987d93b9/4b14ffbe-273d-57f2-9156-ea05987d93b9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc7b9de5e0cb2431a81b0ab9f5672a4c1.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c7b9de5e0cb2431a81b0ab9f5672a4c1.jpg saved to cache
2026-03-26 09:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4b14ffbe-273d-57f2-9156-ea05987d93b9
2026-03-26 09:56:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4b14ffbe-273d-57f2-9156-ea05987d93b9 sending to next pipeline
2026-03-26 09:56:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f182cb10>
2026-03-26 09:56:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e3f4290-b4ba-55f8-82a5-5afca12eb709/9e3f4290-b4ba-55f8-82a5-5afca12eb709_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa58ad7d62b0d4d45827141c796f1bc7c.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a58ad7d62b0d4d45827141c796f1bc7c.jpg saved to cache
2026-03-26 09:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9e3f4290-b4ba-55f8-82a5-5afca12eb709
2026-03-26 09:56:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9e3f4290-b4ba-55f8-82a5-5afca12eb709 sending to next pipeline
2026-03-26 09:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/6e44931777da4eb5979ddb6f71f07f4c.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 09:56:57 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 6ab21939-c1d7-512b-8e2c-ba681836a83b with identifier 202601199266001
2026-03-26 09:56:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:57 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 6ab21939-c1d7-512b-8e2c-ba681836a83b
2026-03-26 09:56:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/32e2812896dc4294a6b94e246dbcab9f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 116,
'color': 'Black',
'currency': 'GBP',
'description': 'With an MOT valid until August 2026, this Mercedes Benz A '
'Class A200 CDI AMG Sport from 2014 offers excellent peace of '
'mind. This Euro 6 compliant vehicle is powered by a 2.1L '
'Diesel engine and features the desirable AMG Sport trim. '
'While it has a partial service history, the last service was '
'completed on 11 August 2025 at 130,435 miles. £35.00 pound '
'tax a yerar, 2 keys. Last owner since 2019. Notable features '
'include Headlight Assist for automatic headlight activation, '
'air conditioning for your comfort, and Bluetooth connectivity '
'for seamless calls and music.\n'
'\n'
'This Mercedes Benz A Class stands out with its impressive '
'acceleration, reaching 0-62mph in just 9.3 seconds, '
'demonstrating its responsive performance. Furthermore, its '
'large boot space provides practical versatility for everyday '
'needs and longer journeys. The vehicle also benefits from '
'being in a low insurance group, which can help to keep '
'running costs down, making it a sensible choice for many '
'drivers.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2.1L',
'engine_horse_power': 134,
'fuel_type': 'Diesel',
'id': '6ab21939-c1d7-512b-8e2c-ba681836a83b',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601199266001',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'Mercedes-Benz',
'model': 'A Class',
'odometer': 136000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 51,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ab21939-c1d7-512b-8e2c-ba681836a83b/6ab21939-c1d7-512b-8e2c-ba681836a83b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 594300,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/32e2812896dc4294a6b94e246dbcab9f.jpg',
'Width': 2048}],
'price': 4950,
'price_includes_vat': True,
'registration_date': '2014-07-21',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A Class 2.1 A200 CDI AMG Sport Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'AMG Sport',
'year': 2014}
2026-03-26 09:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601199266001%27 HTTP/1.1" 200 None
2026-03-26 09:56:57 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601199266001: {'created_time': 1774519017.245421, 'last_price_update_time': 1774519017.245429}
2026-03-26 09:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601199266001') HTTP/1.1" 204 0
2026-03-26 09:56:57 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e3f32421-e107-5832-a9a2-390d875eb2ef with identifier 202601209274802
2026-03-26 09:56:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:57 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e3f32421-e107-5832-a9a2-390d875eb2ef
2026-03-26 09:56:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/970b0fe2a1f14fa0987b5202025327db.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'Black',
'currency': 'GBP',
'description': 'This 2021 Hyundai KONA Premium Electric boasts a full '
'dealership service history, with its last service completed '
'on 31st December 2025 at 107,672 miles with 8 service stamps '
'and benefits from a single owner from new, 2 keys. This well '
'maintained electric vehicle offers a substantial battery '
'total capacity of 68 kWh, providing a maximum range of 300 '
'miles when new. It comes equipped with advanced features such '
'as Android Auto for seamless phone connectivity, automatic '
'headlights that activate with a dusk sensor, and Blind Spot '
'Collision Avoidance Assist for enhanced safety. Additionally, '
'enjoy the convenience of a wireless phone charging pad and '
'bright, efficient full LED headlights.\n'
'\n'
'The Hyundai KONA Premium Electric stands out with its '
'impressive range of 300 miles from new, indicating excellent '
'efficiency compared to many other electric vehicles. Charging '
'is convenient, with a full charge at home using a 7kW charger '
'taking approximately 10 hours and 16 minutes, and a rapid '
'charge from empty to 80% achievable in just 53 minutes at a '
'public charging station. This particular model also has its '
'MOT valid until June 2026, offering further peace of mind for '
'its next owner.',
'doors_number': 5,
'engine_horse_power': 201,
'fuel_type': 'Electric',
'id': 'e3f32421-e107-5832-a9a2-390d875eb2ef',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601209274802',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'Hyundai',
'model': 'KONA',
'odometer': 108000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 54,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3f32421-e107-5832-a9a2-390d875eb2ef/e3f32421-e107-5832-a9a2-390d875eb2ef_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 742879,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/970b0fe2a1f14fa0987b5202025327db.jpg',
'Width': 2048}],
'price': 8695,
'price_includes_vat': True,
'registration_date': '2021-06-17',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai Kona 64kWh Premium Auto 5dr (10.5kW Charger)',
'transmission': 'automatic',
'trim': 'Premium',
'year': 2021}
2026-03-26 09:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601209274802%27 HTTP/1.1" 200 None
2026-03-26 09:56:57 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601209274802: {'created_time': 1774519017.300237, 'last_price_update_time': 1774519017.300247}
2026-03-26 09:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601209274802') HTTP/1.1" 204 0
2026-03-26 09:56:57 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 4b14ffbe-273d-57f2-9156-ea05987d93b9 with identifier 202601219323649
2026-03-26 09:56:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:57 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 4b14ffbe-273d-57f2-9156-ea05987d93b9
2026-03-26 09:56:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/c7b9de5e0cb2431a81b0ab9f5672a4c1.jpg>
{'auction_title': '',
'c_o_2_emission_value': 99,
'color': 'Black',
'currency': 'GBP',
'description': 'With a clear vehicle history and only two previous owners, '
'this 2015 Honda Civic i-DTEC Black Edition presents a '
'compelling proposition. This well maintained diesel hatchback '
'boasts a 1.6 litre engine and comes with mot until 16th '
'Febuary 2027. Its partial service history includes a last '
'service in March 2023 at 139,243 miles, last owner since '
'2015, and it benefits from Bluetooth Hands Free Telephone for '
'seamless connectivity and Climate Control Air Conditioning to '
'ensure comfort in all conditions.\n'
'\n'
'This Civic i-DTEC Black Edition stands out with its '
'exceptional fuel economy, achieving an impressive 74 miles '
'per gallon, which indicates it is more economical than many '
'similar vehicles. Furthermore, its low CO2 emissions and low '
'insurance group highlight its cost effectiveness for everyday '
'driving. Practicality is also a strong point, with generous '
'boot space making it ideal for families or those needing '
'extra room for luggage.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.6L',
'engine_horse_power': 118,
'fuel_type': 'Diesel',
'id': '4b14ffbe-273d-57f2-9156-ea05987d93b9',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601219323649',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'Honda',
'model': 'Civic',
'odometer': 163000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 48,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b14ffbe-273d-57f2-9156-ea05987d93b9/4b14ffbe-273d-57f2-9156-ea05987d93b9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 630784,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c7b9de5e0cb2431a81b0ab9f5672a4c1.jpg',
'Width': 2048}],
'price': 2850,
'price_includes_vat': True,
'registration_date': '2015-03-31',
'seats_number': 5,
'seller_name': None,
'title': 'Honda Civic 1.6 i-DTEC Black Edition Tourer Euro 5 (s/s) 5dr',
'transmission': 'manual',
'trim': 'Black Edition',
'year': 2015}
2026-03-26 09:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601219323649%27 HTTP/1.1" 200 None
2026-03-26 09:56:57 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601219323649: {'created_time': 1774519017.348912, 'last_price_update_time': 1774519017.348921}
2026-03-26 09:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601219323649') HTTP/1.1" 204 0
2026-03-26 09:56:57 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 9e3f4290-b4ba-55f8-82a5-5afca12eb709 with identifier 202306299096495
2026-03-26 09:56:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:57 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 9e3f4290-b4ba-55f8-82a5-5afca12eb709
2026-03-26 09:56:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/a58ad7d62b0d4d45827141c796f1bc7c.jpg>
{'auction_title': '',
'c_o_2_emission_value': 107,
'color': 'Black',
'currency': 'GBP',
'description': 'Arc Car centre are Proud to Offer This Great Example Citroen '
'DS3 1.6 HDI Black Model 3 Door Hatchback Finished in '
'Beautiful Metallic Black £20 Tax A Year Comes With Service '
'History With 7 Service Stamps Looks & Drives Beautiful for '
'Age & Mileage Excellent MPG MOT 01/08/2026 Tremendous '
'Specifications Genuine Documented Mileage in Excellent '
'Condition Both Inside & Out Perfect First Time Driver Hatch '
'Contrasting Cloth Interior AUX Port HPI Report With All the '
'Usual Citroen Refinements PLEASE CALL OUR SALES TEAM TO BOOK '
'A TEST DRIVE/VIEWINGS ON 01924 385500 OPEN 7 DAYS A WEEK ALL '
'MAJOR DEBIT CARDS ACCEPTED UPGRADED WARRANTIES AVAILABLE LOW '
'RATE FINANCE AVAILABLE (subject to status) PLEASE FEEL FREE '
'TO VISIT OUR SHOWROOM FOR MORE CARS AT '
'WWW.ARCQUALITYCARS.CO.UK ANY TRIAL OR INSPECTIONS WELCOME',
'doors_number': 3,
'emission_standard': 'Euro 5',
'engine': '1.6L',
'engine_horse_power': 89,
'fuel_type': 'Diesel',
'id': '9e3f4290-b4ba-55f8-82a5-5afca12eb709',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202306299096495',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'Citroen',
'model': 'DS3',
'odometer': 70000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 42,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e3f4290-b4ba-55f8-82a5-5afca12eb709/9e3f4290-b4ba-55f8-82a5-5afca12eb709_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 567676,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a58ad7d62b0d4d45827141c796f1bc7c.jpg',
'Width': 2048}],
'price': 2795,
'price_includes_vat': True,
'registration_date': '2010-11-16',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen DS3 1.6 HDi Black Euro 5 3dr',
'transmission': 'manual',
'trim': 'Black',
'year': 2010}
2026-03-26 09:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202306299096495%27 HTTP/1.1" 200 None
2026-03-26 09:56:57 [auto_selling_autotrader.co.uk] INFO: Saving data for 202306299096495: {'created_time': 1774519017.399088, 'last_price_update_time': 1774519017.399098}
2026-03-26 09:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202306299096495') HTTP/1.1" 204 0
2026-03-26 09:56:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 09:56:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87f19fd7d0>
2026-03-26 09:56:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 09:56:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 09:56:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 09:56:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8082d6b2-e73c-5d5b-bd89-cde43d2d3f43/8082d6b2-e73c-5d5b-bd89-cde43d2d3f43_image_0.jpg HTTP/1.1" 201 0
2026-03-26 09:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6e44931777da4eb5979ddb6f71f07f4c.jpg') HTTP/1.1" 204 0
2026-03-26 09:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6e44931777da4eb5979ddb6f71f07f4c.jpg saved to cache
2026-03-26 09:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8082d6b2-e73c-5d5b-bd89-cde43d2d3f43
2026-03-26 09:56:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8082d6b2-e73c-5d5b-bd89-cde43d2d3f43 sending to next pipeline
2026-03-26 09:56:57 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 8082d6b2-e73c-5d5b-bd89-cde43d2d3f43 with identifier 202306289028005
2026-03-26 09:56:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:57 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 8082d6b2-e73c-5d5b-bd89-cde43d2d3f43
2026-03-26 09:56:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/6e44931777da4eb5979ddb6f71f07f4c.jpg>
{'auction_title': '',
'c_o_2_emission_value': 93,
'color': 'Black',
'currency': 'GBP',
'description': 'This 2018 Toyota AYGO VVT-i x-play presents an exceptional '
'ownership proposition, having been meticulously maintained by '
'a single owner from new. With a full service history, most '
'recently completed on 17 January 2023 at 89,889 miles, and an '
'MOT valid until January 2026, this Euro 6 compliant vehicle '
'offers peace of mind. The 1.0L petrol engine is paired with '
'the x-play trim, featuring a 7in x-touch multimedia system '
'with Bluetooth connectivity, a reversing camera for parking '
'assistance, and manual air conditioning for your comfort.\n'
'\n'
'FINANCE AVAILABLE PLEASE VISIT OUR WEBSITE '
'WWW.ARCQUALITYCARS.CO.UK\n'
'\n'
'The AYGO VVT-i x-play stands out with its impressive fuel '
'economy, achieving a remarkable 57 miles per gallon, which '
'indicates it is more economical than many similar vehicles. '
'Furthermore, its low CO2 emissions and low insurance group '
'highlight its cost effectiveness, making it an attractive '
'choice for budget conscious drivers.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1L',
'engine_horse_power': 70,
'fuel_type': 'Petrol',
'id': '8082d6b2-e73c-5d5b-bd89-cde43d2d3f43',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202306289028005',
'listing': 'directbuy',
'location': 'Wakefield, West Yorkshire',
'make': 'Toyota',
'model': 'AYGO',
'odometer': 98000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 48,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8082d6b2-e73c-5d5b-bd89-cde43d2d3f43/8082d6b2-e73c-5d5b-bd89-cde43d2d3f43_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 624533,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6e44931777da4eb5979ddb6f71f07f4c.jpg',
'Width': 2048}],
'price': 5095,
'price_includes_vat': True,
'registration_date': '2018-10-04',
'seats_number': 4,
'seller_name': None,
'title': 'Toyota Aygo 1.0 VVT-i x-play Euro 6 5dr',
'transmission': 'manual',
'trim': 'x-play',
'year': 2018}
2026-03-26 09:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202306289028005%27 HTTP/1.1" 200 None
2026-03-26 09:56:57 [auto_selling_autotrader.co.uk] INFO: Saving data for 202306289028005: {'created_time': 1774519017.548299, 'last_price_update_time': 1774519017.548307}
2026-03-26 09:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202306289028005') HTTP/1.1" 204 0
2026-03-26 09:56:57 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-26 09:56:57 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close cursor: 'SaveToCdlqDbAutoSelling' object has no attribute 'cursor'
2026-03-26 09:56:57 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close connection: 'SaveToCdlqDbAutoSelling' object has no attribute 'conn'
2026-03-26 09:56:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 09:56:57 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process scrape complete CloudEvent for item 134b8c3628fa11f18f76c264925fbcfa
2026-03-26 09:56:57 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 09:56:57 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 09:56:57 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 09:56:57 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 09:56:57 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 09:56:57 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.MAPPED: 3> -> <SessionState.END_SENT: 4>
2026-03-26 09:56:57 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPENED: 9> -> <ConnectionState.CLOSE_SENT: 11>
2026-03-26 09:56:57 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.CLOSE_SENT: 11> -> <ConnectionState.END: 13>
2026-03-26 09:56:57 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.END_SENT: 4> -> <SessionState.DISCARDING: 6>
2026-03-26 09:56:57 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 09:56:57 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 09:56:57 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 09:56:57 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 09:56:57 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 09:56:58 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: [AzureBusPipeline] connection closed
2026-03-26 09:56:58 [auto_selling_autotrader.co.uk] INFO: auto_selling_autotrader.co.uk Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 2, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20last_price_update_time%20lt%201773223019 HTTP/1.1" 200 None
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='201505253749371') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='201705255819437') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202405089478881') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202503029658428') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202507224715911') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202508295872016') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202508305898984') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509035999894') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509076124997') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509256615160') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510076939552') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510137105289') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510137111241') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510297510175') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511017585152') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511037626907') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511077732966') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511187973515') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511228066314') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511248112554') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511258116111') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511288218558') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511308236955') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512048347594') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512118516656') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512188690681') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512268803688') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512298834069') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512308848340') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601028877387') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601058933492') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601058935316') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601078978500') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601078979113') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601088999050') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601099041982') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601109055430') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601129079015') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601149130528') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601149138052') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601159159807') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601159162924') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601159166717') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601169192728') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601169192787') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601169196398') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601199245558') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601199250293') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601219309533') HTTP/1.1" 204 0
2026-03-26 09:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601239362563') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601269424229') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601269440228') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601289500126') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601299512820') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601299513512') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601299513635') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601309543313') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601309549112') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602029604934') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602039631297') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602039638061') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602049664865') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602049665382') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602049666685') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602049677066') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602059688973') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602059696453') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602059696493') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602059696713') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602059698020') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602079757257') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602079761257') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602099778071') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602099790603') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602119853180') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602119855525') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602129883016') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602129887769') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602139905422') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602139912568') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602149922274') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602149928807') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602149929418') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602149935764') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602159942428') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602159947450') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602169957424') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602169963053') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602169964463') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602179987881') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602180019852') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602190055290') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602190060282') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602190069952') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602200074389') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602200074985') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602210107275') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602210110460') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602210111669') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602210115656') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602230151881') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602230157088') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602250219074') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602250221116') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602260239589') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602260239989') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602260248870') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602260250110') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602270254133') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602270259088') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602270261589') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602270265911') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602270266733') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602270275930') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603010308042') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603020319452') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603020321767') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603020335564') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603030353819') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603030357503') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603040383513') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603040405544') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603050424102') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603050432470') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603050432767') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603050439685') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603050442080') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603050442687') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603050447957') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603060452761') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603060456219') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603060466277') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603060476015') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603060477161') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603090538245') HTTP/1.1" 204 0
2026-03-26 09:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603100554328') HTTP/1.1" 204 0
2026-03-26 09:57:01 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (42 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto_selling_autotrader.co.uk/134b8c3628fa11f18f76c264925fbcfa.jl
2026-03-26 09:57:01 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 342562,
'downloader/request_count': 47,
'downloader/request_method_count/GET': 39,
'downloader/request_method_count/POST': 8,
'downloader/response_bytes': 25189007,
'downloader/response_count': 47,
'downloader/response_status_count/200': 47,
'elapsed_time_seconds': 20.982664,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 26, 9, 57, 0, 922256, tzinfo=datetime.timezone.utc),
'item_scraped_count': 42,
'log_count/DEBUG': 879,
'log_count/INFO': 640,
'memusage/max': 147476480,
'memusage/startup': 147476480,
'photo_download_count': 39,
'request_depth_max': 4,
'response_received_count': 8,
'scheduler/dequeued': 47,
'scheduler/dequeued/memory': 47,
'scheduler/enqueued': 47,
'scheduler/enqueued/memory': 47,
'scrape_type/new': 42,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 8,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 2.18628712312784,
'scrapy-zyte-api/mean_response_seconds': 2.26371090952307,
'scrapy-zyte-api/processed': 8,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 8,
'scrapy-zyte-api/request_args/experimental.requestCookies': 7,
'scrapy-zyte-api/request_args/experimental.responseCookies': 8,
'scrapy-zyte-api/request_args/httpRequestBody': 8,
'scrapy-zyte-api/request_args/httpRequestMethod': 8,
'scrapy-zyte-api/request_args/httpResponseBody': 8,
'scrapy-zyte-api/request_args/httpResponseHeaders': 8,
'scrapy-zyte-api/request_args/url': 8,
'scrapy-zyte-api/status_codes/200': 8,
'scrapy-zyte-api/success': 8,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'start_time': datetime.datetime(2026, 3, 26, 9, 56, 39, 939592, tzinfo=datetime.timezone.utc)}
2026-03-26 09:57:01 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-26 09:57:01 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f87f638fa50>
2026-03-26 09:57:01 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f87f639c250>