2026-03-25 15:41:39 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-25 15:41:39 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-25 15:41:39 [auto_selling_autotrader.co.uk] INFO: Starting auto_selling_autotrader.co.uk spider
2026-03-25 15:41:39 [auto_selling_autotrader.co.uk] INFO: Quick mode enabled: batching detail requests in groups of 10
2026-03-25 15:41:39 [auto_selling_autotrader.co.uk] INFO: Limiting photo downloads to 1 per item
2026-03-25 15:41:39 [auto_selling_autotrader.co.uk] INFO: _job: 1a09905c286111f18f76c264925fbcfa, SCRAPY_JOB: None
2026-03-25 15:41:39 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-25 15:41:39 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-25 15:41:39 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-25 15:41:39 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-25 15:41:39 [scrapy.extensions.telnet] INFO: Telnet Password: 18a7209c027436bc
2026-03-25 15:41:39 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-25 15:41:39 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 3600,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto_selling_autotrader.co.uk/1a09905c286111f18f76c264925fbcfa.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-25 15:41:39 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-25 15:41:39 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-25 15:41:39 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-25 15:41:39 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware for auto_selling
2026-03-25 15:41:39 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.auto_selling.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-25 15:41:39 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.post_to_azurebus_auto_selling.AzureBusPipelineAutoSelling',
'crawlers.pipelines.save_to_cdlq_db_auto_selling.SaveToCdlqDbAutoSelling']
2026-03-25 15:41:39 [scrapy.core.engine] INFO: Spider opened
2026-03-25 15:41:39 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-25 15:41:39 [common.service_bus.service_bus_client_factory] INFO: ServiceBusClient initialized via DefaultAzureCredential for alx-production-bus.servicebus.windows.net
2026-03-25 15:41:39 [crawlers.pipelines.base_azure_bus_pipeline] INFO: [AzureBusPipeline] Connected to topic auto.sourcing-v2-quickmode
2026-03-25 15:41:39 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-25 15:41:39 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-25 15:41:39 [scrapy.extensions.memusage] INFO: Peak memory usage is 140MiB
2026-03-25 15:41:39 [scrapy-playwright] INFO: Starting download handler
2026-03-25 15:41:39 [scrapy-playwright] INFO: Starting download handler
2026-03-25 15:41:44 [auto_selling_autotrader.co.uk] INFO: Scraper started with retailer ID: 10036606 and multipost_profile_id: be65b313-a997-4e5a-8a30-98ae8b6de912 and job_id: 1a09905c286111f18f76c264925fbcfa and url: https://www.autotrader.co.uk/dealers/smart-choice-autos-limited-10036606
2026-03-25 15:41:44 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 10036606, page: 1
2026-03-25 15:41:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 15:41:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: None) ['zyte-api']
2026-03-25 15:41:46 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-25 15:41:46 [auto_selling_autotrader.co.uk] INFO: Page: 1/3, total results: 42
2026-03-25 15:41:46 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2107
2026-03-25 15:41:46 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603240961730%27 HTTP/1.1" 200 None
2026-03-25 15:41:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603240961730: 1
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603240954683%27 HTTP/1.1" 200 None
2026-03-25 15:41:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603240954683: 1
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603180811700%27 HTTP/1.1" 200 None
2026-03-25 15:41:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603180811700: 1
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603170775097%27 HTTP/1.1" 200 None
2026-03-25 15:41:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603170775097: 1
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603130681723%27 HTTP/1.1" 200 None
2026-03-25 15:41:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603130681723: 1
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603130681547%27 HTTP/1.1" 200 None
2026-03-25 15:41:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603130681547: 1
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603130666073%27 HTTP/1.1" 200 None
2026-03-25 15:41:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603130666073: 1
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120640211%27 HTTP/1.1" 200 None
2026-03-25 15:41:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603120640211: 1
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603070494164%27 HTTP/1.1" 200 None
2026-03-25 15:41:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603070494164: 1
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603030365194%27 HTTP/1.1" 200 None
2026-03-25 15:41:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603030365194: 1
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602220120314%27 HTTP/1.1" 200 None
2026-03-25 15:41:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602220120314: 1
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602169967151%27 HTTP/1.1" 200 None
2026-03-25 15:41:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602169967151: 1
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602109827925%27 HTTP/1.1" 200 None
2026-03-25 15:41:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602109827925: 1
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602109819513%27 HTTP/1.1" 200 None
2026-03-25 15:41:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602109819513: 1
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602109819402%27 HTTP/1.1" 200 None
2026-03-25 15:41:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602109819402: 1
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602099800180%27 HTTP/1.1" 200 None
2026-03-25 15:41:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602099800180: 1
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602089773040%27 HTTP/1.1" 200 None
2026-03-25 15:41:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602089773040: 1
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601299513378%27 HTTP/1.1" 200 None
2026-03-25 15:41:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601299513378: 1
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601279456168%27 HTTP/1.1" 200 None
2026-03-25 15:41:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601279456168: 1
2026-03-25 15:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601269425075%27 HTTP/1.1" 200 None
2026-03-25 15:41:47 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601269425075: 1
2026-03-25 15:41:47 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-25 15:41:47 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-25 15:41:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 15:41:47 [auto_selling_autotrader.co.uk] INFO: Getting next page: 2
2026-03-25 15:41:47 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 10036606, page: 2
2026-03-25 15:41:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 15:41:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 15:41:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-25 15:41:48 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-25 15:41:48 [auto_selling_autotrader.co.uk] INFO: Page: 2/3, total results: 42
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601269424838%27 HTTP/1.1" 200 None
2026-03-25 15:41:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601269424838: 1
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601189234896%27 HTTP/1.1" 200 None
2026-03-25 15:41:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601189234896: 1
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149145374%27 HTTP/1.1" 200 None
2026-03-25 15:41:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601149145374: 1
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512178669541%27 HTTP/1.1" 200 None
2026-03-25 15:41:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512178669541: 1
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512148583133%27 HTTP/1.1" 200 None
2026-03-25 15:41:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512148583133: 1
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512098484194%27 HTTP/1.1" 200 None
2026-03-25 15:41:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512098484194: 1
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511298234017%27 HTTP/1.1" 200 None
2026-03-25 15:41:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511298234017: 1
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511268148295%27 HTTP/1.1" 200 None
2026-03-25 15:41:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511268148295: 1
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511238085298%27 HTTP/1.1" 200 None
2026-03-25 15:41:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511238085298: 1
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511077744697%27 HTTP/1.1" 200 None
2026-03-25 15:41:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511077744697: 1
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510237379592%27 HTTP/1.1" 200 None
2026-03-25 15:41:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202510237379592: 1
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509186448249%27 HTTP/1.1" 200 None
2026-03-25 15:41:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202509186448249: 1
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509066110735%27 HTTP/1.1" 200 None
2026-03-25 15:41:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202509066110735: 1
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508275801558%27 HTTP/1.1" 200 None
2026-03-25 15:41:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202508275801558: 1
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508205603143%27 HTTP/1.1" 200 None
2026-03-25 15:41:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202508205603143: 1
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508195571167%27 HTTP/1.1" 200 None
2026-03-25 15:41:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202508195571167: 1
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202507144470779%27 HTTP/1.1" 200 None
2026-03-25 15:41:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202507144470779: 1
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202411276782159%27 HTTP/1.1" 200 None
2026-03-25 15:41:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202411276782159: 1
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202410295719460%27 HTTP/1.1" 200 None
2026-03-25 15:41:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202410295719460: 1
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202409023553014%27 HTTP/1.1" 200 None
2026-03-25 15:41:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202409023553014: 1
2026-03-25 15:41:48 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-25 15:41:48 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-25 15:41:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 15:41:48 [auto_selling_autotrader.co.uk] INFO: Getting next page: 3
2026-03-25 15:41:48 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 10036606, page: 3
2026-03-25 15:41:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 15:41:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 15:41:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-25 15:41:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c9915464-eba0-5604-93c2-b99f21c21aa0 with identifier: 202603240961730
2026-03-25 15:41:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c9915464-eba0-5604-93c2-b99f21c21aa0
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3aaff2feb5154262839d98a5c56e4709.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3aaff2feb5154262839d98a5c56e4709.jpg not downloaded yet
2026-03-25 15:41:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c9cd5dd-1fd5-5c23-93d9-c4ebd170176a with identifier: 202603240954683
2026-03-25 15:41:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4c9cd5dd-1fd5-5c23-93d9-c4ebd170176a
2026-03-25 15:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F07771c9ab52a4303b0101373eb882cc1.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/07771c9ab52a4303b0101373eb882cc1.jpg not downloaded yet
2026-03-25 15:41:49 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:49 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: f8627e59-ca06-55fb-9b86-57689b09b406 with identifier: 202603180811700
2026-03-25 15:41:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f8627e59-ca06-55fb-9b86-57689b09b406
2026-03-25 15:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F987578e3ff064ca6b95b036b4d9393c9.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/987578e3ff064ca6b95b036b4d9393c9.jpg not downloaded yet
2026-03-25 15:41:49 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:49 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fc69753-ce23-59c7-b3ff-6d9ea3aef061 with identifier: 202603170775097
2026-03-25 15:41:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3fc69753-ce23-59c7-b3ff-6d9ea3aef061
2026-03-25 15:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F707bd69e6d544ab08413d9687f513c6a.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/707bd69e6d544ab08413d9687f513c6a.jpg not downloaded yet
2026-03-25 15:41:49 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:49 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 394cf89d-eb73-54fb-953f-cc1f7a39071c with identifier: 202603130681723
2026-03-25 15:41:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 394cf89d-eb73-54fb-953f-cc1f7a39071c
2026-03-25 15:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0d9027404e3644ea936f3529c17f7a30.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0d9027404e3644ea936f3529c17f7a30.jpg not downloaded yet
2026-03-25 15:41:49 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:49 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a56e5e8-7608-5049-abc0-afb9ebdc82d7 with identifier: 202603130681547
2026-03-25 15:41:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9a56e5e8-7608-5049-abc0-afb9ebdc82d7
2026-03-25 15:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcede2a57116e4e9494ad65e16f765a7a.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cede2a57116e4e9494ad65e16f765a7a.jpg not downloaded yet
2026-03-25 15:41:49 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:49 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c091406-52a3-531d-8ef0-216c36af6f52 with identifier: 202603130666073
2026-03-25 15:41:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0c091406-52a3-531d-8ef0-216c36af6f52
2026-03-25 15:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F36ad35d5112c4a779be065d612d14143.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/36ad35d5112c4a779be065d612d14143.jpg not downloaded yet
2026-03-25 15:41:49 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:49 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ad65d79-5dbc-547c-b4f7-ae4c12e9db7d with identifier: 202603120640211
2026-03-25 15:41:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9ad65d79-5dbc-547c-b4f7-ae4c12e9db7d
2026-03-25 15:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2ea2eb07e6dd4df9a14867b80e751de4.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2ea2eb07e6dd4df9a14867b80e751de4.jpg not downloaded yet
2026-03-25 15:41:49 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:49 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e2c0ab78-160c-5019-9f36-2c228ad114a3 with identifier: 202603070494164
2026-03-25 15:41:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e2c0ab78-160c-5019-9f36-2c228ad114a3
2026-03-25 15:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff506dd480232417fbbbe349fd70016f3.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f506dd480232417fbbbe349fd70016f3.jpg not downloaded yet
2026-03-25 15:41:49 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:49 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 43573217-a8c4-52fd-b430-e5b2e913bc64 with identifier: 202603030365194
2026-03-25 15:41:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 43573217-a8c4-52fd-b430-e5b2e913bc64
2026-03-25 15:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2afb5818621a4c2781e8a510427fa377.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2afb5818621a4c2781e8a510427fa377.jpg not downloaded yet
2026-03-25 15:41:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/987578e3ff064ca6b95b036b4d9393c9.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/707bd69e6d544ab08413d9687f513c6a.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/cede2a57116e4e9494ad65e16f765a7a.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/07771c9ab52a4303b0101373eb882cc1.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/3aaff2feb5154262839d98a5c56e4709.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/36ad35d5112c4a779be065d612d14143.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/2ea2eb07e6dd4df9a14867b80e751de4.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/f506dd480232417fbbbe349fd70016f3.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-25 15:41:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-25 15:41:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f229f9ed850>
2026-03-25 15:41:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-25 15:41:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-25 15:41:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-25 15:41:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8627e59-ca06-55fb-9b86-57689b09b406/f8627e59-ca06-55fb-9b86-57689b09b406_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F987578e3ff064ca6b95b036b4d9393c9.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/987578e3ff064ca6b95b036b4d9393c9.jpg saved to cache
2026-03-25 15:41:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f8627e59-ca06-55fb-9b86-57689b09b406
2026-03-25 15:41:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f8627e59-ca06-55fb-9b86-57689b09b406 sending to next pipeline
2026-03-25 15:41:49 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: f8627e59-ca06-55fb-9b86-57689b09b406 with identifier 202603180811700
2026-03-25 15:41:49 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: None -> <ConnectionState.START: 0>
2026-03-25 15:41:49 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.START: 0> -> <ConnectionState.HDR_SENT: 2>
2026-03-25 15:41:49 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.HDR_SENT: 2>
2026-03-25 15:41:49 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.OPEN_PIPE: 4>
2026-03-25 15:41:49 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.UNMAPPED: 0> -> <SessionState.BEGIN_SENT: 1>
2026-03-25 15:41:49 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-25 15:41:49 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-25 15:41:49 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-25 15:41:49 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-25 15:41:49 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_PIPE: 4> -> <ConnectionState.OPEN_SENT: 7>
2026-03-25 15:41:49 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_SENT: 7> -> <ConnectionState.OPENED: 9>
2026-03-25 15:41:49 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.BEGIN_SENT: 1> -> <SessionState.MAPPED: 3>
2026-03-25 15:41:50 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-25 15:41:50 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-25 15:41:50 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-25 15:41:50 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-25 15:41:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS completed opening with status: <ManagementOpenResult.OK: 1>
2026-03-25 15:41:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-25 15:41:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2022
2026-03-25 15:41:50 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-25 15:41:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774453310
2026-03-25 15:41:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774453310
2026-03-25 15:41:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS Put token result (<ManagementExecuteOperationResult.OK: 0>), status code: 202, status_description: b'Accepted'.
2026-03-25 15:41:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:50 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-25 15:41:50 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-25 15:41:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:50 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item f8627e59-ca06-55fb-9b86-57689b09b406
2026-03-25 15:41:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/987578e3ff064ca6b95b036b4d9393c9.jpg>
{'auction_title': '',
'c_o_2_emission_value': 41,
'color': 'White',
'currency': 'GBP',
'description': 'SERVICE HISTORY -- REAR ENTERTAINMENT SCREEN -- REVERSING 360 '
'CAMERA -- LOW MILEAGE -- HPI CLEAR WITH REPORT SUPPLIED --- '
'This 2017 Mitsubishi Outlander 4h offers an exceptional blend '
'of efficiency and capability, featuring a 2.0L Petrol Plug-in '
'Hybrid engine and Four Wheel Drive. As a Euro 6 compliant '
'vehicle, it meets modern emissions standards. This model '
'comes equipped with desirable features such as Air '
'Conditioning with Dual Climate Control, Dusk Sensing '
'Headlights for automatic illumination, and Remotely '
"Controlled Keyless Entry for convenience. Inside, you'll find "
'Front Seat Heaters for added comfort and Bluetooth '
'connectivity with Music Streaming, allowing for seamless '
'audio enjoyment on your journeys.\n'
'\n'
'The Outlander 4h stands out with its intelligent hybrid '
'system, providing a more economical and environmentally '
'conscious driving experience compared to traditional petrol '
'or diesel vehicles. The Four Wheel Drive system ensures '
'confident handling in various conditions, while the plug-in '
'hybrid technology allows for electric only driving for '
'shorter trips, reducing fuel consumption and emissions. These '
'combined attributes make this Mitsubishi Outlander a '
'practical and advanced choice for those seeking versatility '
'and modern technology in their next vehicle.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 198,
'fuel_type': 'Petrol Plug-in Hybrid',
'id': 'f8627e59-ca06-55fb-9b86-57689b09b406',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603180811700',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'Mitsubishi',
'model': 'Outlander',
'odometer': 69923,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 48,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8627e59-ca06-55fb-9b86-57689b09b406/f8627e59-ca06-55fb-9b86-57689b09b406_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86639,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/987578e3ff064ca6b95b036b4d9393c9.jpg',
'Width': 800}],
'price': 10899,
'price_includes_vat': True,
'registration_date': '2017-09-01',
'seats_number': 5,
'seller_name': None,
'title': 'Mitsubishi Outlander 2.0h 12kWh 4h CVT 4WD Euro 6 (s/s) 5dr',
'transmission': 'automatic',
'trim': '4h',
'year': 2017}
2026-03-25 15:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603180811700%27 HTTP/1.1" 200 None
2026-03-25 15:41:50 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603180811700: {'created_time': 1774453310.56667, 'last_price_update_time': 1774453310.56668}
2026-03-25 15:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603180811700') HTTP/1.1" 204 0
2026-03-25 15:41:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-25 15:41:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-25 15:41:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f229dd74390>
2026-03-25 15:41:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fc69753-ce23-59c7-b3ff-6d9ea3aef061/3fc69753-ce23-59c7-b3ff-6d9ea3aef061_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F707bd69e6d544ab08413d9687f513c6a.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/707bd69e6d544ab08413d9687f513c6a.jpg saved to cache
2026-03-25 15:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3fc69753-ce23-59c7-b3ff-6d9ea3aef061
2026-03-25 15:41:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3fc69753-ce23-59c7-b3ff-6d9ea3aef061 sending to next pipeline
2026-03-25 15:41:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f229d3f5010>
2026-03-25 15:41:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a56e5e8-7608-5049-abc0-afb9ebdc82d7/9a56e5e8-7608-5049-abc0-afb9ebdc82d7_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcede2a57116e4e9494ad65e16f765a7a.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cede2a57116e4e9494ad65e16f765a7a.jpg saved to cache
2026-03-25 15:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9a56e5e8-7608-5049-abc0-afb9ebdc82d7
2026-03-25 15:41:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9a56e5e8-7608-5049-abc0-afb9ebdc82d7 sending to next pipeline
2026-03-25 15:41:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f229c9ff690>
2026-03-25 15:41:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c9cd5dd-1fd5-5c23-93d9-c4ebd170176a/4c9cd5dd-1fd5-5c23-93d9-c4ebd170176a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F07771c9ab52a4303b0101373eb882cc1.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/07771c9ab52a4303b0101373eb882cc1.jpg saved to cache
2026-03-25 15:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c9cd5dd-1fd5-5c23-93d9-c4ebd170176a
2026-03-25 15:41:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c9cd5dd-1fd5-5c23-93d9-c4ebd170176a sending to next pipeline
2026-03-25 15:41:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f229ca03b50>
2026-03-25 15:41:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9915464-eba0-5604-93c2-b99f21c21aa0/c9915464-eba0-5604-93c2-b99f21c21aa0_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3aaff2feb5154262839d98a5c56e4709.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3aaff2feb5154262839d98a5c56e4709.jpg saved to cache
2026-03-25 15:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c9915464-eba0-5604-93c2-b99f21c21aa0
2026-03-25 15:41:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c9915464-eba0-5604-93c2-b99f21c21aa0 sending to next pipeline
2026-03-25 15:41:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f229ddc1e90>
2026-03-25 15:41:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c091406-52a3-531d-8ef0-216c36af6f52/0c091406-52a3-531d-8ef0-216c36af6f52_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F36ad35d5112c4a779be065d612d14143.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/36ad35d5112c4a779be065d612d14143.jpg saved to cache
2026-03-25 15:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0c091406-52a3-531d-8ef0-216c36af6f52
2026-03-25 15:41:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0c091406-52a3-531d-8ef0-216c36af6f52 sending to next pipeline
2026-03-25 15:41:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f229ca09490>
2026-03-25 15:41:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ad65d79-5dbc-547c-b4f7-ae4c12e9db7d/9ad65d79-5dbc-547c-b4f7-ae4c12e9db7d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2ea2eb07e6dd4df9a14867b80e751de4.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2ea2eb07e6dd4df9a14867b80e751de4.jpg saved to cache
2026-03-25 15:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9ad65d79-5dbc-547c-b4f7-ae4c12e9db7d
2026-03-25 15:41:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9ad65d79-5dbc-547c-b4f7-ae4c12e9db7d sending to next pipeline
2026-03-25 15:41:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f229ca13850>
2026-03-25 15:41:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2c0ab78-160c-5019-9f36-2c228ad114a3/e2c0ab78-160c-5019-9f36-2c228ad114a3_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff506dd480232417fbbbe349fd70016f3.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f506dd480232417fbbbe349fd70016f3.jpg saved to cache
2026-03-25 15:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e2c0ab78-160c-5019-9f36-2c228ad114a3
2026-03-25 15:41:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e2c0ab78-160c-5019-9f36-2c228ad114a3 sending to next pipeline
2026-03-25 15:41:51 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 3fc69753-ce23-59c7-b3ff-6d9ea3aef061 with identifier 202603170775097
2026-03-25 15:41:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:51 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 3fc69753-ce23-59c7-b3ff-6d9ea3aef061
2026-03-25 15:41:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/707bd69e6d544ab08413d9687f513c6a.jpg>
{'auction_title': '',
'c_o_2_emission_value': 152,
'color': 'White',
'currency': 'GBP',
'description': 'This 2015 Volvo XC90 D5 Inscription is a Euro 6 compliant, '
'four wheel drive model offering a spacious seven seat '
'configuration. Powered by a robust 2.0 litre diesel engine, '
'this vehicle boasts a substantial towing weight of 2700 kg. '
'Inside, you will find luxurious Nappa soft leather upholstery '
'in Blond, complete with perforated and ventilated seats for '
'enhanced comfort. The Inscription trim level includes a '
'heated steering wheel and keyless entry for effortless access '
'and driving convenience.\n'
'Experience impressive performance with an acceleration of 0 '
'to 60 miles per hour in just 7.4 seconds, a figure that '
'demonstrates its capability compared to other vehicles in its '
'class. Further enhancing your journey is the Sensus Connect '
'system, featuring a premium sound experience from Bowers and '
'Wilkins, including a luxury branded sound system. The power '
'adjustable front seat side support ensures optimal comfort '
'for the driver on longer journeys.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 222,
'fuel_type': 'Diesel',
'id': '3fc69753-ce23-59c7-b3ff-6d9ea3aef061',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603170775097',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'Volvo',
'model': 'XC90',
'odometer': 111160,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fc69753-ce23-59c7-b3ff-6d9ea3aef061/3fc69753-ce23-59c7-b3ff-6d9ea3aef061_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85283,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/707bd69e6d544ab08413d9687f513c6a.jpg',
'Width': 800}],
'price': 15999,
'price_includes_vat': True,
'registration_date': '2015-05-26',
'seats_number': 7,
'seller_name': None,
'title': 'Volvo XC90 2.0 D5 Inscription Geartronic 4WD Euro 6 (s/s) 5dr',
'transmission': 'automatic',
'trim': 'Inscription',
'year': 2015}
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603170775097%27 HTTP/1.1" 200 None
2026-03-25 15:41:51 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603170775097: {'created_time': 1774453311.418303, 'last_price_update_time': 1774453311.418315}
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603170775097') HTTP/1.1" 204 0
2026-03-25 15:41:51 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 9a56e5e8-7608-5049-abc0-afb9ebdc82d7 with identifier 202603130681547
2026-03-25 15:41:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:51 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 9a56e5e8-7608-5049-abc0-afb9ebdc82d7
2026-03-25 15:41:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/cede2a57116e4e9494ad65e16f765a7a.jpg>
{'auction_title': '',
'c_o_2_emission_value': 154,
'color': 'Black',
'currency': 'GBP',
'description': 'This 2013 Hyundai ix20 Style presents a compelling '
'proposition with its remarkably low mileage of just 56,763 '
'miles for its age. This particular example, featuring a 1.6 '
'litre petrol engine, offers a blend of practicality and '
"comfort. You'll appreciate the convenience of automatic "
'headlights that switch on when needed, and the ease of '
'parking with rear parking assistance and reversing sensors. '
'Inside, the cabin is kept comfortable thanks to air '
'conditioning, and staying connected on the go is simple with '
'Bluetooth connectivity that includes voice recognition. For '
'those moments when you want to enjoy the open air, the '
'electric tilt and slide panoramic sunroof adds a touch of '
'luxury.\n'
'\n'
'The Hyundai ix20 Style is designed to make your journeys more '
'enjoyable and less stressful. Its large boot space means you '
"won't have to worry about carrying luggage or shopping. "
'Furthermore, this vehicle sits in a low insurance group, '
'which can help to keep your running costs down, making it an '
'economical choice compared to many other vehicles in its '
'class.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.6L',
'engine_horse_power': 123,
'fuel_type': 'Petrol',
'id': '9a56e5e8-7608-5049-abc0-afb9ebdc82d7',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603130681547',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'Hyundai',
'model': 'ix20',
'odometer': 56763,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 59,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a56e5e8-7608-5049-abc0-afb9ebdc82d7/9a56e5e8-7608-5049-abc0-afb9ebdc82d7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386005,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cede2a57116e4e9494ad65e16f765a7a.jpg',
'Width': 2048}],
'price': 5999,
'price_includes_vat': True,
'registration_date': '2013-07-31',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai ix20 1.6 Style Auto Euro 5 5dr',
'transmission': 'automatic',
'trim': 'Style',
'year': 2013}
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603130681547%27 HTTP/1.1" 200 None
2026-03-25 15:41:51 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603130681547: {'created_time': 1774453311.478222, 'last_price_update_time': 1774453311.478233}
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603130681547') HTTP/1.1" 204 0
2026-03-25 15:41:51 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 4c9cd5dd-1fd5-5c23-93d9-c4ebd170176a with identifier 202603240954683
2026-03-25 15:41:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:51 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 4c9cd5dd-1fd5-5c23-93d9-c4ebd170176a
2026-03-25 15:41:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/07771c9ab52a4303b0101373eb882cc1.jpg>
{'auction_title': '',
'c_o_2_emission_value': 108,
'color': 'Black',
'currency': 'GBP',
'description': 'This 2014 Audi A1 TDI Black Edition offers a compelling blend '
'of style and efficiency, making it a standout choice in the '
'compact car segment. Powered by a robust 2.0 litre diesel '
'engine, this model delivers an engaging driving experience '
'while benefiting from the sophisticated Black Edition trim. '
'Key features include advanced Electronic Climate Control for '
'personalised comfort, Bi Xenon Plus headlights for superior '
'visibility, and a Bluetooth interface for seamless mobile '
'telephone connectivity.\n'
'\n'
'The Audi A1 TDI Black Edition is designed to impress with its '
'thoughtful features that elevate it above other vehicles in '
'its class. The inclusion of Bi Xenon Plus headlights, for '
'instance, provides a brighter and more focused beam compared '
'to standard halogen lights, enhancing safety during night '
'driving. Similarly, the Electronic Climate Control offers '
'more precise temperature management than manual systems, '
'ensuring a consistently comfortable cabin environment for all '
'occupants. These elements, combined with the efficient diesel '
'engine and stylish Black Edition detailing, create a well '
'rounded and desirable package.',
'doors_number': 3,
'emission_standard': 'Euro 5',
'engine': '2L',
'engine_horse_power': 141,
'fuel_type': 'Diesel',
'id': '4c9cd5dd-1fd5-5c23-93d9-c4ebd170176a',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603240954683',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'Audi',
'model': 'A1',
'odometer': 96219,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 56,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c9cd5dd-1fd5-5c23-93d9-c4ebd170176a/4c9cd5dd-1fd5-5c23-93d9-c4ebd170176a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397705,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/07771c9ab52a4303b0101373eb882cc1.jpg',
'Width': 2048}],
'price': 5499,
'price_includes_vat': True,
'registration_date': '2014-09-01',
'seats_number': 4,
'seller_name': None,
'title': 'Audi A1 2.0 TDI Black Edition Euro 5 (s/s) 3dr',
'transmission': 'manual',
'trim': 'Black Edition',
'year': 2014}
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603240954683%27 HTTP/1.1" 200 None
2026-03-25 15:41:51 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603240954683: {'created_time': 1774453311.537381, 'last_price_update_time': 1774453311.537392}
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603240954683') HTTP/1.1" 204 0
2026-03-25 15:41:51 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c9915464-eba0-5604-93c2-b99f21c21aa0 with identifier 202603240961730
2026-03-25 15:41:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:51 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c9915464-eba0-5604-93c2-b99f21c21aa0
2026-03-25 15:41:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/3aaff2feb5154262839d98a5c56e4709.jpg>
{'auction_title': '',
'c_o_2_emission_value': 124,
'color': 'Blue',
'currency': 'GBP',
'description': 'This 2017 Ford Kuga TDCi Titanium presents an exceptional '
'example with remarkably low mileage for its age, having '
'covered just 46,666 miles. This popular SUV is equipped with '
'a 1.5L Diesel engine and meets Euro 6 emissions standards. '
'The Titanium trim level ensures a well appointed interior, '
'featuring a Ford DAB Navigation System with Ford SYNC3 and '
'Bluetooth connectivity for seamless entertainment and '
'communication. Practicality is enhanced by rear parking '
'sensors with parking assistance, and the convenience of '
'keyless entry and opening. Driving comfort is further '
'elevated by automatic halogen headlights with LED daytime '
'running lights and dual zone electronic automatic temperature '
'control for a pleasant cabin environment.\n'
'\n'
'This Ford Kuga stands out with several key advantages. Its '
'impressive fuel economy of 59 mpg means fewer trips to the '
'petrol station, making it an economical choice for your '
'journeys. Furthermore, its low insurance group indicates that '
'running costs will be more affordable compared to similar '
'vehicles. The low CO2 emissions also highlight its '
'environmental consideration. These factors combined make this '
'Kuga TDCi Titanium a sensible and appealing option for those '
'seeking a well equipped and cost effective SUV.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 118,
'fuel_type': 'Diesel',
'id': 'c9915464-eba0-5604-93c2-b99f21c21aa0',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603240961730',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'Ford',
'model': 'Kuga',
'odometer': 46666,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 64,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9915464-eba0-5604-93c2-b99f21c21aa0/c9915464-eba0-5604-93c2-b99f21c21aa0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 431911,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3aaff2feb5154262839d98a5c56e4709.jpg',
'Width': 2048}],
'price': 10599,
'price_includes_vat': True,
'registration_date': '2017-09-30',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Kuga 1.5 TDCi Titanium Powershift Euro 6 (s/s) 5dr',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2017}
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603240961730%27 HTTP/1.1" 200 None
2026-03-25 15:41:51 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603240961730: {'created_time': 1774453311.591802, 'last_price_update_time': 1774453311.591812}
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603240961730') HTTP/1.1" 204 0
2026-03-25 15:41:51 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 0c091406-52a3-531d-8ef0-216c36af6f52 with identifier 202603130666073
2026-03-25 15:41:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:51 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 0c091406-52a3-531d-8ef0-216c36af6f52
2026-03-25 15:41:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/36ad35d5112c4a779be065d612d14143.jpg>
{'auction_title': '',
'c_o_2_emission_value': 148,
'color': 'Red',
'currency': 'GBP',
'description': 'Discover this 2009 Lexus RX 450h SE-L, a sophisticated SUV '
'that combines performance with efficiency. This model boasts '
'a powerful 3.5 litre petrol hybrid engine, delivering an '
'impressive 0-62mph acceleration in just 7.9 seconds, all '
'while benefiting from a low insurance group. Its Four Wheel '
'Drive system ensures confident handling in various '
'conditions, and the SE-L trim provides a comfortable and well '
'equipped interior.\n'
'\n'
'The Lexus RX 450h SE-L stands out with its generous boot '
'space, making it ideal for families or those who need ample '
'room for luggage and shopping. The hybrid technology means '
'you can enjoy a more economical drive compared to traditional '
'petrol or diesel SUVs, and the smooth acceleration highlights '
'its refined engineering. This vehicle offers a compelling '
'blend of luxury, practicality, and advanced technology for a '
'superior driving experience.',
'doors_number': 5,
'emission_standard': 'Euro 4',
'engine': '3.5L',
'engine_horse_power': 298,
'fuel_type': 'Petrol Hybrid',
'id': '0c091406-52a3-531d-8ef0-216c36af6f52',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603130666073',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'Lexus',
'model': 'RX',
'odometer': 85125,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 69,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c091406-52a3-531d-8ef0-216c36af6f52/0c091406-52a3-531d-8ef0-216c36af6f52_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 430276,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/36ad35d5112c4a779be065d612d14143.jpg',
'Width': 2048}],
'price': 8990,
'price_includes_vat': True,
'registration_date': '2009-09-21',
'seats_number': 5,
'seller_name': None,
'title': 'Lexus RX 3.5 450h V6 SE-L CVT 4WD Euro 4 (s/s) 5dr',
'transmission': 'automatic',
'trim': 'SE-L',
'year': 2009}
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603130666073%27 HTTP/1.1" 200 None
2026-03-25 15:41:51 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603130666073: {'created_time': 1774453311.637162, 'last_price_update_time': 1774453311.637172}
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603130666073') HTTP/1.1" 204 0
2026-03-25 15:41:51 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 9ad65d79-5dbc-547c-b4f7-ae4c12e9db7d with identifier 202603120640211
2026-03-25 15:41:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:51 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 9ad65d79-5dbc-547c-b4f7-ae4c12e9db7d
2026-03-25 15:41:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/2ea2eb07e6dd4df9a14867b80e751de4.jpg>
{'auction_title': '',
'c_o_2_emission_value': 122,
'color': 'Black',
'currency': 'GBP',
'description': 'This 2018 Nissan Qashqai dCi Tekna offers exceptional value '
'with its remarkably low mileage of just 63,807 miles for its '
'age. As a Euro 6 compliant model, it features a 1.6 litre '
'diesel engine and comes equipped with desirable Tekna trim '
"enhancements. You'll appreciate the convenience of LED "
'headlights, an intelligent key for keyless entry, and a rear '
'camera as part of the tech pack, all designed to make your '
'driving experience smoother and more enjoyable.\n'
'\n'
'This Qashqai stands out with its impressive fuel economy, '
'achieving up to 60 miles per gallon, which indicates it is '
'more economical than many similar vehicles. Furthermore, its '
'low CO2 emissions and low insurance group highlight its cost '
"effectiveness for everyday use. Inside, you'll find comfort "
'is a priority with dual zone climate control air conditioning '
'and heated seats, ensuring a pleasant journey for all '
'occupants regardless of the weather.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.6L',
'engine_horse_power': 128,
'fuel_type': 'Diesel',
'id': '9ad65d79-5dbc-547c-b4f7-ae4c12e9db7d',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603120640211',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 63807,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 58,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ad65d79-5dbc-547c-b4f7-ae4c12e9db7d/9ad65d79-5dbc-547c-b4f7-ae4c12e9db7d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 422516,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2ea2eb07e6dd4df9a14867b80e751de4.jpg',
'Width': 2048}],
'price': 10799,
'price_includes_vat': True,
'registration_date': '2018-07-24',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 1.6 dCi Tekna XTRON Euro 6 (s/s) 5dr',
'transmission': 'automatic',
'trim': 'Tekna',
'year': 2018}
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120640211%27 HTTP/1.1" 200 None
2026-03-25 15:41:51 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603120640211: {'created_time': 1774453311.704419, 'last_price_update_time': 1774453311.704434}
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603120640211') HTTP/1.1" 204 0
2026-03-25 15:41:51 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e2c0ab78-160c-5019-9f36-2c228ad114a3 with identifier 202603070494164
2026-03-25 15:41:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:51 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e2c0ab78-160c-5019-9f36-2c228ad114a3
2026-03-25 15:41:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/f506dd480232417fbbbe349fd70016f3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 44,
'color': 'White',
'currency': 'GBP',
'description': 'Discover this 2015 Mitsubishi Outlander GX4HS, a '
'sophisticated 2.0L petrol plug-in hybrid that offers an '
'intelligent blend of efficiency and capability. This Four '
'Wheel Drive model comes equipped with a host of desirable '
'features designed to enhance your driving experience. Stay '
'connected and safe with the Bluetooth Hands Free Telephone '
'Kit and the helpful Rear View Camera with parking assistance. '
'Enjoy the open air with the Electric Glass Tilt and Slide '
'Sunroof, and experience ultimate comfort with Heated Front '
'Seats. For effortless journeys, the Adaptive Cruise Control '
'ensures a smooth and relaxed drive.\n'
'\n'
'The Mitsubishi Outlander GX4HS stands out with its advanced '
'plug-in hybrid technology, offering a more economical and '
'environmentally conscious way to travel compared to '
'traditional petrol or diesel vehicles. The inclusion of Four '
'Wheel Drive provides added confidence and stability in '
'various driving conditions. These carefully selected '
'features, from the convenience of Bluetooth and the rear '
'camera to the comfort of heated seats and the ease of '
'adaptive cruise control, demonstrate a thoughtful '
'specification that elevates this Outlander above others in '
'its class.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '2L',
'engine_horse_power': 198,
'fuel_type': 'Petrol Plug-in Hybrid',
'id': 'e2c0ab78-160c-5019-9f36-2c228ad114a3',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603070494164',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'Mitsubishi',
'model': 'Outlander',
'odometer': 115893,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 63,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2c0ab78-160c-5019-9f36-2c228ad114a3/e2c0ab78-160c-5019-9f36-2c228ad114a3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85194,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f506dd480232417fbbbe349fd70016f3.jpg',
'Width': 800}],
'price': 5999,
'price_includes_vat': True,
'registration_date': '2015-03-16',
'seats_number': 5,
'seller_name': None,
'title': 'Mitsubishi Outlander 2.0h 12kWh GX4hs CVT 4WD Euro 5 (s/s) 5dr',
'transmission': 'automatic',
'trim': 'GX4hs',
'year': 2015}
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603070494164%27 HTTP/1.1" 200 None
2026-03-25 15:41:51 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603070494164: {'created_time': 1774453311.76313, 'last_price_update_time': 1774453311.763142}
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603070494164') HTTP/1.1" 204 0
2026-03-25 15:41:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/2afb5818621a4c2781e8a510427fa377.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-25 15:41:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-25 15:41:51 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:51 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 32085e4d-6240-5833-bfe9-859b989c245c with identifier: 202602220120314
2026-03-25 15:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 32085e4d-6240-5833-bfe9-859b989c245c
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc32ac48767f74f92854f8ca97f9fcc81.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c32ac48767f74f92854f8ca97f9fcc81.jpg not downloaded yet
2026-03-25 15:41:51 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-25 15:41:51 [auto_selling_autotrader.co.uk] INFO: Page: 3/3, total results: 42
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202402236873414%27 HTTP/1.1" 200 None
2026-03-25 15:41:51 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202402236873414: 1
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202303315831269%27 HTTP/1.1" 200 None
2026-03-25 15:41:51 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202303315831269: 1
2026-03-25 15:41:51 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 2 detail requests (batch 1)
2026-03-25 15:41:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/0d9027404e3644ea936f3529c17f7a30.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:51 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:51 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a61a69b9-2ca5-5c9f-a010-4b71a40a404d with identifier: 202602169967151
2026-03-25 15:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a61a69b9-2ca5-5c9f-a010-4b71a40a404d
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F42c828e3cb9e49eeb4c97f4849bd708e.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/42c828e3cb9e49eeb4c97f4849bd708e.jpg not downloaded yet
2026-03-25 15:41:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 15:41:51 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:51 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 73373d23-5d51-5779-94e9-5765e77955b3 with identifier: 202602109827925
2026-03-25 15:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 73373d23-5d51-5779-94e9-5765e77955b3
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5b938da6f09c431f9f2cb584be25ccf9.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5b938da6f09c431f9f2cb584be25ccf9.jpg not downloaded yet
2026-03-25 15:41:51 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:51 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 4808a5f3-29cd-5d44-be30-9eeaa1536a8e with identifier: 202602109819513
2026-03-25 15:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4808a5f3-29cd-5d44-be30-9eeaa1536a8e
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0dd09d9d9020432ebc4ffea8a4be45df.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0dd09d9d9020432ebc4ffea8a4be45df.jpg not downloaded yet
2026-03-25 15:41:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f229ca19ed0>
2026-03-25 15:41:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43573217-a8c4-52fd-b430-e5b2e913bc64/43573217-a8c4-52fd-b430-e5b2e913bc64_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2afb5818621a4c2781e8a510427fa377.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2afb5818621a4c2781e8a510427fa377.jpg saved to cache
2026-03-25 15:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 43573217-a8c4-52fd-b430-e5b2e913bc64
2026-03-25 15:41:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 43573217-a8c4-52fd-b430-e5b2e913bc64 sending to next pipeline
2026-03-25 15:41:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 861cd77c-8f6c-5657-a4d7-bfab8d0fc7c7 with identifier: 202601269424838
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 861cd77c-8f6c-5657-a4d7-bfab8d0fc7c7
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9b9825bc65a1401fbb709fe99385302f.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9b9825bc65a1401fbb709fe99385302f.jpg not downloaded yet
2026-03-25 15:41:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 13888c53-e1a5-5ad3-af16-03c3317da103 with identifier: 202510237379592
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 13888c53-e1a5-5ad3-af16-03c3317da103
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbc2340790c0b45d58fb3153ed4bedb13.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bc2340790c0b45d58fb3153ed4bedb13.jpg not downloaded yet
2026-03-25 15:41:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 688241b1-162a-52cc-b585-954d611d8466 with identifier: 202602109819402
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 688241b1-162a-52cc-b585-954d611d8466
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe3df7e1d57454ed9b18f89da5b9edf7e.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e3df7e1d57454ed9b18f89da5b9edf7e.jpg not downloaded yet
2026-03-25 15:41:52 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 43573217-a8c4-52fd-b430-e5b2e913bc64 with identifier 202603030365194
2026-03-25 15:41:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:52 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 43573217-a8c4-52fd-b430-e5b2e913bc64
2026-03-25 15:41:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/2afb5818621a4c2781e8a510427fa377.jpg>
{'auction_title': '',
'c_o_2_emission_value': 166,
'color': 'Grey',
'currency': 'GBP',
'description': 'This Mercedes Benz A Class A170 Avantgarde SE from 2007 '
'boasts an exceptional ownership record, having had only two '
'owners from new. This well maintained example features a 1.7 '
'litre petrol engine and comes with a full service history, '
'offering peace of mind for its next owner. The Avantgarde SE '
'trim level ensures a comfortable and stylish driving '
'experience. THIS VEHICLE HAS AN OUTSTANDING RECALL----\n'
'\n'
'The low insurance group for this A Class is a significant '
'advantage, indicating that running costs are likely to be '
'lower compared to many other vehicles in its class. Combined '
'with its excellent provenance, this Mercedes Benz A Class '
'A170 Avantgarde SE presents a compelling choice for those '
'seeking a reliable and economical premium hatchback.',
'doors_number': 5,
'emission_standard': 'Euro 4',
'engine': '1.7L',
'engine_horse_power': 116,
'fuel_type': 'Petrol',
'id': '43573217-a8c4-52fd-b430-e5b2e913bc64',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603030365194',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'Mercedes-Benz',
'model': 'A Class',
'odometer': 47679,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 64,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43573217-a8c4-52fd-b430-e5b2e913bc64/43573217-a8c4-52fd-b430-e5b2e913bc64_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 399763,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2afb5818621a4c2781e8a510427fa377.jpg',
'Width': 2048}],
'price': 3499,
'price_includes_vat': True,
'registration_date': '2007-09-27',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A Class 1.7 A170 Avantgarde SE CVT 5dr',
'transmission': 'automatic',
'trim': 'Avantgarde SE',
'year': 2007}
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603030365194%27 HTTP/1.1" 200 None
2026-03-25 15:41:52 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603030365194: {'created_time': 1774453312.106205, 'last_price_update_time': 1774453312.106214}
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603030365194') HTTP/1.1" 204 0
2026-03-25 15:41:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d8ca120b-2ae8-5700-9608-c4777e277e57 with identifier: 202601189234896
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d8ca120b-2ae8-5700-9608-c4777e277e57
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4ef075307cc846598b2601bb7d8b61c9.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4ef075307cc846598b2601bb7d8b61c9.jpg not downloaded yet
2026-03-25 15:41:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b224f33-0c50-52eb-8737-e231ddac76a1 with identifier: 202509186448249
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8b224f33-0c50-52eb-8737-e231ddac76a1
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F748cbfdffd6647ee9e42f39ecab8ae7e.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/748cbfdffd6647ee9e42f39ecab8ae7e.jpg not downloaded yet
2026-03-25 15:41:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: efbaa0a0-9540-5172-b0f8-87be42521949 with identifier: 202602099800180
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item efbaa0a0-9540-5172-b0f8-87be42521949
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6838fcf633df46b89864ef50d4c41626.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6838fcf633df46b89864ef50d4c41626.jpg not downloaded yet
2026-03-25 15:41:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f229cae5190>
2026-03-25 15:41:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_394cf89d-eb73-54fb-953f-cc1f7a39071c/394cf89d-eb73-54fb-953f-cc1f7a39071c_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0d9027404e3644ea936f3529c17f7a30.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0d9027404e3644ea936f3529c17f7a30.jpg saved to cache
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 394cf89d-eb73-54fb-953f-cc1f7a39071c
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 394cf89d-eb73-54fb-953f-cc1f7a39071c sending to next pipeline
2026-03-25 15:41:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fbc9f36-58e7-5755-9b79-733430b23d56 with identifier: 202601149145374
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8fbc9f36-58e7-5755-9b79-733430b23d56
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F08ef35dfdef74ad784a6f24b71010059.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/08ef35dfdef74ad784a6f24b71010059.jpg not downloaded yet
2026-03-25 15:41:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e853e5c-127d-5245-bb49-b6b9e12a20f3 with identifier: 202509066110735
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3e853e5c-127d-5245-bb49-b6b9e12a20f3
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F60dc2baeea844d3fa77bdb582e49d328.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/60dc2baeea844d3fa77bdb582e49d328.jpg not downloaded yet
2026-03-25 15:41:52 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 394cf89d-eb73-54fb-953f-cc1f7a39071c with identifier 202603130681723
2026-03-25 15:41:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:52 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 394cf89d-eb73-54fb-953f-cc1f7a39071c
2026-03-25 15:41:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/0d9027404e3644ea936f3529c17f7a30.jpg>
{'auction_title': '',
'c_o_2_emission_value': 120,
'color': 'Bronze',
'currency': 'GBP',
'description': 'This 2014 Peugeot Partner Tepee HDi Tepee S presents an '
'exceptional find with remarkably low mileage for its age, '
'having covered just 32,862 miles. Powered by an efficient 1.6 '
'litre diesel engine, this Tepee S model offers a practical '
'and economical driving experience. Its generous boot space '
'makes it ideal for families or those needing ample storage, '
'while its low CO2 emissions contribute to a more '
'environmentally friendly journey.\n'
'\n'
'The low insurance group rating for this Partner Tepee Tepee S '
'is a significant advantage, indicating lower running costs '
'compared to many similar vehicles. Combined with its very low '
'mileage and impressive boot capacity, this Peugeot Partner '
'Tepee HDi Tepee S stands out as a sensible and cost effective '
'choice for a versatile vehicle.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.6L',
'engine_horse_power': 92,
'fuel_type': 'Diesel',
'id': '394cf89d-eb73-54fb-953f-cc1f7a39071c',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603130681723',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'Peugeot',
'model': 'Partner Tepee',
'odometer': 32862,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 50,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_394cf89d-eb73-54fb-953f-cc1f7a39071c/394cf89d-eb73-54fb-953f-cc1f7a39071c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 416912,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0d9027404e3644ea936f3529c17f7a30.jpg',
'Width': 2048}],
'price': 6799,
'price_includes_vat': True,
'registration_date': '2014-03-31',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot Partner Tepee 1.6 HDi Tepee S EGC (s/s) 5dr',
'transmission': 'automatic',
'trim': 'Tepee S',
'year': 2014}
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603130681723%27 HTTP/1.1" 200 None
2026-03-25 15:41:52 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603130681723: {'created_time': 1774453312.332487, 'last_price_update_time': 1774453312.332496}
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603130681723') HTTP/1.1" 204 0
2026-03-25 15:41:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ff716070-ce42-52e5-9f85-778a0abcb05a with identifier: 202602089773040
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ff716070-ce42-52e5-9f85-778a0abcb05a
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F811297ac4e44401c9ae47ec3e66d210c.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/811297ac4e44401c9ae47ec3e66d210c.jpg not downloaded yet
2026-03-25 15:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/5b938da6f09c431f9f2cb584be25ccf9.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b97db52-d3be-55af-bac0-09daa8b9fa67 with identifier: 202512178669541
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6b97db52-d3be-55af-bac0-09daa8b9fa67
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff0ad14edc4304eb38695d170cc8834df.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f0ad14edc4304eb38695d170cc8834df.jpg not downloaded yet
2026-03-25 15:41:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 86122de6-bd66-5afa-969a-43994b40f7d0 with identifier: 202508275801558
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 86122de6-bd66-5afa-969a-43994b40f7d0
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1940c90abd1a475f9cbc43f79d26996c.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1940c90abd1a475f9cbc43f79d26996c.jpg not downloaded yet
2026-03-25 15:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/c32ac48767f74f92854f8ca97f9fcc81.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/bc2340790c0b45d58fb3153ed4bedb13.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 4055890d-8f97-5d56-89b0-d480aa62c5a9 with identifier: 202601299513378
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4055890d-8f97-5d56-89b0-d480aa62c5a9
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F45e240a5dca14006aa672f43f5f61456.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/45e240a5dca14006aa672f43f5f61456.jpg not downloaded yet
2026-03-25 15:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/42c828e3cb9e49eeb4c97f4849bd708e.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cd87309-3395-5103-b2b8-8a377d381a1b with identifier: 202512148583133
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6cd87309-3395-5103-b2b8-8a377d381a1b
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2429e4f61a884dc39098bf20727f69ad.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2429e4f61a884dc39098bf20727f69ad.jpg not downloaded yet
2026-03-25 15:41:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: dc05487c-23cb-5e16-9914-4946da44b95c with identifier: 202508205603143
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item dc05487c-23cb-5e16-9914-4946da44b95c
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F43404924c6b44a34ac69632833d888c9.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/43404924c6b44a34ac69632833d888c9.jpg not downloaded yet
2026-03-25 15:41:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 496bd355-5f1d-5132-bea7-c38b3c1088e3 with identifier: 202601279456168
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 496bd355-5f1d-5132-bea7-c38b3c1088e3
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8630099bfa934faabc60799e293919f3.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8630099bfa934faabc60799e293919f3.jpg not downloaded yet
2026-03-25 15:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/9b9825bc65a1401fbb709fe99385302f.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 3af310ef-4751-51b3-938e-7cbcc2a96519 with identifier: 202512098484194
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3af310ef-4751-51b3-938e-7cbcc2a96519
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F25909c57b69c43549f82ac7d503cdfc7.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/25909c57b69c43549f82ac7d503cdfc7.jpg not downloaded yet
2026-03-25 15:41:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 3446dce4-5bc9-58d3-bc51-8fd76ca0d528 with identifier: 202508195571167
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3446dce4-5bc9-58d3-bc51-8fd76ca0d528
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F69ede0fa6692468fa3178d540db93dd6.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/69ede0fa6692468fa3178d540db93dd6.jpg not downloaded yet
2026-03-25 15:41:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 40b0d438-1ef0-5178-b37d-137ef72b21df with identifier: 202601269425075
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 40b0d438-1ef0-5178-b37d-137ef72b21df
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F79e6d35e6010422da3e8cf238e444ede.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/79e6d35e6010422da3e8cf238e444ede.jpg not downloaded yet
2026-03-25 15:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/0dd09d9d9020432ebc4ffea8a4be45df.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 5776bf1a-f2e2-505b-be22-07ce67cfd7d5 with identifier: 202511298234017
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5776bf1a-f2e2-505b-be22-07ce67cfd7d5
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F77e1dcc0a6094b1992c3f72adb69fd00.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/77e1dcc0a6094b1992c3f72adb69fd00.jpg not downloaded yet
2026-03-25 15:41:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a8133ed-48f5-546e-a0a4-26b381b61c7f with identifier: 202507144470779
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2a8133ed-48f5-546e-a0a4-26b381b61c7f
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0608347df3db4f728b674a99e38d414b.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0608347df3db4f728b674a99e38d414b.jpg not downloaded yet
2026-03-25 15:41:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f229ca31110>
2026-03-25 15:41:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73373d23-5d51-5779-94e9-5765e77955b3/73373d23-5d51-5779-94e9-5765e77955b3_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5b938da6f09c431f9f2cb584be25ccf9.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5b938da6f09c431f9f2cb584be25ccf9.jpg saved to cache
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73373d23-5d51-5779-94e9-5765e77955b3
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73373d23-5d51-5779-94e9-5765e77955b3 sending to next pipeline
2026-03-25 15:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/748cbfdffd6647ee9e42f39ecab8ae7e.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/6838fcf633df46b89864ef50d4c41626.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:52 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 73373d23-5d51-5779-94e9-5765e77955b3 with identifier 202602109827925
2026-03-25 15:41:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:52 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 73373d23-5d51-5779-94e9-5765e77955b3
2026-03-25 15:41:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/5b938da6f09c431f9f2cb584be25ccf9.jpg>
{'auction_title': '',
'c_o_2_emission_value': 189,
'color': 'Black',
'currency': 'GBP',
'description': 'This 2013 Porsche Cayenne TD V6 boasts exceptionally low '
'mileage for its age, having covered just 82,952 miles. This '
'impressive example of the popular Cayenne model is equipped '
'with a powerful 3.0L Diesel engine and a robust Four Wheel '
'Drive system, ensuring confident performance in all '
'conditions. Inside, you will find the convenience of Dual '
'Zone Climate Control, allowing both driver and passenger to '
'set their preferred temperature independently.\n'
'\n'
'The low mileage on this Cayenne TD V6 is a significant '
'advantage, suggesting less wear and tear compared to other '
'vehicles of a similar age. This, combined with the desirable '
'Porsche marque and the practical TD V6 variant, makes it a '
'compelling choice for those seeking a premium SUV. The '
'inclusion of Four Wheel Drive and the efficient 3.0L Diesel '
'engine further enhance its appeal, offering a blend of '
'capability and economy.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '3L',
'engine_horse_power': 237,
'fuel_type': 'Diesel',
'id': '73373d23-5d51-5779-94e9-5765e77955b3',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602109827925',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'Porsche',
'model': 'Cayenne',
'odometer': 82952,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 66,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73373d23-5d51-5779-94e9-5765e77955b3/73373d23-5d51-5779-94e9-5765e77955b3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77490,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5b938da6f09c431f9f2cb584be25ccf9.jpg',
'Width': 800}],
'price': 12899,
'price_includes_vat': True,
'registration_date': '2013-06-05',
'seats_number': 5,
'seller_name': None,
'title': 'Porsche Cayenne 3.0 TD V6 Tiptronic 4WD Euro 5 (s/s) 5dr',
'transmission': 'automatic',
'year': 2013}
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602109827925%27 HTTP/1.1" 200 None
2026-03-25 15:41:52 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602109827925: {'created_time': 1774453312.747928, 'last_price_update_time': 1774453312.74797}
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602109827925') HTTP/1.1" 204 0
2026-03-25 15:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/4ef075307cc846598b2601bb7d8b61c9.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e58e3540-d472-5eb4-94fa-f36b079e6a21 with identifier: 202511268148295
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e58e3540-d472-5eb4-94fa-f36b079e6a21
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Faee3b2762b7a4834b55590d20f70c524.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/aee3b2762b7a4834b55590d20f70c524.jpg not downloaded yet
2026-03-25 15:41:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d87ba0e0-f39c-512c-ba5d-6e6e8fac17cb with identifier: 202411276782159
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d87ba0e0-f39c-512c-ba5d-6e6e8fac17cb
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F62774135fdde41e6b44884b9c958ad54.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/62774135fdde41e6b44884b9c958ad54.jpg not downloaded yet
2026-03-25 15:41:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f229dc2b710>
2026-03-25 15:41:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32085e4d-6240-5833-bfe9-859b989c245c/32085e4d-6240-5833-bfe9-859b989c245c_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc32ac48767f74f92854f8ca97f9fcc81.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c32ac48767f74f92854f8ca97f9fcc81.jpg saved to cache
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 32085e4d-6240-5833-bfe9-859b989c245c
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 32085e4d-6240-5833-bfe9-859b989c245c sending to next pipeline
2026-03-25 15:41:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22a118eed0>
2026-03-25 15:41:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13888c53-e1a5-5ad3-af16-03c3317da103/13888c53-e1a5-5ad3-af16-03c3317da103_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbc2340790c0b45d58fb3153ed4bedb13.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bc2340790c0b45d58fb3153ed4bedb13.jpg saved to cache
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13888c53-e1a5-5ad3-af16-03c3317da103
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 13888c53-e1a5-5ad3-af16-03c3317da103 sending to next pipeline
2026-03-25 15:41:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22a119cd50>
2026-03-25 15:41:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a61a69b9-2ca5-5c9f-a010-4b71a40a404d/a61a69b9-2ca5-5c9f-a010-4b71a40a404d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F42c828e3cb9e49eeb4c97f4849bd708e.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/42c828e3cb9e49eeb4c97f4849bd708e.jpg saved to cache
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a61a69b9-2ca5-5c9f-a010-4b71a40a404d
2026-03-25 15:41:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a61a69b9-2ca5-5c9f-a010-4b71a40a404d sending to next pipeline
2026-03-25 15:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/60dc2baeea844d3fa77bdb582e49d328.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/08ef35dfdef74ad784a6f24b71010059.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/811297ac4e44401c9ae47ec3e66d210c.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:52 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 32085e4d-6240-5833-bfe9-859b989c245c with identifier 202602220120314
2026-03-25 15:41:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:52 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 32085e4d-6240-5833-bfe9-859b989c245c
2026-03-25 15:41:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/c32ac48767f74f92854f8ca97f9fcc81.jpg>
{'auction_title': '',
'c_o_2_emission_value': 158,
'color': 'Silver',
'currency': 'GBP',
'description': 'This 2012 Volkswagen Tiguan TDI SE presents a remarkable '
'opportunity with its exceptionally low mileage of just 91,355 '
'miles for a vehicle of its age. Powered by a robust 2.0 litre '
'diesel engine and featuring a capable four wheel drive '
'system, this model is well equipped for various conditions. '
'The SE trim level ensures a comfortable and convenient '
'driving experience, further enhanced by notable features such '
'as dusk sensing automatic headlights, two zone electronic '
'climate control with automatic air recirculation, and '
'Bluetooth telephone preparation for seamless connectivity.\n'
'\n'
'Further enhancing its appeal, this Tiguan boasts Park Assist, '
'which includes front and rear parking sensors, making '
'manoeuvring in tight spaces considerably easier. The vehicle '
'also benefits from a low insurance group, suggesting more '
'affordable ownership costs. With a substantial towing weight '
'of 2500 kg, this Volkswagen Tiguan TDI SE is a versatile and '
'practical choice, offering a compelling combination of '
'performance, technology, and value that sets it apart from '
'other vehicles in its class.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '2L',
'engine_horse_power': 138,
'fuel_type': 'Diesel',
'id': '32085e4d-6240-5833-bfe9-859b989c245c',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602220120314',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 91355,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 60,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32085e4d-6240-5833-bfe9-859b989c245c/32085e4d-6240-5833-bfe9-859b989c245c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 381977,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c32ac48767f74f92854f8ca97f9fcc81.jpg',
'Width': 2048}],
'price': 5999,
'price_includes_vat': True,
'registration_date': '2012-09-27',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI BlueMotion Tech SE DSG 4WD Euro 5 (s/s) '
'5dr',
'transmission': 'automatic',
'trim': 'SE',
'year': 2012}
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602220120314%27 HTTP/1.1" 200 None
2026-03-25 15:41:53 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602220120314: {'created_time': 1774453313.013701, 'last_price_update_time': 1774453313.013712}
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602220120314') HTTP/1.1" 204 0
2026-03-25 15:41:53 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 13888c53-e1a5-5ad3-af16-03c3317da103 with identifier 202510237379592
2026-03-25 15:41:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:53 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 13888c53-e1a5-5ad3-af16-03c3317da103
2026-03-25 15:41:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/bc2340790c0b45d58fb3153ed4bedb13.jpg>
{'auction_title': '',
'c_o_2_emission_value': 105,
'color': 'Blue',
'currency': 'GBP',
'description': 'REVERSING CAMERA —This 2015 Citroen Grand C4 Picasso e-HDi '
'Exclusive is a standout choice, boasting an impressively low '
'mileage of just 74,400 miles for its age and having been '
'cared for by only two owners. This seven seater MPV is '
'powered by an efficient 1.6 litre diesel engine and features '
"the desirable Exclusive trim. You'll appreciate the "
'convenience of keyless entry and start, automatic headlights, '
'and a reversing camera complete with parking assistance. The '
'cabin offers automatic dual zone climate control for '
'personalised comfort, and the distinctive chrome side '
'signature adds a touch of style.\n'
'\n'
'The exceptional fuel economy of 71 miles per gallon is a '
'significant highlight, demonstrating how this Grand C4 '
'Picasso offers greater efficiency compared to many other '
'vehicles in its class. Coupled with its low CO2 emissions, '
'this makes it an economical and environmentally conscious '
'option. This well maintained and feature packed seven seater '
'provides a practical and comfortable driving experience for '
'families.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.6L',
'engine_horse_power': 112,
'fuel_type': 'Diesel',
'id': '13888c53-e1a5-5ad3-af16-03c3317da103',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510237379592',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'Citroen',
'model': 'Grand C4 Picasso',
'odometer': 74400,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 67,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13888c53-e1a5-5ad3-af16-03c3317da103/13888c53-e1a5-5ad3-af16-03c3317da103_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84502,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bc2340790c0b45d58fb3153ed4bedb13.jpg',
'Width': 800}],
'price': 5680,
'price_includes_vat': True,
'registration_date': '2015-02-16',
'seats_number': 7,
'seller_name': None,
'title': 'Citroen Grand C4 Picasso 1.6 e-HDi Exclusive ETG6 Euro 5 (s/s) 5dr',
'transmission': 'automatic',
'trim': 'Exclusive',
'year': 2015}
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510237379592%27 HTTP/1.1" 200 None
2026-03-25 15:41:53 [auto_selling_autotrader.co.uk] INFO: Saving data for 202510237379592: {'created_time': 1774453313.0781, 'last_price_update_time': 1774453313.078121}
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510237379592') HTTP/1.1" 204 0
2026-03-25 15:41:53 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a61a69b9-2ca5-5c9f-a010-4b71a40a404d with identifier 202602169967151
2026-03-25 15:41:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:53 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a61a69b9-2ca5-5c9f-a010-4b71a40a404d
2026-03-25 15:41:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/42c828e3cb9e49eeb4c97f4849bd708e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 124,
'color': 'White',
'currency': 'GBP',
'description': 'This 2018 Audi A5 TFSI Sport offers a compelling blend of '
'style and practicality, making it an excellent choice for '
'discerning drivers. Powered by an efficient 1.4 litre Euro 6 '
'compliant petrol engine, this Sport trim model delivers a '
"smooth and responsive driving experience. Inside, you'll find "
'comfort enhanced by heated front seats, perfect for those '
'colder mornings. The convenience of automatic headlights, '
'activated by a light and rain sensor, ensures optimal '
'visibility, while Xenon headlights with striking LED daytime '
'running lights provide both clarity and a distinctive look. '
'Connectivity is seamless thanks to the Bluetooth interface '
'and the Audi Smartphone Interface, which supports both '
'Android Auto and Apple CarPlay, keeping your digital life '
'accessible on the go.\n'
'\n'
'The Audi A5 TFSI Sport stands out with its impressive fuel '
'economy, achieving up to 52 miles per gallon, which indicates '
'its efficiency compared to similar vehicles. Furthermore, its '
'acceleration from 0 to 60 miles per hour in just 8.6 seconds '
'demonstrates a lively performance. Practicality is also a key '
'strength, with a generously sized boot offering ample space '
'for luggage, shopping, or sports equipment, making it a '
'versatile companion for everyday journeys and longer trips '
'alike.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.4L',
'engine_horse_power': 148,
'fuel_type': 'Petrol',
'id': 'a61a69b9-2ca5-5c9f-a010-4b71a40a404d',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602169967151',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'Audi',
'model': 'A5',
'odometer': 139000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 66,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a61a69b9-2ca5-5c9f-a010-4b71a40a404d/a61a69b9-2ca5-5c9f-a010-4b71a40a404d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 429135,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/42c828e3cb9e49eeb4c97f4849bd708e.jpg',
'Width': 2048}],
'price': 8992,
'price_includes_vat': True,
'registration_date': '2018-05-30',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A5 1.4 TFSI Sport Sportback S Tronic Euro 6 (s/s) 5dr',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2018}
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602169967151%27 HTTP/1.1" 200 None
2026-03-25 15:41:53 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602169967151: {'created_time': 1774453313.184274, 'last_price_update_time': 1774453313.184286}
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602169967151') HTTP/1.1" 204 0
2026-03-25 15:41:53 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:53 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f5a0adb-8c65-5baf-b1b9-a935f33a0a8e with identifier: 202511238085298
2026-03-25 15:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7f5a0adb-8c65-5baf-b1b9-a935f33a0a8e
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F589a30da50e14cc1be7d7bfa74054a23.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/589a30da50e14cc1be7d7bfa74054a23.jpg not downloaded yet
2026-03-25 15:41:53 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:53 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e1e5432a-1537-53b8-b548-dfaf885aba7f with identifier: 202410295719460
2026-03-25 15:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e1e5432a-1537-53b8-b548-dfaf885aba7f
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3eac66c6f4ab485c8e144fd54e2e0e8e.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3eac66c6f4ab485c8e144fd54e2e0e8e.jpg not downloaded yet
2026-03-25 15:41:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f229dc284d0>
2026-03-25 15:41:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_861cd77c-8f6c-5657-a4d7-bfab8d0fc7c7/861cd77c-8f6c-5657-a4d7-bfab8d0fc7c7_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9b9825bc65a1401fbb709fe99385302f.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9b9825bc65a1401fbb709fe99385302f.jpg saved to cache
2026-03-25 15:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 861cd77c-8f6c-5657-a4d7-bfab8d0fc7c7
2026-03-25 15:41:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 861cd77c-8f6c-5657-a4d7-bfab8d0fc7c7 sending to next pipeline
2026-03-25 15:41:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f229f960990>
2026-03-25 15:41:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4808a5f3-29cd-5d44-be30-9eeaa1536a8e/4808a5f3-29cd-5d44-be30-9eeaa1536a8e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0dd09d9d9020432ebc4ffea8a4be45df.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0dd09d9d9020432ebc4ffea8a4be45df.jpg saved to cache
2026-03-25 15:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4808a5f3-29cd-5d44-be30-9eeaa1536a8e
2026-03-25 15:41:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4808a5f3-29cd-5d44-be30-9eeaa1536a8e sending to next pipeline
2026-03-25 15:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/1940c90abd1a475f9cbc43f79d26996c.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:53 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 861cd77c-8f6c-5657-a4d7-bfab8d0fc7c7 with identifier 202601269424838
2026-03-25 15:41:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:53 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 861cd77c-8f6c-5657-a4d7-bfab8d0fc7c7
2026-03-25 15:41:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/9b9825bc65a1401fbb709fe99385302f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 126,
'color': 'White',
'currency': 'GBP',
'description': 'FULL MAIN DEALER SERVICE HISTORY --- 2 KEYS --- HPI CLEAR --- '
'VERY GOOD CONDITION INSIDE OUT --- FRIST TO SEE WILL BUY IT '
'--- ONLY 2 OWNERS FROM NEW -- SMALL ENGINE WITH LOW INSURANCE '
'GROUP -- This 2020 SEAT Leon TSI EVO SE Dynamic boasts a full '
'dealership service history, offering peace of mind for its '
'next owner. This Euro 6 compliant model features a 1.0 litre '
'petrol engine and comes in the SE Dynamic trim. It is '
'equipped with LED headlights and taillights, along with '
'separate daytime running lights that automatically control '
'the headlights. For convenience, it includes Park Assist with '
'front and rear parking sensors, and the Media System Plus '
'with navigation and Bluetooth connectivity.\n'
'\n'
'The SEAT Leon also offers excellent connectivity through Full '
'Link Smartphone Integration, supporting Mirror Link, wireless '
"Apple CarPlay, and wired Google Android Auto. You'll "
'appreciate the large boot space, perfect for luggage or '
'shopping. With an impressive fuel economy of 51 mpg, this '
'Leon is more economical to run than many similar vehicles. '
'The combination of its comprehensive service history, '
'advanced technology, and efficient performance makes this '
'SEAT Leon a standout choice.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1L',
'engine_horse_power': 108,
'fuel_type': 'Petrol',
'id': '861cd77c-8f6c-5657-a4d7-bfab8d0fc7c7',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601269424838',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'SEAT',
'model': 'Leon',
'odometer': 73950,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 63,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_861cd77c-8f6c-5657-a4d7-bfab8d0fc7c7/861cd77c-8f6c-5657-a4d7-bfab8d0fc7c7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80803,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9b9825bc65a1401fbb709fe99385302f.jpg',
'Width': 800}],
'price': 9799,
'price_includes_vat': True,
'registration_date': '2020-11-16',
'seats_number': 5,
'seller_name': None,
'title': 'SEAT Leon 1.0 TSI EVO SE Dynamic Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'SE Dynamic',
'year': 2020}
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601269424838%27 HTTP/1.1" 200 None
2026-03-25 15:41:53 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601269424838: {'created_time': 1774453313.39565, 'last_price_update_time': 1774453313.395663}
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601269424838') HTTP/1.1" 204 0
2026-03-25 15:41:53 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 4808a5f3-29cd-5d44-be30-9eeaa1536a8e with identifier 202602109819513
2026-03-25 15:41:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:53 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 4808a5f3-29cd-5d44-be30-9eeaa1536a8e
2026-03-25 15:41:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/0dd09d9d9020432ebc4ffea8a4be45df.jpg>
{'auction_title': '',
'c_o_2_emission_value': 159,
'color': 'Grey',
'currency': 'GBP',
'description': 'This 2014 Toyota Verso Excel is a rare find, having had only '
'two owners from new. This seven seater MPV is powered by a '
'1.8 litre petrol engine and comes with a host of desirable '
"features. You'll appreciate the convenience of the Smart "
'Entry and Smart Start system, allowing keyless entry and '
'ignition. Stay connected on the go with Bluetooth '
'connectivity, and navigate tight spots with ease thanks to '
'the rear parking camera. The Excel trim also includes High '
'Intensity Discharge headlights, which are dusk sensing, '
'meaning they automatically turn on when light levels drop.\n'
'\n'
'The Toyota Verso Excel offers a compelling package for '
'families. Its 0-62mph acceleration time of 11.1 seconds is '
'competitive within its class, and it sits in a low insurance '
'group, which can help keep running costs down. These factors, '
'combined with its practical seven seat layout and the notable '
'features already mentioned, make this Verso a sensible and '
'well equipped choice for those seeking a versatile and '
'economical family vehicle.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.8L',
'engine_horse_power': 145,
'fuel_type': 'Petrol',
'id': '4808a5f3-29cd-5d44-be30-9eeaa1536a8e',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602109819513',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'Toyota',
'model': 'Verso',
'odometer': 90000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 60,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4808a5f3-29cd-5d44-be30-9eeaa1536a8e/4808a5f3-29cd-5d44-be30-9eeaa1536a8e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 450370,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0dd09d9d9020432ebc4ffea8a4be45df.jpg',
'Width': 2048}],
'price': 7499,
'price_includes_vat': True,
'registration_date': '2014-01-31',
'seats_number': 7,
'seller_name': None,
'title': 'Toyota Verso 1.8 V-Matic Excel Multidrive S Euro 5 5dr Euro 5',
'transmission': 'automatic',
'trim': 'Excel',
'year': 2014}
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602109819513%27 HTTP/1.1" 200 None
2026-03-25 15:41:53 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602109819513: {'created_time': 1774453313.447528, 'last_price_update_time': 1774453313.447541}
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602109819513') HTTP/1.1" 204 0
2026-03-25 15:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/43404924c6b44a34ac69632833d888c9.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/f0ad14edc4304eb38695d170cc8834df.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/2429e4f61a884dc39098bf20727f69ad.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:53 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:53 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d01ee19-2656-54c0-9c76-7ab312b8ffb0 with identifier: 202511077744697
2026-03-25 15:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7d01ee19-2656-54c0-9c76-7ab312b8ffb0
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fafeaea30f03c4b87b7909d70959d1955.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/afeaea30f03c4b87b7909d70959d1955.jpg not downloaded yet
2026-03-25 15:41:53 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:53 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a750923-4970-55a0-8b8e-73e3cc0d02a4 with identifier: 202409023553014
2026-03-25 15:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6a750923-4970-55a0-8b8e-73e3cc0d02a4
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3a34f1d6d3da472db914cabdd5e25a5f.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3a34f1d6d3da472db914cabdd5e25a5f.jpg not downloaded yet
2026-03-25 15:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-25 15:41:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f229c57d8d0>
2026-03-25 15:41:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b224f33-0c50-52eb-8737-e231ddac76a1/8b224f33-0c50-52eb-8737-e231ddac76a1_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F748cbfdffd6647ee9e42f39ecab8ae7e.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/748cbfdffd6647ee9e42f39ecab8ae7e.jpg saved to cache
2026-03-25 15:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8b224f33-0c50-52eb-8737-e231ddac76a1
2026-03-25 15:41:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8b224f33-0c50-52eb-8737-e231ddac76a1 sending to next pipeline
2026-03-25 15:41:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f229ddf3890>
2026-03-25 15:41:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efbaa0a0-9540-5172-b0f8-87be42521949/efbaa0a0-9540-5172-b0f8-87be42521949_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6838fcf633df46b89864ef50d4c41626.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6838fcf633df46b89864ef50d4c41626.jpg saved to cache
2026-03-25 15:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item efbaa0a0-9540-5172-b0f8-87be42521949
2026-03-25 15:41:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item efbaa0a0-9540-5172-b0f8-87be42521949 sending to next pipeline
2026-03-25 15:41:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f229dc3e8d0>
2026-03-25 15:41:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8ca120b-2ae8-5700-9608-c4777e277e57/d8ca120b-2ae8-5700-9608-c4777e277e57_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4ef075307cc846598b2601bb7d8b61c9.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4ef075307cc846598b2601bb7d8b61c9.jpg saved to cache
2026-03-25 15:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d8ca120b-2ae8-5700-9608-c4777e277e57
2026-03-25 15:41:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d8ca120b-2ae8-5700-9608-c4777e277e57 sending to next pipeline
2026-03-25 15:41:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f229ddf2f50>
2026-03-25 15:41:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e853e5c-127d-5245-bb49-b6b9e12a20f3/3e853e5c-127d-5245-bb49-b6b9e12a20f3_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F60dc2baeea844d3fa77bdb582e49d328.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/60dc2baeea844d3fa77bdb582e49d328.jpg saved to cache
2026-03-25 15:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3e853e5c-127d-5245-bb49-b6b9e12a20f3
2026-03-25 15:41:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3e853e5c-127d-5245-bb49-b6b9e12a20f3 sending to next pipeline
2026-03-25 15:41:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f229c59ab10>
2026-03-25 15:41:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fbc9f36-58e7-5755-9b79-733430b23d56/8fbc9f36-58e7-5755-9b79-733430b23d56_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F08ef35dfdef74ad784a6f24b71010059.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/08ef35dfdef74ad784a6f24b71010059.jpg saved to cache
2026-03-25 15:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8fbc9f36-58e7-5755-9b79-733430b23d56
2026-03-25 15:41:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8fbc9f36-58e7-5755-9b79-733430b23d56 sending to next pipeline
2026-03-25 15:41:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f229dc8dbd0>
2026-03-25 15:41:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff716070-ce42-52e5-9f85-778a0abcb05a/ff716070-ce42-52e5-9f85-778a0abcb05a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F811297ac4e44401c9ae47ec3e66d210c.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/811297ac4e44401c9ae47ec3e66d210c.jpg saved to cache
2026-03-25 15:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff716070-ce42-52e5-9f85-778a0abcb05a
2026-03-25 15:41:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff716070-ce42-52e5-9f85-778a0abcb05a sending to next pipeline
2026-03-25 15:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/e3df7e1d57454ed9b18f89da5b9edf7e.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/25909c57b69c43549f82ac7d503cdfc7.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/69ede0fa6692468fa3178d540db93dd6.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:53 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 8b224f33-0c50-52eb-8737-e231ddac76a1 with identifier 202509186448249
2026-03-25 15:41:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:53 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 8b224f33-0c50-52eb-8737-e231ddac76a1
2026-03-25 15:41:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/748cbfdffd6647ee9e42f39ecab8ae7e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 110,
'color': 'Red',
'currency': 'GBP',
'description': 'This 2019 Citroen C5 Aircross BlueHDi Flair boasts a full '
'service history, offering peace of mind alongside its '
'impressive capabilities. As a Euro 6 compliant 1.5 litre '
'diesel, this Flair trim model is registered in 2019 and has a '
'clear vehicle history check. It comes equipped with front '
'parking sensors and a park city camera pack for enhanced '
'manoeuvrability, along with automatic headlight activation. '
'For added safety, it features an active blind spot monitoring '
'system and a convenient Bluetooth telephone facility.\n'
'\n'
'The Citroen C5 Aircross BlueHDi Flair stands out with its '
'exceptional fuel economy, achieving a remarkable 57 miles per '
'gallon, which is better than many similar vehicles. Its low '
'CO2 emissions also contribute to its efficiency, and it falls '
'into a low insurance group, making it an economical choice. '
"Furthermore, you'll appreciate the generous boot space, "
'providing ample room for all your needs, further enhancing '
'its practicality.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 127,
'fuel_type': 'Diesel',
'id': '8b224f33-0c50-52eb-8737-e231ddac76a1',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509186448249',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'Citroen',
'model': 'C5 Aircross',
'odometer': 53250,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 73,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b224f33-0c50-52eb-8737-e231ddac76a1/8b224f33-0c50-52eb-8737-e231ddac76a1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80732,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/748cbfdffd6647ee9e42f39ecab8ae7e.jpg',
'Width': 800}],
'price': 8999,
'price_includes_vat': True,
'registration_date': '2019-07-05',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C5 Aircross 1.5 BlueHDi Flair Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'Flair',
'year': 2019}
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509186448249%27 HTTP/1.1" 200 None
2026-03-25 15:41:53 [auto_selling_autotrader.co.uk] INFO: Saving data for 202509186448249: {'created_time': 1774453313.846129, 'last_price_update_time': 1774453313.846143}
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509186448249') HTTP/1.1" 204 0
2026-03-25 15:41:53 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: efbaa0a0-9540-5172-b0f8-87be42521949 with identifier 202602099800180
2026-03-25 15:41:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:53 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item efbaa0a0-9540-5172-b0f8-87be42521949
2026-03-25 15:41:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/6838fcf633df46b89864ef50d4c41626.jpg>
{'auction_title': '',
'c_o_2_emission_value': 130,
'color': 'Silver',
'currency': 'GBP',
'description': 'Discover this 2012 Kia Venga 2 with exceptionally low '
'mileage, having covered just 41319 miles. This Venga is '
'powered by a 1.4 litre petrol engine and comes equipped with '
'essential features such as air conditioning to keep you '
'comfortable and Bluetooth connectivity for seamless music '
'streaming and handsfree calls. Its compact yet practical '
'design makes it an ideal choice for everyday driving.\n'
'\n'
'This Venga stands out with its impressive fuel economy, '
'achieving up to 46 miles per gallon, which indicates it is '
'more economical than many similar vehicles. Furthermore, its '
'low CO2 emissions and low insurance group highlight its '
"affordability and efficiency. You'll also appreciate the "
'surprisingly large boot space, offering ample room for '
'shopping or luggage, making this Kia Venga a sensible and '
'well equipped option.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.4L',
'engine_horse_power': 89,
'fuel_type': 'Petrol',
'id': 'efbaa0a0-9540-5172-b0f8-87be42521949',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602099800180',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'Kia',
'model': 'Venga',
'odometer': 41319,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 60,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efbaa0a0-9540-5172-b0f8-87be42521949/efbaa0a0-9540-5172-b0f8-87be42521949_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98188,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6838fcf633df46b89864ef50d4c41626.jpg',
'Width': 800}],
'price': 3200,
'price_includes_vat': True,
'registration_date': '2012-04-03',
'seats_number': 5,
'seller_name': None,
'title': 'KIA Venga 1.4 EcoDynamics 2 Euro 5 (s/s) 5dr',
'transmission': 'manual',
'trim': '2',
'year': 2012}
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602099800180%27 HTTP/1.1" 200 None
2026-03-25 15:41:53 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602099800180: {'created_time': 1774453313.889462, 'last_price_update_time': 1774453313.889469}
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602099800180') HTTP/1.1" 204 0
2026-03-25 15:41:53 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d8ca120b-2ae8-5700-9608-c4777e277e57 with identifier 202601189234896
2026-03-25 15:41:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:53 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d8ca120b-2ae8-5700-9608-c4777e277e57
2026-03-25 15:41:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/4ef075307cc846598b2601bb7d8b61c9.jpg>
{'auction_title': '',
'c_o_2_emission_value': 227,
'color': 'Silver',
'currency': 'GBP',
'description': 'This 2011 Toyota Hilux Invincible boasts exceptionally low '
'mileage for its age, having covered just 80,000 miles, and '
'comes with a clear vehicle history check. As a 3.0 D-4D '
'Invincible Auto 4WD 4dr model, this robust four wheel drive '
'pickup is powered by a capable 3.0 litre diesel engine. The '
'Invincible trim level signifies a well equipped and durable '
'vehicle, ready for a variety of tasks.\n'
'\n'
'The Hilux Invincible stands out with its combination of a '
'powerful 3.0 litre diesel engine and automatic four wheel '
'drive, offering a superior driving experience and enhanced '
'capability compared to many other vehicles in its class. Its '
'low mileage and clear history further underline its excellent '
'condition and value, making it a reliable choice for those '
'seeking a dependable and well maintained pickup.',
'doors_number': 4,
'emission_standard': 'Euro 5',
'engine': '3L',
'engine_horse_power': 171,
'fuel_type': 'Diesel',
'id': 'd8ca120b-2ae8-5700-9608-c4777e277e57',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601189234896',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'Toyota',
'model': 'Hilux',
'odometer': 80000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 66,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8ca120b-2ae8-5700-9608-c4777e277e57/d8ca120b-2ae8-5700-9608-c4777e277e57_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79693,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4ef075307cc846598b2601bb7d8b61c9.jpg',
'Width': 800}],
'price': 13999,
'price_includes_vat': True,
'registration_date': '2011-12-02',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Hilux 3.0 D-4D Invincible Auto 4WD 4dr',
'transmission': 'automatic',
'trim': 'Invincible',
'year': 2011}
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601189234896%27 HTTP/1.1" 200 None
2026-03-25 15:41:53 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601189234896: {'created_time': 1774453313.950111, 'last_price_update_time': 1774453313.950121}
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601189234896') HTTP/1.1" 204 0
2026-03-25 15:41:53 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 3e853e5c-127d-5245-bb49-b6b9e12a20f3 with identifier 202509066110735
2026-03-25 15:41:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:53 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 3e853e5c-127d-5245-bb49-b6b9e12a20f3
2026-03-25 15:41:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/60dc2baeea844d3fa77bdb582e49d328.jpg>
{'auction_title': '',
'c_o_2_emission_value': 107,
'color': 'Red',
'currency': 'GBP',
'description': '—FRESH 12 MONTHS MOT DONE—This 2014 Volkswagen Polo TSI SE '
'offers an impressive 60 mpg, making it a highly economical '
'choice for your motoring needs. As a Euro 6 compliant '
'vehicle, it also boasts low CO2 emissions. This particular '
'model comes with manual air conditioning for your comfort and '
'features Bluetooth phone connectivity, allowing for handsfree '
'calls and Bluetooth audio connection for your favourite '
'music.\n'
'\n'
'The Polo TSI SE is powered by a 1.2 litre petrol engine, '
'capable of reaching 0 to 62 miles per hour in 10.8 seconds. '
'These figures indicate how this Volkswagen Polo performs '
'favourably compared to other vehicles in its class, offering '
'a good balance of efficiency and responsiveness for everyday '
'driving.',
'doors_number': 3,
'emission_standard': 'Euro 6',
'engine': '1.2L',
'engine_horse_power': 89,
'fuel_type': 'Petrol',
'id': '3e853e5c-127d-5245-bb49-b6b9e12a20f3',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509066110735',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 117500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 45,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e853e5c-127d-5245-bb49-b6b9e12a20f3/3e853e5c-127d-5245-bb49-b6b9e12a20f3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112553,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/60dc2baeea844d3fa77bdb582e49d328.jpg',
'Width': 800}],
'price': 2998,
'price_includes_vat': True,
'registration_date': '2014-09-19',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Polo 1.2 TSI BlueMotion Tech SE Euro 6 (s/s) 3dr',
'transmission': 'manual',
'trim': 'SE',
'year': 2014}
2026-03-25 15:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509066110735%27 HTTP/1.1" 200 None
2026-03-25 15:41:54 [auto_selling_autotrader.co.uk] INFO: Saving data for 202509066110735: {'created_time': 1774453314.091188, 'last_price_update_time': 1774453314.0912}
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509066110735') HTTP/1.1" 204 0
2026-03-25 15:41:54 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 8fbc9f36-58e7-5755-9b79-733430b23d56 with identifier 202601149145374
2026-03-25 15:41:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:54 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 8fbc9f36-58e7-5755-9b79-733430b23d56
2026-03-25 15:41:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/08ef35dfdef74ad784a6f24b71010059.jpg>
{'auction_title': '',
'c_o_2_emission_value': 138,
'color': 'Beige',
'currency': 'GBP',
'description': 'The Volkswagen Tiguan TDI Match is a reliable and '
'feature-packed vehicle from 2015. This 2.0L diesel engine '
"model is a great example of Volkswagen's commitment to "
'quality and performance. With a low mileage and a '
'well-documented history, you can buy with confidence. This '
'Tiguan is equipped with a range of convenient features, '
'including parking sensors at the front and rear, which come '
'with parking assistance systems to make navigating tight '
'spaces a breeze. The vehicle also boasts automatic driving '
"lights and dusk sensors, ensuring you're always seen on the "
'road. Additionally, the Tiguan features Bluetooth telephone '
'preparation, allowing you to stay connected on the go. The '
'Park Assist system, including parking sensors front and rear, '
'takes the stress out of parallel parking.\n'
'\n'
'The Volkswagen Tiguan TDI Match is a great choice for those '
'looking for a fuel-efficient vehicle. With a fuel economy of '
'up to 53 mpg, you can enjoy the freedom of long road trips '
'without breaking the bank. This model also boasts low '
'insurance group ratings, making it an attractive option for '
"those looking to keep costs down. Furthermore, the Tiguan's "
'low CO2 emissions make it a more environmentally friendly '
'choice. These impressive credentials indicate that the '
'Volkswagen Tiguan TDI Match is a standout model in its class, '
'offering a winning combination of performance, practicality, '
'and value.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '2L',
'engine_horse_power': 138,
'fuel_type': 'Diesel',
'id': '8fbc9f36-58e7-5755-9b79-733430b23d56',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601149145374',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 85100,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 61,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fbc9f36-58e7-5755-9b79-733430b23d56/8fbc9f36-58e7-5755-9b79-733430b23d56_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78511,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/08ef35dfdef74ad784a6f24b71010059.jpg',
'Width': 800}],
'price': 5995,
'price_includes_vat': True,
'registration_date': '2015-03-18',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI BlueMotion Tech Match 2WD Euro 5 (s/s) '
'5dr',
'transmission': 'manual',
'trim': 'Match',
'year': 2015}
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149145374%27 HTTP/1.1" 200 None
2026-03-25 15:41:54 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601149145374: {'created_time': 1774453314.139803, 'last_price_update_time': 1774453314.139815}
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601149145374') HTTP/1.1" 204 0
2026-03-25 15:41:54 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ff716070-ce42-52e5-9f85-778a0abcb05a with identifier 202602089773040
2026-03-25 15:41:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:54 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ff716070-ce42-52e5-9f85-778a0abcb05a
2026-03-25 15:41:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/811297ac4e44401c9ae47ec3e66d210c.jpg>
{'auction_title': '',
'c_o_2_emission_value': 110,
'color': 'Silver',
'currency': 'GBP',
'description': 'FULL SERVICE HISTORY—2 KEYS — LOW MILEAGE ONLY 26k Discover '
'this 2009 Toyota iQ VVT-i, a compact and clever city car that '
'offers an exceptional ownership experience. Powered by an '
'efficient 1.0 litre petrol engine, this model is designed for '
'economical driving, boasting an impressive fuel economy of up '
'to 60 miles per gallon. Its compact size makes it ideal for '
'navigating busy urban streets and parking in tight spaces, '
'while its thoughtful design ensures a comfortable and '
'practical interior.\n'
'\n'
'The Toyota iQ stands out with its remarkably low insurance '
'group, making it an affordable choice for many drivers. '
'Furthermore, its low CO2 emissions contribute to a more '
'environmentally friendly drive. These highlights demonstrate '
'how this particular Toyota iQ offers a superior combination '
'of running costs and efficiency when compared to other '
'vehicles in its class, making it a sensible and appealing '
'option for your next car.',
'doors_number': 3,
'emission_standard': 'Euro 4',
'engine': '1L',
'engine_horse_power': 68,
'fuel_type': 'Petrol',
'id': 'ff716070-ce42-52e5-9f85-778a0abcb05a',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602089773040',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'Toyota',
'model': 'iQ',
'odometer': 26463,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 47,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff716070-ce42-52e5-9f85-778a0abcb05a/ff716070-ce42-52e5-9f85-778a0abcb05a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73299,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/811297ac4e44401c9ae47ec3e66d210c.jpg',
'Width': 800}],
'price': 5490,
'price_includes_vat': True,
'registration_date': '2009-10-26',
'seats_number': 4,
'seller_name': None,
'title': 'Toyota IQ 1.0 VVT-i Multidrive Euro 4 3dr',
'transmission': 'automatic',
'year': 2009}
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602089773040%27 HTTP/1.1" 200 None
2026-03-25 15:41:54 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602089773040: {'created_time': 1774453314.200703, 'last_price_update_time': 1774453314.200713}
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602089773040') HTTP/1.1" 204 0
2026-03-25 15:41:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f229dc63150>
2026-03-25 15:41:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86122de6-bd66-5afa-969a-43994b40f7d0/86122de6-bd66-5afa-969a-43994b40f7d0_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1940c90abd1a475f9cbc43f79d26996c.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1940c90abd1a475f9cbc43f79d26996c.jpg saved to cache
2026-03-25 15:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 86122de6-bd66-5afa-969a-43994b40f7d0
2026-03-25 15:41:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 86122de6-bd66-5afa-969a-43994b40f7d0 sending to next pipeline
2026-03-25 15:41:54 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 86122de6-bd66-5afa-969a-43994b40f7d0 with identifier 202508275801558
2026-03-25 15:41:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:54 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 86122de6-bd66-5afa-969a-43994b40f7d0
2026-03-25 15:41:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/1940c90abd1a475f9cbc43f79d26996c.jpg>
{'auction_title': '',
'c_o_2_emission_value': 156,
'color': 'Red',
'currency': 'GBP',
'description': 'This 2015 BMW X4 30d xLine offers a compelling blend of '
'performance and practicality, boasting a powerful 3.0L diesel '
'engine and a smooth four wheel drive system. As a Euro 6 '
'compliant vehicle, it meets modern emissions standards. '
"Inside, you'll find a luxurious cabin featuring electric "
'front seat adjustment with driver memory, a sophisticated '
'Burled Walnut wood interior trim with Pearl Chrome accents, '
'and automatic two zone climate control for personalised '
'comfort. The electric glass sunroof adds an open and airy '
'feel, complemented by a windscreen with a grey shade band for '
'reduced glare.\n'
'\n'
'The BMW X4 30d xLine stands out with its impressive '
'acceleration, reaching 0 to 62 miles per hour in just 5.8 '
'seconds, demonstrating its dynamic capabilities. This model '
'also benefits from a low insurance group, making it an '
'economical choice for many drivers. Furthermore, the generous '
'boot space ensures ample room for luggage or shopping, '
'highlighting its versatility for everyday use and longer '
'journeys. These features collectively indicate how this X4 '
'offers a superior driving experience and ownership '
'proposition compared to similar vehicles.outstanding recall '
'done waiting for updates',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '3L',
'engine_horse_power': 254,
'fuel_type': 'Diesel',
'id': '86122de6-bd66-5afa-969a-43994b40f7d0',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202508275801558',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'BMW',
'model': 'X4',
'odometer': 84090,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 75,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86122de6-bd66-5afa-969a-43994b40f7d0/86122de6-bd66-5afa-969a-43994b40f7d0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84899,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1940c90abd1a475f9cbc43f79d26996c.jpg',
'Width': 800}],
'price': 11499,
'price_includes_vat': True,
'registration_date': '2015-03-02',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X4 3.0 30d xLine Auto xDrive Euro 6 (s/s) 5dr',
'transmission': 'automatic',
'trim': 'xLine',
'year': 2015}
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508275801558%27 HTTP/1.1" 200 None
2026-03-25 15:41:54 [auto_selling_autotrader.co.uk] INFO: Saving data for 202508275801558: {'created_time': 1774453314.298406, 'last_price_update_time': 1774453314.298415}
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202508275801558') HTTP/1.1" 204 0
2026-03-25 15:41:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/77e1dcc0a6094b1992c3f72adb69fd00.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/0608347df3db4f728b674a99e38d414b.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/79e6d35e6010422da3e8cf238e444ede.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f229c76e0d0>
2026-03-25 15:41:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc05487c-23cb-5e16-9914-4946da44b95c/dc05487c-23cb-5e16-9914-4946da44b95c_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F43404924c6b44a34ac69632833d888c9.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/43404924c6b44a34ac69632833d888c9.jpg saved to cache
2026-03-25 15:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dc05487c-23cb-5e16-9914-4946da44b95c
2026-03-25 15:41:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dc05487c-23cb-5e16-9914-4946da44b95c sending to next pipeline
2026-03-25 15:41:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f229ca388d0>
2026-03-25 15:41:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b97db52-d3be-55af-bac0-09daa8b9fa67/6b97db52-d3be-55af-bac0-09daa8b9fa67_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff0ad14edc4304eb38695d170cc8834df.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f0ad14edc4304eb38695d170cc8834df.jpg saved to cache
2026-03-25 15:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b97db52-d3be-55af-bac0-09daa8b9fa67
2026-03-25 15:41:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b97db52-d3be-55af-bac0-09daa8b9fa67 sending to next pipeline
2026-03-25 15:41:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f229ca5c3d0>
2026-03-25 15:41:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cd87309-3395-5103-b2b8-8a377d381a1b/6cd87309-3395-5103-b2b8-8a377d381a1b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2429e4f61a884dc39098bf20727f69ad.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2429e4f61a884dc39098bf20727f69ad.jpg saved to cache
2026-03-25 15:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6cd87309-3395-5103-b2b8-8a377d381a1b
2026-03-25 15:41:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6cd87309-3395-5103-b2b8-8a377d381a1b sending to next pipeline
2026-03-25 15:41:54 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:54 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: eda6ed21-0d38-596c-80d7-da7b780fdad0 with identifier: 202402236873414
2026-03-25 15:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item eda6ed21-0d38-596c-80d7-da7b780fdad0
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2ab4c747b86c4193b0b1d4bfc030ea34.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2ab4c747b86c4193b0b1d4bfc030ea34.jpg not downloaded yet
2026-03-25 15:41:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f229ca6ca10>
2026-03-25 15:41:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_688241b1-162a-52cc-b585-954d611d8466/688241b1-162a-52cc-b585-954d611d8466_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe3df7e1d57454ed9b18f89da5b9edf7e.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e3df7e1d57454ed9b18f89da5b9edf7e.jpg saved to cache
2026-03-25 15:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 688241b1-162a-52cc-b585-954d611d8466
2026-03-25 15:41:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 688241b1-162a-52cc-b585-954d611d8466 sending to next pipeline
2026-03-25 15:41:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22a0d16350>
2026-03-25 15:41:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3af310ef-4751-51b3-938e-7cbcc2a96519/3af310ef-4751-51b3-938e-7cbcc2a96519_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F25909c57b69c43549f82ac7d503cdfc7.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/25909c57b69c43549f82ac7d503cdfc7.jpg saved to cache
2026-03-25 15:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3af310ef-4751-51b3-938e-7cbcc2a96519
2026-03-25 15:41:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3af310ef-4751-51b3-938e-7cbcc2a96519 sending to next pipeline
2026-03-25 15:41:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f229dccdd50>
2026-03-25 15:41:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3446dce4-5bc9-58d3-bc51-8fd76ca0d528/3446dce4-5bc9-58d3-bc51-8fd76ca0d528_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F69ede0fa6692468fa3178d540db93dd6.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/69ede0fa6692468fa3178d540db93dd6.jpg saved to cache
2026-03-25 15:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3446dce4-5bc9-58d3-bc51-8fd76ca0d528
2026-03-25 15:41:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3446dce4-5bc9-58d3-bc51-8fd76ca0d528 sending to next pipeline
2026-03-25 15:41:54 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: dc05487c-23cb-5e16-9914-4946da44b95c with identifier 202508205603143
2026-03-25 15:41:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:54 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item dc05487c-23cb-5e16-9914-4946da44b95c
2026-03-25 15:41:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/43404924c6b44a34ac69632833d888c9.jpg>
{'auction_title': '',
'c_o_2_emission_value': 125,
'color': 'Black',
'currency': 'GBP',
'description': 'This 2020 Peugeot 208 Allure Premium is a superb example, '
'having been cherished by just one owner from new and boasting '
'a remarkably low mileage of only 30,000 miles. Powered by an '
'efficient 1.2L Petrol Engine, this Euro 6 compliant model '
'offers an impressive fuel economy of 53 miles per gallon, '
'making it an economical choice for daily driving. Inside, '
"you'll find the innovative PEUGEOT 3D i-Cockpit with its "
'configurable 3D head up instrument panel, providing a clear '
'and modern display. Convenience is further enhanced with a '
'smartphone charging plate, including wireless charging, and '
'Mirror Screen functionality that seamlessly integrates Apple '
'CarPlay and Android Auto.---THIS VEHICLE HAS AN OUTSYTANDING '
'RECALL---\n'
'\n'
'The Allure Premium trim level ensures a comfortable and '
'connected experience, further supported by the Visibility '
'Pack which includes automatic headlights for enhanced safety '
'and convenience. Parking is made easier with rear parking '
'sensors and rear parking assistance. This Peugeot 208 '
'accelerates from 0 to 62 miles per hour in a brisk 9.9 '
'seconds, demonstrating a good balance of performance and '
'efficiency that sets it apart from many other vehicles in its '
'class.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.2L',
'engine_horse_power': 99,
'fuel_type': 'Petrol',
'id': 'dc05487c-23cb-5e16-9914-4946da44b95c',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202508205603143',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'Peugeot',
'model': '208',
'odometer': 29500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc05487c-23cb-5e16-9914-4946da44b95c/dc05487c-23cb-5e16-9914-4946da44b95c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94560,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/43404924c6b44a34ac69632833d888c9.jpg',
'Width': 800}],
'price': 10999,
'price_includes_vat': True,
'registration_date': '2020-10-30',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Allure Premium Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'Allure Premium',
'year': 2020}
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508205603143%27 HTTP/1.1" 200 None
2026-03-25 15:41:54 [auto_selling_autotrader.co.uk] INFO: Saving data for 202508205603143: {'created_time': 1774453314.684333, 'last_price_update_time': 1774453314.684344}
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202508205603143') HTTP/1.1" 204 0
2026-03-25 15:41:54 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 6b97db52-d3be-55af-bac0-09daa8b9fa67 with identifier 202512178669541
2026-03-25 15:41:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:54 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 6b97db52-d3be-55af-bac0-09daa8b9fa67
2026-03-25 15:41:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/f0ad14edc4304eb38695d170cc8834df.jpg>
{'auction_title': '',
'c_o_2_emission_value': 145,
'color': 'Grey',
'currency': 'GBP',
'description': 'FULL MAIN DEALER LEXUS SERVICE HISTORY -- 2 KEYS --- RECENTLY '
'SERVICED 53K -- PANORAMIC ROOF -- DRIVES VERY WELL -- This '
'2015 Lexus RX 450h Advance presents an exceptional '
'opportunity with its remarkably low mileage of just 55,800 '
'miles. This Four Wheel Drive model boasts a powerful 3.5L '
'Petrol Hybrid engine, offering a smooth and efficient driving '
'experience. The Advance trim level ensures a premium feel, '
'complemented by desirable features such as dual zone climate '
'control with a pollen filter, front and rear parking sensors '
'for effortless manoeuvring, and striking LED headlights. '
'Enjoy an open and airy cabin thanks to the fixed panoramic '
'sunroof, adding to the overall sense of space and luxury.\n'
'\n'
'The Lexus RX 450h Advance stands out from other vehicles in '
'its class due to several key highlights. Its impressive '
'acceleration, reaching 0-62mph in just 7.8 seconds, '
'demonstrates its dynamic performance capabilities. '
'Furthermore, its placement in a low insurance group makes it '
'an economical choice for many drivers. These factors, '
'combined with the advanced technology and comfort features, '
'make this Lexus RX a compelling and well rounded premium SUV.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '3.5L',
'engine_horse_power': 295,
'fuel_type': 'Petrol Hybrid',
'id': '6b97db52-d3be-55af-bac0-09daa8b9fa67',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512178669541',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'Lexus',
'model': 'RX',
'odometer': 55800,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 74,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b97db52-d3be-55af-bac0-09daa8b9fa67/6b97db52-d3be-55af-bac0-09daa8b9fa67_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82107,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f0ad14edc4304eb38695d170cc8834df.jpg',
'Width': 800}],
'price': 15900,
'price_includes_vat': True,
'registration_date': '2015-09-08',
'seats_number': 5,
'seller_name': None,
'title': 'Lexus RX 3.5 450h V6 Advance CVT 4WD Euro 5 (s/s) 5dr (Pan Roof)',
'transmission': 'automatic',
'trim': 'Advance',
'year': 2015}
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512178669541%27 HTTP/1.1" 200 None
2026-03-25 15:41:54 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512178669541: {'created_time': 1774453314.750999, 'last_price_update_time': 1774453314.75101}
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512178669541') HTTP/1.1" 204 0
2026-03-25 15:41:54 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 6cd87309-3395-5103-b2b8-8a377d381a1b with identifier 202512148583133
2026-03-25 15:41:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:54 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 6cd87309-3395-5103-b2b8-8a377d381a1b
2026-03-25 15:41:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/2429e4f61a884dc39098bf20727f69ad.jpg>
{'auction_title': '',
'c_o_2_emission_value': 127,
'color': 'Blue',
'currency': 'GBP',
'description': 'This 2016 Kia Carens CRDi 2 is a superb example, boasting a '
'clear vehicle history check and having had only two owners '
'from new. Powered by an efficient 1.7 litre diesel engine, '
'this Euro 6 compliant model offers a spacious interior with '
'seven seats, making it ideal for families. It comes equipped '
'with rear parking sensors for easier manoeuvring, dual '
'automatic air conditioning with an ioniser for a comfortable '
'cabin environment, and automatic headlights for convenience. '
'Enjoy seamless connectivity with Bluetooth for both music '
'streaming and voice recognition.\n'
'\n'
'The Carens CRDi 2 stands out with its low insurance group, '
'suggesting lower running costs. Furthermore, its generous '
'boot space provides ample room for luggage or shopping, a '
'practical advantage over many similar vehicles. This well '
'maintained Kia Carens offers a compelling combination of '
'practicality, comfort, and value.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.7L',
'engine_horse_power': 139,
'fuel_type': 'Diesel',
'id': '6cd87309-3395-5103-b2b8-8a377d381a1b',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512148583133',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'Kia',
'model': 'Carens',
'odometer': 87000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cd87309-3395-5103-b2b8-8a377d381a1b/6cd87309-3395-5103-b2b8-8a377d381a1b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84398,
'Height': 576,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2429e4f61a884dc39098bf20727f69ad.jpg',
'Width': 1024}],
'price': 5499,
'price_includes_vat': True,
'registration_date': '2016-05-06',
'seats_number': 7,
'seller_name': None,
'title': 'KIA Carens 1.7 CRDi 2 DCT Euro 6 (s/s) 5dr',
'transmission': 'automatic',
'trim': '2',
'year': 2016}
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512148583133%27 HTTP/1.1" 200 None
2026-03-25 15:41:54 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512148583133: {'created_time': 1774453314.799757, 'last_price_update_time': 1774453314.79977}
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512148583133') HTTP/1.1" 204 0
2026-03-25 15:41:54 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 688241b1-162a-52cc-b585-954d611d8466 with identifier 202602109819402
2026-03-25 15:41:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:54 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 688241b1-162a-52cc-b585-954d611d8466
2026-03-25 15:41:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/e3df7e1d57454ed9b18f89da5b9edf7e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 55,
'color': 'Green',
'currency': 'GBP',
'description': 'Discover this 2018 MINI Countryman Cooper SE, a distinctive '
'four wheel drive plug in hybrid that offers an engaging '
'driving experience. This Euro 6 compliant model boasts a 1.5 '
'litre petrol engine, seamlessly blending electric and petrol '
"power for efficient journeys. You'll appreciate the "
'convenience of electric seat adjustment with driver memory '
'function, ensuring your perfect driving position is always '
'ready. Navigating tight spaces is made easier with the rear '
'view camera and rear park distance control, while the heated '
'front windscreen and automatic headlights with rain sensor '
'ensure comfort and visibility in all weather conditions.\n'
'\n'
'This MINI Countryman Cooper SE stands out with its '
'intelligent combination of plug in hybrid technology and four '
'wheel drive capability, providing a versatile and economical '
'option for your motoring needs. The inclusion of features '
'like the electric seat adjustment with memory and the rear '
'view camera demonstrates a focus on driver comfort and ease '
'of use, setting it apart from other vehicles in its class. '
'Experience the practical benefits and refined driving '
'dynamics that this well equipped MINI Countryman has to '
'offer.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 221,
'fuel_type': 'Petrol Plug-in Hybrid',
'id': '688241b1-162a-52cc-b585-954d611d8466',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602109819402',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'MINI',
'model': 'Countryman',
'odometer': 101575,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 78,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_688241b1-162a-52cc-b585-954d611d8466/688241b1-162a-52cc-b585-954d611d8466_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 472090,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e3df7e1d57454ed9b18f89da5b9edf7e.jpg',
'Width': 2048}],
'price': 9996,
'price_includes_vat': True,
'registration_date': '2018-07-24',
'seats_number': 5,
'seller_name': None,
'title': 'MINI Countryman 1.5 7.6kWh Cooper SE Auto ALL4 Euro 6 (s/s) 5dr',
'transmission': 'automatic',
'trim': 'Cooper SE',
'year': 2018}
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602109819402%27 HTTP/1.1" 200 None
2026-03-25 15:41:54 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602109819402: {'created_time': 1774453314.84756, 'last_price_update_time': 1774453314.847571}
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602109819402') HTTP/1.1" 204 0
2026-03-25 15:41:54 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 3af310ef-4751-51b3-938e-7cbcc2a96519 with identifier 202512098484194
2026-03-25 15:41:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:54 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 3af310ef-4751-51b3-938e-7cbcc2a96519
2026-03-25 15:41:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/25909c57b69c43549f82ac7d503cdfc7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 147,
'color': 'Silver',
'currency': 'GBP',
'description': 'FULL SERVICE HISTORY -- 2 KEYS --- ALL MAIN DEALER SERVICES '
'LAST SERVICE RECENTLY DONE -- This 2019 Mercedes Benz C Class '
'C200 SE is a prime example of refined motoring. Powered by an '
'efficient 1.5 litre petrol engine, this Euro 6 compliant '
'vehicle offers a smooth and responsive driving experience. '
'The SE trim level ensures a comfortable journey, enhanced by '
'features such as THERMATIC automatic climate control with two '
'zones, allowing both driver and passenger to set their '
'preferred temperatures. For convenience and safety, it '
'includes a reversing camera and Active Parking Assist with '
'front and rear sensors, making manoeuvring in tight spaces '
'effortless.\n'
'\n'
'The C200 SE boasts an impressive acceleration of 0 to 62 '
'miles per hour in just 7.9 seconds, demonstrating its dynamic '
'performance. This capability, combined with the integrated '
'Audio 20 CD system featuring Bluetooth connectivity and '
'heated front seats for added comfort, positions this Mercedes '
'Benz above other vehicles in its class. It represents a well '
'equipped and capable saloon, ready for your next journey.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 195,
'fuel_type': 'Petrol',
'id': '3af310ef-4751-51b3-938e-7cbcc2a96519',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512098484194',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'Mercedes-Benz',
'model': 'C Class',
'odometer': 97450,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 70,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3af310ef-4751-51b3-938e-7cbcc2a96519/3af310ef-4751-51b3-938e-7cbcc2a96519_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101630,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/25909c57b69c43549f82ac7d503cdfc7.jpg',
'Width': 800}],
'price': 9997,
'price_includes_vat': True,
'registration_date': '2019-10-18',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz C Class 1.5 C200 MHEV EQ Boost SE G-Tronic+ Euro 6 '
'(s/s) 5dr',
'transmission': 'automatic',
'trim': 'SE',
'year': 2019}
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512098484194%27 HTTP/1.1" 200 None
2026-03-25 15:41:54 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512098484194: {'created_time': 1774453314.900615, 'last_price_update_time': 1774453314.900622}
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512098484194') HTTP/1.1" 204 0
2026-03-25 15:41:54 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 3446dce4-5bc9-58d3-bc51-8fd76ca0d528 with identifier 202508195571167
2026-03-25 15:41:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:54 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 3446dce4-5bc9-58d3-bc51-8fd76ca0d528
2026-03-25 15:41:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/69ede0fa6692468fa3178d540db93dd6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 136,
'color': 'White',
'currency': 'GBP',
'description': 'Discover this 2017 Vauxhall Insignia i Turbo SRi Nav, a well '
'presented example ready for its next owner. This model is '
'equipped with a responsive 1.5 litre petrol engine, meeting '
"Euro 6 emissions standards. Inside, you'll find the SRi Nav "
'trim, enhanced by the Sight and Light Pack which includes '
'automatic headlights for your convenience. The Navi 900 '
'IntelliLink system offers a touchscreen navigation and '
'infotainment experience, complete with Android Auto, Apple '
'CarPlay, and Bluetooth connectivity. Further comfort is '
'provided by Electronic Climate Control with air conditioning, '
'and the Driving Assistance Pack One adds a front camera for '
'parking assistance.\n'
'\n'
'This Vauxhall Insignia boasts impressive performance, '
'accelerating from 0 to 60 miles per hour in just 8.4 seconds, '
'demonstrating its capability. The large boot space offers '
'ample room for luggage or shopping, making it a practical '
'choice for families or those who need extra capacity. The '
'automatic lighting control with tunnel detection further '
'enhances the driving experience by automatically activating '
'the headlights when needed, indicating a thoughtful level of '
'specification that sets it apart.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 163,
'fuel_type': 'Petrol',
'id': '3446dce4-5bc9-58d3-bc51-8fd76ca0d528',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202508195571167',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'Vauxhall',
'model': 'Insignia',
'odometer': 95000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 69,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3446dce4-5bc9-58d3-bc51-8fd76ca0d528/3446dce4-5bc9-58d3-bc51-8fd76ca0d528_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76539,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/69ede0fa6692468fa3178d540db93dd6.jpg',
'Width': 800}],
'price': 5499,
'price_includes_vat': True,
'registration_date': '2017-09-27',
'seats_number': 5,
'seller_name': None,
'title': 'Vauxhall Insignia 1.5i Turbo SRi Nav Grand Sport Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'SRi Nav',
'year': 2017}
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508195571167%27 HTTP/1.1" 200 None
2026-03-25 15:41:54 [auto_selling_autotrader.co.uk] INFO: Saving data for 202508195571167: {'created_time': 1774453314.944558, 'last_price_update_time': 1774453314.944566}
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202508195571167') HTTP/1.1" 204 0
2026-03-25 15:41:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/45e240a5dca14006aa672f43f5f61456.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:54 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 15:41:54 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 48a11db5-5dfd-5aec-b099-bc0a0c9f1fb3 with identifier: 202303315831269
2026-03-25 15:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 48a11db5-5dfd-5aec-b099-bc0a0c9f1fb3
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9cdc14d5b485421eb500b2b707911a4f.jpg%27 HTTP/1.1" 200 None
2026-03-25 15:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9cdc14d5b485421eb500b2b707911a4f.jpg not downloaded yet
2026-03-25 15:41:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/62774135fdde41e6b44884b9c958ad54.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/aee3b2762b7a4834b55590d20f70c524.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/afeaea30f03c4b87b7909d70959d1955.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/3a34f1d6d3da472db914cabdd5e25a5f.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/589a30da50e14cc1be7d7bfa74054a23.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/8630099bfa934faabc60799e293919f3.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f229d32fb50>
2026-03-25 15:41:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5776bf1a-f2e2-505b-be22-07ce67cfd7d5/5776bf1a-f2e2-505b-be22-07ce67cfd7d5_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F77e1dcc0a6094b1992c3f72adb69fd00.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/77e1dcc0a6094b1992c3f72adb69fd00.jpg saved to cache
2026-03-25 15:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5776bf1a-f2e2-505b-be22-07ce67cfd7d5
2026-03-25 15:41:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5776bf1a-f2e2-505b-be22-07ce67cfd7d5 sending to next pipeline
2026-03-25 15:41:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f229d334f10>
2026-03-25 15:41:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a8133ed-48f5-546e-a0a4-26b381b61c7f/2a8133ed-48f5-546e-a0a4-26b381b61c7f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0608347df3db4f728b674a99e38d414b.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0608347df3db4f728b674a99e38d414b.jpg saved to cache
2026-03-25 15:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2a8133ed-48f5-546e-a0a4-26b381b61c7f
2026-03-25 15:41:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2a8133ed-48f5-546e-a0a4-26b381b61c7f sending to next pipeline
2026-03-25 15:41:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f229dc301d0>
2026-03-25 15:41:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40b0d438-1ef0-5178-b37d-137ef72b21df/40b0d438-1ef0-5178-b37d-137ef72b21df_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F79e6d35e6010422da3e8cf238e444ede.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/79e6d35e6010422da3e8cf238e444ede.jpg saved to cache
2026-03-25 15:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 40b0d438-1ef0-5178-b37d-137ef72b21df
2026-03-25 15:41:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 40b0d438-1ef0-5178-b37d-137ef72b21df sending to next pipeline
2026-03-25 15:41:55 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 5776bf1a-f2e2-505b-be22-07ce67cfd7d5 with identifier 202511298234017
2026-03-25 15:41:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:55 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 5776bf1a-f2e2-505b-be22-07ce67cfd7d5
2026-03-25 15:41:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/77e1dcc0a6094b1992c3f72adb69fd00.jpg>
{'auction_title': '',
'c_o_2_emission_value': 231,
'color': 'Bronze',
'currency': 'GBP',
'description': 'This 2016 BMW M5 V8 offers a remarkable blend of performance '
'and luxury, boasting a powerful 4.4L petrol engine that '
'delivers exhilarating acceleration, reaching 0-62mph in just '
'4.3 seconds. As a Euro 6 compliant vehicle, it meets '
"stringent emission standards. Inside, you'll find "
'sophisticated touches like BMW Individual Piano Black '
'interior trim and front heated seats for enhanced comfort. '
'The convenience of a reversing assist camera, integrated with '
'parking assistance, makes manoeuvring effortless.\n'
'\n'
'Further enhancing the driving experience are the striking '
'20in Light M Double Spoke Style 343M alloy wheels, adding to '
"the car's assertive presence. The Head Up Display projects "
'vital information directly into your line of sight, allowing '
'you to keep your focus on the road. This M5 also provides '
'ample practicality with its large boot space, making it '
'suitable for both spirited drives and everyday use. These '
'features collectively demonstrate the superior engineering '
'and thoughtful design that set this BMW M5 apart.',
'doors_number': 4,
'emission_standard': 'Euro 6',
'engine': '4.4L',
'engine_horse_power': 552,
'fuel_type': 'Petrol',
'id': '5776bf1a-f2e2-505b-be22-07ce67cfd7d5',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511298234017',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'BMW',
'model': 'M5',
'odometer': 86500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 75,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5776bf1a-f2e2-505b-be22-07ce67cfd7d5/5776bf1a-f2e2-505b-be22-07ce67cfd7d5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88356,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/77e1dcc0a6094b1992c3f72adb69fd00.jpg',
'Width': 800}],
'price': 17999,
'price_includes_vat': True,
'registration_date': '2016-02-22',
'seats_number': 5,
'seller_name': None,
'title': 'BMW M5 4.4 V8 DCT Euro 6 (s/s) 4dr',
'transmission': 'automatic',
'year': 2015}
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511298234017%27 HTTP/1.1" 200 None
2026-03-25 15:41:55 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511298234017: {'created_time': 1774453315.158363, 'last_price_update_time': 1774453315.158372}
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511298234017') HTTP/1.1" 204 0
2026-03-25 15:41:55 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2a8133ed-48f5-546e-a0a4-26b381b61c7f with identifier 202507144470779
2026-03-25 15:41:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:55 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2a8133ed-48f5-546e-a0a4-26b381b61c7f
2026-03-25 15:41:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/0608347df3db4f728b674a99e38d414b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 171,
'color': 'Green',
'currency': 'GBP',
'description': 'With only 52000 miles on the clock, this 2017 Land Rover '
'Discovery SD4 HSE is a rare find. As a Euro 6 compliant '
'vehicle, this Discovery is powered by a 2.0L diesel engine '
'with a four-wheel drive drivetrain. The HSE trim adds a touch '
'of luxury and convenience, with features like heated front '
'and rear seats and 2-zone automatic climate control. The '
'vehicle also includes keyless entry, rear parking aid with '
'visual display, and blind spot assist with reverse traffic '
'detection.\n'
'\n'
'The Land Rover Discovery is a versatile vehicle with seven '
'seats, making it ideal for families or those who need extra '
'passenger space. It also boasts a towing weight of 3500 kg. '
'The acceleration of 0-60mph in 8.0 seconds demonstrates that '
'this vehicle offers a blend of performance and practicality '
'that sets it apart from its competitors.This vehicle has an '
'outstanding recall',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 237,
'fuel_type': 'Diesel',
'id': '2a8133ed-48f5-546e-a0a4-26b381b61c7f',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202507144470779',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'Land Rover',
'model': 'Discovery',
'odometer': 52000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 70,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a8133ed-48f5-546e-a0a4-26b381b61c7f/2a8133ed-48f5-546e-a0a4-26b381b61c7f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97042,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0608347df3db4f728b674a99e38d414b.jpg',
'Width': 800}],
'price': 18550,
'price_includes_vat': True,
'registration_date': '2017-09-08',
'seats_number': 7,
'seller_name': None,
'title': 'Land Rover Discovery 2.0 SD4 HSE Auto 4WD Euro 6 (s/s) 5dr',
'transmission': 'automatic',
'trim': 'HSE',
'year': 2017}
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202507144470779%27 HTTP/1.1" 200 None
2026-03-25 15:41:55 [auto_selling_autotrader.co.uk] INFO: Saving data for 202507144470779: {'created_time': 1774453315.216078, 'last_price_update_time': 1774453315.216088}
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202507144470779') HTTP/1.1" 204 0
2026-03-25 15:41:55 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 40b0d438-1ef0-5178-b37d-137ef72b21df with identifier 202601269425075
2026-03-25 15:41:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:55 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 40b0d438-1ef0-5178-b37d-137ef72b21df
2026-03-25 15:41:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/79e6d35e6010422da3e8cf238e444ede.jpg>
{'auction_title': '',
'c_o_2_emission_value': 141,
'color': 'White',
'currency': 'GBP',
'description': 'This 2017 Skoda Kodiaq TSI SE offers exceptional value, '
'boasting a fuel economy of 46 miles per gallon. This Euro 6 '
'compliant 1.4 litre petrol engine is housed within a '
'versatile 7 seat SUV, making it an ideal choice for families '
'or those needing extra space. The SE trim level comes '
'equipped with practical features such as rear parking sensors '
'for easier manoeuvring, and light and rain sensors that '
'automatically adjust headlights and wipers. Stay connected on '
'the go with the integrated Bluetooth system, and enjoy '
'consistent comfort thanks to the dual zone climate control, '
'complete with a humidity sensor.\n'
'\n'
'The Skoda Kodiaq TSI SE stands out with its low insurance '
'group, making it an economical choice for many drivers. This, '
'combined with its impressive 46 mpg fuel economy, '
'demonstrates its efficiency compared to other vehicles in its '
'class. The inclusion of automatic headlights further enhances '
'its practicality and safety, ensuring you are always prepared '
'for changing driving conditions. This Kodiaq is a well '
'rounded and sensible option for those seeking a spacious and '
'feature rich SUV.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.4L',
'engine_horse_power': 123,
'fuel_type': 'Petrol',
'id': '40b0d438-1ef0-5178-b37d-137ef72b21df',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601269425075',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'Skoda',
'model': 'Kodiaq',
'odometer': 109450,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 64,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40b0d438-1ef0-5178-b37d-137ef72b21df/40b0d438-1ef0-5178-b37d-137ef72b21df_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84780,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/79e6d35e6010422da3e8cf238e444ede.jpg',
'Width': 800}],
'price': 8899,
'price_includes_vat': True,
'registration_date': '2017-11-30',
'seats_number': 7,
'seller_name': None,
'title': 'SKODA Kodiaq 1.4 TSI SE Euro 6 (s/s) 5dr (7 Seat)',
'transmission': 'manual',
'trim': 'SE',
'year': 2017}
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601269425075%27 HTTP/1.1" 200 None
2026-03-25 15:41:55 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601269425075: {'created_time': 1774453315.28502, 'last_price_update_time': 1774453315.285031}
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601269425075') HTTP/1.1" 204 0
2026-03-25 15:41:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/3eac66c6f4ab485c8e144fd54e2e0e8e.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/2ab4c747b86c4193b0b1d4bfc030ea34.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22a1da8310>
2026-03-25 15:41:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4055890d-8f97-5d56-89b0-d480aa62c5a9/4055890d-8f97-5d56-89b0-d480aa62c5a9_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F45e240a5dca14006aa672f43f5f61456.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/45e240a5dca14006aa672f43f5f61456.jpg saved to cache
2026-03-25 15:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4055890d-8f97-5d56-89b0-d480aa62c5a9
2026-03-25 15:41:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4055890d-8f97-5d56-89b0-d480aa62c5a9 sending to next pipeline
2026-03-25 15:41:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f229c5603d0>
2026-03-25 15:41:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d87ba0e0-f39c-512c-ba5d-6e6e8fac17cb/d87ba0e0-f39c-512c-ba5d-6e6e8fac17cb_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F62774135fdde41e6b44884b9c958ad54.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/62774135fdde41e6b44884b9c958ad54.jpg saved to cache
2026-03-25 15:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d87ba0e0-f39c-512c-ba5d-6e6e8fac17cb
2026-03-25 15:41:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d87ba0e0-f39c-512c-ba5d-6e6e8fac17cb sending to next pipeline
2026-03-25 15:41:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f229dc16d50>
2026-03-25 15:41:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e58e3540-d472-5eb4-94fa-f36b079e6a21/e58e3540-d472-5eb4-94fa-f36b079e6a21_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Faee3b2762b7a4834b55590d20f70c524.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/aee3b2762b7a4834b55590d20f70c524.jpg saved to cache
2026-03-25 15:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e58e3540-d472-5eb4-94fa-f36b079e6a21
2026-03-25 15:41:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e58e3540-d472-5eb4-94fa-f36b079e6a21 sending to next pipeline
2026-03-25 15:41:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f229c5618d0>
2026-03-25 15:41:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d01ee19-2656-54c0-9c76-7ab312b8ffb0/7d01ee19-2656-54c0-9c76-7ab312b8ffb0_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fafeaea30f03c4b87b7909d70959d1955.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/afeaea30f03c4b87b7909d70959d1955.jpg saved to cache
2026-03-25 15:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7d01ee19-2656-54c0-9c76-7ab312b8ffb0
2026-03-25 15:41:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7d01ee19-2656-54c0-9c76-7ab312b8ffb0 sending to next pipeline
2026-03-25 15:41:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f229c7bc210>
2026-03-25 15:41:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a750923-4970-55a0-8b8e-73e3cc0d02a4/6a750923-4970-55a0-8b8e-73e3cc0d02a4_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3a34f1d6d3da472db914cabdd5e25a5f.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3a34f1d6d3da472db914cabdd5e25a5f.jpg saved to cache
2026-03-25 15:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6a750923-4970-55a0-8b8e-73e3cc0d02a4
2026-03-25 15:41:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6a750923-4970-55a0-8b8e-73e3cc0d02a4 sending to next pipeline
2026-03-25 15:41:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f229dc23350>
2026-03-25 15:41:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f5a0adb-8c65-5baf-b1b9-a935f33a0a8e/7f5a0adb-8c65-5baf-b1b9-a935f33a0a8e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F589a30da50e14cc1be7d7bfa74054a23.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/589a30da50e14cc1be7d7bfa74054a23.jpg saved to cache
2026-03-25 15:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7f5a0adb-8c65-5baf-b1b9-a935f33a0a8e
2026-03-25 15:41:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7f5a0adb-8c65-5baf-b1b9-a935f33a0a8e sending to next pipeline
2026-03-25 15:41:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f229dc62650>
2026-03-25 15:41:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_496bd355-5f1d-5132-bea7-c38b3c1088e3/496bd355-5f1d-5132-bea7-c38b3c1088e3_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8630099bfa934faabc60799e293919f3.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8630099bfa934faabc60799e293919f3.jpg saved to cache
2026-03-25 15:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 496bd355-5f1d-5132-bea7-c38b3c1088e3
2026-03-25 15:41:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 496bd355-5f1d-5132-bea7-c38b3c1088e3 sending to next pipeline
2026-03-25 15:41:55 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 4055890d-8f97-5d56-89b0-d480aa62c5a9 with identifier 202601299513378
2026-03-25 15:41:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:55 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 4055890d-8f97-5d56-89b0-d480aa62c5a9
2026-03-25 15:41:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/45e240a5dca14006aa672f43f5f61456.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'Blue',
'currency': 'GBP',
'description': 'This 2017 Tesla Model X 75D offers an impressive electric '
'driving experience with its Four Wheel Drive system and a '
'substantial 75 kWh battery, providing a maximum range of 259 '
'miles when new. Charging at home on a 7kW charger takes '
'approximately 12 hours, while rapid public charging can '
'replenish the battery from empty to 80% in just 45 minutes. '
'This electric SUV also boasts a generous towing weight of '
"2268 kg. Inside, you'll find comfort and convenience with "
'Dual Zone Climate Control, Keyless Entry, and a striking '
'Glass Roof. The Premium Upgrade Package adds heated seats and '
'a heated steering wheel, complemented by automatic LED '
'headlights.\n'
'\n'
'The Tesla Model X 75D stands out with its remarkable '
'acceleration, achieving 0-60mph in a swift 6.0 seconds, '
'demonstrating its performance capabilities. This electric '
'vehicle also offers a large boot space, making it practical '
'for everyday use and longer journeys. These features '
'collectively highlight how this Model X provides a superior '
'and more engaging driving experience compared to other '
'vehicles in its class.',
'doors_number': 5,
'engine_horse_power': 328,
'fuel_type': 'Electric',
'id': '4055890d-8f97-5d56-89b0-d480aa62c5a9',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601299513378',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'Tesla',
'model': 'Model X',
'odometer': 117000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 64,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4055890d-8f97-5d56-89b0-d480aa62c5a9/4055890d-8f97-5d56-89b0-d480aa62c5a9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 403835,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/45e240a5dca14006aa672f43f5f61456.jpg',
'Width': 2048}],
'price': 15499,
'price_includes_vat': True,
'registration_date': '2017-10-30',
'seats_number': 5,
'seller_name': None,
'title': 'Tesla Model X 75D (Dual Motor) Auto 4WDE 5dr',
'transmission': 'automatic',
'year': 2017}
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601299513378%27 HTTP/1.1" 200 None
2026-03-25 15:41:55 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601299513378: {'created_time': 1774453315.747722, 'last_price_update_time': 1774453315.747735}
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601299513378') HTTP/1.1" 204 0
2026-03-25 15:41:55 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d87ba0e0-f39c-512c-ba5d-6e6e8fac17cb with identifier 202411276782159
2026-03-25 15:41:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:55 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d87ba0e0-f39c-512c-ba5d-6e6e8fac17cb
2026-03-25 15:41:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/62774135fdde41e6b44884b9c958ad54.jpg>
{'auction_title': '',
'c_o_2_emission_value': 109,
'color': 'Blue',
'currency': 'GBP',
'description': 'PRESENTING THIS BEAUTIFUL LOOKING VAUXHALL ASTRA SRI VX LINE '
'NAV—ULEZ COMPLIANT—FULL MAIN DEALER SERVICE HISTORY AND COMES '
'WITH 2 KEYS—AUTOMATIC—ONLY 1 OWNER FROM NEW',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 120,
'fuel_type': 'Diesel',
'id': 'd87ba0e0-f39c-512c-ba5d-6e6e8fac17cb',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202411276782159',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'Vauxhall',
'model': 'Astra',
'odometer': 51900,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 70,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d87ba0e0-f39c-512c-ba5d-6e6e8fac17cb/d87ba0e0-f39c-512c-ba5d-6e6e8fac17cb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81097,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/62774135fdde41e6b44884b9c958ad54.jpg',
'Width': 800}],
'price': 9999,
'price_includes_vat': True,
'registration_date': '2020-03-31',
'seats_number': 5,
'seller_name': None,
'title': 'Vauxhall Astra 1.5 Turbo D SRi VX Line Nav Auto Euro 6 (s/s) 5dr',
'transmission': 'automatic',
'trim': 'SRi VX Line Nav',
'year': 2020}
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202411276782159%27 HTTP/1.1" 200 None
2026-03-25 15:41:55 [auto_selling_autotrader.co.uk] INFO: Saving data for 202411276782159: {'created_time': 1774453315.799361, 'last_price_update_time': 1774453315.79937}
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202411276782159') HTTP/1.1" 204 0
2026-03-25 15:41:55 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e58e3540-d472-5eb4-94fa-f36b079e6a21 with identifier 202511268148295
2026-03-25 15:41:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:55 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e58e3540-d472-5eb4-94fa-f36b079e6a21
2026-03-25 15:41:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/aee3b2762b7a4834b55590d20f70c524.jpg>
{'auction_title': '',
'c_o_2_emission_value': 121,
'color': 'Grey',
'currency': 'GBP',
'description': 'FULL SERVICE HISTORY -- ULEZ COMPLAINT --- HPI CLEAR --- '
'DRIVES VERY GOOD ---This 2015 Audi A6 Avant TDI Black Edition '
'offers an exceptional blend of style and practicality, '
'boasting a remarkable 61 miles per gallon. As a Euro 6 '
'compliant vehicle, it features a 2.0 litre diesel engine, '
'ensuring efficient performance. The Black Edition trim '
'enhances its sophisticated appearance, while the spacious '
"boot provides ample room for all your needs. Inside, you'll "
'find the comfort of Electronic Deluxe 4 Zone Climate Control, '
'ensuring a pleasant environment for all occupants. Parking is '
'made effortless with Audi Parking System Plus, including both '
'front and rear sensors, and the BOSE Surround Sound System '
'delivers an immersive audio experience. Connectivity is also '
'seamless thanks to the Bluetooth interface for mobile '
'telephone preparation.\n'
'\n'
'This Audi A6 Avant stands out with its impressive '
'acceleration, reaching 0 to 62 miles per hour in just 8.5 '
'seconds, demonstrating its dynamic capabilities. The '
'combination of its fuel economy, acceleration, and generous '
'boot space highlights how this vehicle offers a superior '
'driving experience compared to others in its class, providing '
'both efficiency and performance without compromising on '
'utility.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 187,
'fuel_type': 'Diesel',
'id': 'e58e3540-d472-5eb4-94fa-f36b079e6a21',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511268148295',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'Audi',
'model': 'A6 Avant',
'odometer': 108000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 76,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e58e3540-d472-5eb4-94fa-f36b079e6a21/e58e3540-d472-5eb4-94fa-f36b079e6a21_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89147,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/aee3b2762b7a4834b55590d20f70c524.jpg',
'Width': 800}],
'price': 9795,
'price_includes_vat': True,
'registration_date': '2015-07-24',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A6 Avant 2.0 TDI ultra Black Edition Estate 5dr Diesel S '
'Tronic Euro 6 (s/s) (190 ps)',
'transmission': 'automatic',
'trim': 'Black Edition',
'year': 2015}
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511268148295%27 HTTP/1.1" 200 None
2026-03-25 15:41:55 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511268148295: {'created_time': 1774453315.844232, 'last_price_update_time': 1774453315.844241}
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511268148295') HTTP/1.1" 204 0
2026-03-25 15:41:55 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7d01ee19-2656-54c0-9c76-7ab312b8ffb0 with identifier 202511077744697
2026-03-25 15:41:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:55 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7d01ee19-2656-54c0-9c76-7ab312b8ffb0
2026-03-25 15:41:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/afeaea30f03c4b87b7909d70959d1955.jpg>
{'auction_title': '',
'c_o_2_emission_value': 109,
'color': 'White',
'currency': 'GBP',
'description': 'This 2016 Mercedes Benz C Class C220d AMG Line is a prime '
'example of refined motoring, boasting a 2.1L Euro 6 diesel '
'engine. As an AMG Line trim, it offers a sporty aesthetic and '
'feel, complemented by desirable features such as front and '
'rear parking sensors, a reversing camera for effortless '
'manoeuvring, and a Bluetooth interface for seamless hands '
'free calls. Inside, you will appreciate the comfort of heated '
'front seats, making every journey a pleasure.\n'
'\n'
'This C Class stands out with its impressive fuel economy of '
'61 mpg, indicating it is more economical than many similar '
'vehicles. Its Euro 6 compliant engine also means it has low '
'CO2 emissions, which is better for the environment. '
'Furthermore, the generous boot space provides ample room for '
'luggage or shopping, and its position in a low insurance '
'group makes it an affordable choice to own and run.',
'doors_number': 2,
'emission_standard': 'Euro 6',
'engine': '2.1L',
'engine_horse_power': 168,
'fuel_type': 'Diesel',
'id': '7d01ee19-2656-54c0-9c76-7ab312b8ffb0',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511077744697',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'Mercedes-Benz',
'model': 'C Class',
'odometer': 121011,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 60,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d01ee19-2656-54c0-9c76-7ab312b8ffb0/7d01ee19-2656-54c0-9c76-7ab312b8ffb0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82959,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/afeaea30f03c4b87b7909d70959d1955.jpg',
'Width': 800}],
'price': 9499,
'price_includes_vat': True,
'registration_date': '2016-03-21',
'seats_number': 4,
'seller_name': None,
'title': 'Mercedes-Benz C Class 2.1 C220d AMG Line G-Tronic+ Euro 6 (s/s) 2dr',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2016}
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511077744697%27 HTTP/1.1" 200 None
2026-03-25 15:41:55 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511077744697: {'created_time': 1774453315.886389, 'last_price_update_time': 1774453315.886397}
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511077744697') HTTP/1.1" 204 0
2026-03-25 15:41:55 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 6a750923-4970-55a0-8b8e-73e3cc0d02a4 with identifier 202409023553014
2026-03-25 15:41:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:55 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 6a750923-4970-55a0-8b8e-73e3cc0d02a4
2026-03-25 15:41:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/3a34f1d6d3da472db914cabdd5e25a5f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 154,
'color': 'Blue',
'currency': 'GBP',
'description': 'With only one previous owner, this 2021 SEAT Ateca 1.5L TSI '
'EVO SE Technology is a great example of this popular model. '
'The SE Technology trim adds a touch of sophistication to this '
'practical SUV, which complies with Euro 6 emission standards. '
'Enjoy the convenience of KESSY keyless entry and go, along '
'with the ease of wireless phone charging. The full LED '
'headlights provide excellent visibility, and dual-zone '
'climate control ensures a comfortable environment for both '
'driver and passengers. Parking is made simple with park '
'assist, including front and rear parking sensors. The vehicle '
'has undergone a thorough history check, providing additional '
'peace of mind.\n'
'\n'
'The SEAT Ateca stands out with its large boot space, offering '
'ample room for luggage, shopping, or family essentials. The '
'responsive 1.5L petrol engine delivers a satisfying driving '
'experience, accelerating from 0-62mph in just 8.6 seconds. '
'This combination of practicality and performance makes the '
'Ateca a compelling choice in its class.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 148,
'fuel_type': 'Petrol',
'id': '6a750923-4970-55a0-8b8e-73e3cc0d02a4',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202409023553014',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'SEAT',
'model': 'Ateca',
'odometer': 78440,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 81,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a750923-4970-55a0-8b8e-73e3cc0d02a4/6a750923-4970-55a0-8b8e-73e3cc0d02a4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88222,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3a34f1d6d3da472db914cabdd5e25a5f.jpg',
'Width': 800}],
'price': 11999,
'price_includes_vat': True,
'registration_date': '2021-01-13',
'seats_number': 5,
'seller_name': None,
'title': 'SEAT Ateca 1.5 TSI EVO SE Technology DSG Euro 6 (s/s) 5dr',
'transmission': 'automatic',
'trim': 'SE Technology',
'year': 2021}
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202409023553014%27 HTTP/1.1" 200 None
2026-03-25 15:41:55 [auto_selling_autotrader.co.uk] INFO: Saving data for 202409023553014: {'created_time': 1774453315.92907, 'last_price_update_time': 1774453315.929081}
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202409023553014') HTTP/1.1" 204 0
2026-03-25 15:41:55 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7f5a0adb-8c65-5baf-b1b9-a935f33a0a8e with identifier 202511238085298
2026-03-25 15:41:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:55 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7f5a0adb-8c65-5baf-b1b9-a935f33a0a8e
2026-03-25 15:41:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/589a30da50e14cc1be7d7bfa74054a23.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'color': 'Grey',
'currency': 'GBP',
'description': 'Discover this 2009 BMW 1 Series 116d Sport, a well presented '
'example of this popular hatchback. This particular model '
'benefits from a 2.0L diesel engine and a Sport trim, offering '
'a balanced driving experience. Inside, you will find manual '
'air conditioning to keep you comfortable in all conditions.\n'
'\n'
'This BMW 1 Series stands out with its impressive fuel '
'economy, achieving a remarkable 64 miles per gallon, which '
'indicates it is more economical than many other vehicles in '
'its class. Furthermore, it boasts low CO2 emissions, '
'contributing to a more environmentally friendly drive. '
'Practicality is also a strong point, with generous boot space '
'making it ideal for everyday use and longer journeys.This '
'vehicle has an outstanding recall',
'doors_number': 3,
'emission_standard': 'Euro 4',
'engine': '2L',
'engine_horse_power': 114,
'fuel_type': 'Diesel',
'id': '7f5a0adb-8c65-5baf-b1b9-a935f33a0a8e',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511238085298',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'BMW',
'model': '1 Series',
'odometer': 126232,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 38,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5a0adb-8c65-5baf-b1b9-a935f33a0a8e/7f5a0adb-8c65-5baf-b1b9-a935f33a0a8e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76690,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/589a30da50e14cc1be7d7bfa74054a23.jpg',
'Width': 800}],
'price': 1999,
'price_includes_vat': True,
'registration_date': '2009-09-30',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1 Series 2.0 116d Sport Euro 4 3dr',
'transmission': 'manual',
'trim': 'Sport',
'year': 2009}
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511238085298%27 HTTP/1.1" 200 None
2026-03-25 15:41:55 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511238085298: {'created_time': 1774453315.976123, 'last_price_update_time': 1774453315.976132}
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511238085298') HTTP/1.1" 204 0
2026-03-25 15:41:55 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 496bd355-5f1d-5132-bea7-c38b3c1088e3 with identifier 202601279456168
2026-03-25 15:41:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:56 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 496bd355-5f1d-5132-bea7-c38b3c1088e3
2026-03-25 15:41:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/8630099bfa934faabc60799e293919f3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 114,
'color': 'Blue',
'currency': 'GBP',
'description': 'FULL DEALSHIP HISTORY--GEAR BOX OIL SERVICE DONE ON '
'91482MILES--This 2018 Volkswagen Passat TDI SE Business is a '
'superb example of a well maintained vehicle. It features a '
'powerful yet efficient 2.0 litre diesel engine, meeting Euro '
'6 emission standards. This SE Business trim level comes '
'equipped with a useful Winter Pack, including heated seats '
'for those colder journeys, and advanced LED headlights that '
'automatically activate thanks to the dusk sensor. For added '
'convenience on longer drives, it boasts adaptive cruise '
'control, and the Composition Media System with Bluetooth '
'connectivity keeps you entertained and connected.\n'
'\n'
'This Passat offers several advantages over other vehicles in '
'its class. Its large boot space makes it incredibly practical '
'for families or those who need to carry extra luggage. '
'Furthermore, its low CO2 emissions contribute to a more '
'environmentally friendly drive, and it sits in a low '
'insurance group, which can help to reduce your running costs.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 148,
'fuel_type': 'Diesel',
'id': '496bd355-5f1d-5132-bea7-c38b3c1088e3',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601279456168',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 130500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 65,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_496bd355-5f1d-5132-bea7-c38b3c1088e3/496bd355-5f1d-5132-bea7-c38b3c1088e3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 460512,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8630099bfa934faabc60799e293919f3.jpg',
'Width': 2048}],
'price': 7399,
'price_includes_vat': True,
'registration_date': '2018-03-26',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI SE Business DSG Euro 6 (s/s) 5dr',
'transmission': 'automatic',
'trim': 'SE Business',
'year': 2018}
2026-03-25 15:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601279456168%27 HTTP/1.1" 200 None
2026-03-25 15:41:56 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601279456168: {'created_time': 1774453316.023184, 'last_price_update_time': 1774453316.023199}
2026-03-25 15:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601279456168') HTTP/1.1" 204 0
2026-03-25 15:41:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22a11bec50>
2026-03-25 15:41:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1e5432a-1537-53b8-b548-dfaf885aba7f/e1e5432a-1537-53b8-b548-dfaf885aba7f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3eac66c6f4ab485c8e144fd54e2e0e8e.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3eac66c6f4ab485c8e144fd54e2e0e8e.jpg saved to cache
2026-03-25 15:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e1e5432a-1537-53b8-b548-dfaf885aba7f
2026-03-25 15:41:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e1e5432a-1537-53b8-b548-dfaf885aba7f sending to next pipeline
2026-03-25 15:41:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f229ca4fb50>
2026-03-25 15:41:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eda6ed21-0d38-596c-80d7-da7b780fdad0/eda6ed21-0d38-596c-80d7-da7b780fdad0_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2ab4c747b86c4193b0b1d4bfc030ea34.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2ab4c747b86c4193b0b1d4bfc030ea34.jpg saved to cache
2026-03-25 15:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eda6ed21-0d38-596c-80d7-da7b780fdad0
2026-03-25 15:41:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eda6ed21-0d38-596c-80d7-da7b780fdad0 sending to next pipeline
2026-03-25 15:41:56 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e1e5432a-1537-53b8-b548-dfaf885aba7f with identifier 202410295719460
2026-03-25 15:41:56 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:56 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:56 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e1e5432a-1537-53b8-b548-dfaf885aba7f
2026-03-25 15:41:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/3eac66c6f4ab485c8e144fd54e2e0e8e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'Black',
'currency': 'GBP',
'description': '1 OWNER FROM NEW -- FULL SERVICE HISTORY --- 2 KEYS --- HPI '
'CLEAR WITH REPORT SUPPLIED ---',
'doors_number': 5,
'engine_horse_power': 141,
'fuel_type': 'Electric',
'id': 'e1e5432a-1537-53b8-b548-dfaf885aba7f',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202410295719460',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'MG',
'model': 'MG ZS',
'odometer': 43300,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 70,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1e5432a-1537-53b8-b548-dfaf885aba7f/e1e5432a-1537-53b8-b548-dfaf885aba7f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341430,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3eac66c6f4ab485c8e144fd54e2e0e8e.jpg',
'Width': 2048}],
'price': 8999,
'price_includes_vat': True,
'registration_date': '2021-10-11',
'seats_number': 5,
'seller_name': None,
'title': 'MG MG Zs 44.5kWh Excite Auto 5dr',
'transmission': 'automatic',
'trim': 'Excite',
'year': 2021}
2026-03-25 15:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202410295719460%27 HTTP/1.1" 200 None
2026-03-25 15:41:56 [auto_selling_autotrader.co.uk] INFO: Saving data for 202410295719460: {'created_time': 1774453316.206153, 'last_price_update_time': 1774453316.206163}
2026-03-25 15:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202410295719460') HTTP/1.1" 204 0
2026-03-25 15:41:56 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: eda6ed21-0d38-596c-80d7-da7b780fdad0 with identifier 202402236873414
2026-03-25 15:41:56 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:56 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:56 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item eda6ed21-0d38-596c-80d7-da7b780fdad0
2026-03-25 15:41:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/2ab4c747b86c4193b0b1d4bfc030ea34.jpg>
{'auction_title': '',
'c_o_2_emission_value': 123,
'color': 'Grey',
'currency': 'GBP',
'description': 'Presenting Volkswagen Golf 1.4 TSI BlueMotion—-A GOOD LOOKING '
'ESTATE WITH ROOF RACKS FITTED—ULEZ COMPLIANT—ONLY 1 OWNER '
'FROM NEW—-SERVICE HISTORY FROM VW—-DRIVES VERY GOOD—PACKED '
'WITH LOADS OF FEATURES—FRONT AND BACK PARKING '
'SENSORS—-NAVIGATION—CRUISE CONTROL—FRONT BOTH HEATED SEATS '
'AND MORE—For your peace of mind all of our cars undergo a '
'brief inspection and are prepared to full extent--Free '
'12MONTHS roadside recovery. You are in safe Hands as we have '
'signed our dealer promise with AA. Delivery on Your Doorstep, '
'Credit & Debit Cards Accepted. Part exchange your car any age '
'any mileage. For information please contact us we are looking '
'forward to hear from you--GIVE US A CALL AND BOOK YOUR TEST '
'DRIVE TOADY SO YOU DONT MISS OUT',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.4L',
'engine_horse_power': 123,
'fuel_type': 'Petrol',
'id': 'eda6ed21-0d38-596c-80d7-da7b780fdad0',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202402236873414',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'Volkswagen',
'model': 'Golf',
'odometer': 128200,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 87,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eda6ed21-0d38-596c-80d7-da7b780fdad0/eda6ed21-0d38-596c-80d7-da7b780fdad0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101445,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2ab4c747b86c4193b0b1d4bfc030ea34.jpg',
'Width': 800}],
'price': 4999,
'price_includes_vat': True,
'registration_date': '2017-05-05',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf 1.4 TSI BlueMotion Tech SE Nav Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'SE Nav',
'year': 2017}
2026-03-25 15:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202402236873414%27 HTTP/1.1" 200 None
2026-03-25 15:41:56 [auto_selling_autotrader.co.uk] INFO: Saving data for 202402236873414: {'created_time': 1774453316.255313, 'last_price_update_time': 1774453316.255326}
2026-03-25 15:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202402236873414') HTTP/1.1" 204 0
2026-03-25 15:41:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/9cdc14d5b485421eb500b2b707911a4f.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 15:41:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 15:41:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f229dc8ef10>
2026-03-25 15:41:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 15:41:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 15:41:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 15:41:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48a11db5-5dfd-5aec-b099-bc0a0c9f1fb3/48a11db5-5dfd-5aec-b099-bc0a0c9f1fb3_image_0.jpg HTTP/1.1" 201 0
2026-03-25 15:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9cdc14d5b485421eb500b2b707911a4f.jpg') HTTP/1.1" 204 0
2026-03-25 15:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9cdc14d5b485421eb500b2b707911a4f.jpg saved to cache
2026-03-25 15:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 48a11db5-5dfd-5aec-b099-bc0a0c9f1fb3
2026-03-25 15:41:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 48a11db5-5dfd-5aec-b099-bc0a0c9f1fb3 sending to next pipeline
2026-03-25 15:41:56 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 48a11db5-5dfd-5aec-b099-bc0a0c9f1fb3 with identifier 202303315831269
2026-03-25 15:41:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:57 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 48a11db5-5dfd-5aec-b099-bc0a0c9f1fb3
2026-03-25 15:41:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/9cdc14d5b485421eb500b2b707911a4f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 85,
'color': 'Grey',
'currency': 'GBP',
'description': 'This 2016 Renault Clio dCi Dynamique Nav is a truly '
'exceptional find, having been cherished by only two owners '
'from new and boasting a clear vehicle history check. Powered '
'by an efficient 1.5L Diesel engine, this Euro 6 compliant '
'model offers a remarkable 86 mpg, making it incredibly '
'economical for daily driving. The Dynamique Nav trim comes '
'equipped with a convenient Handsfree Keycard featuring a Push '
'Button Start Stop function and keyless entry, alongside the '
'Renault MediaNav system with Bluetooth connectivity for '
'seamless entertainment and communication. Comfort is assured '
'with manual air conditioning, ensuring a pleasant cabin '
'environment in all conditions.\n'
'\n'
'The appeal of this Clio extends beyond its impressive fuel '
'economy, which is significantly better than many comparable '
'vehicles. Its low insurance group rating further contributes '
'to its affordability, while its low CO2 emissions highlight '
'its environmental consideration. These combined factors make '
'this Renault Clio dCi Dynamique Nav an outstanding choice for '
'those seeking a practical, cost effective, and well equipped '
'hatchback.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 89,
'fuel_type': 'Diesel',
'id': '48a11db5-5dfd-5aec-b099-bc0a0c9f1fb3',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202303315831269',
'listing': 'directbuy',
'location': 'Luton, Bedfordshire',
'make': 'Renault',
'model': 'Clio',
'odometer': 99792,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 64,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48a11db5-5dfd-5aec-b099-bc0a0c9f1fb3/48a11db5-5dfd-5aec-b099-bc0a0c9f1fb3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344072,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9cdc14d5b485421eb500b2b707911a4f.jpg',
'Width': 2048}],
'price': 4499,
'price_includes_vat': True,
'registration_date': '2016-09-16',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Dynamique Nav Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'Dynamique Nav',
'year': 2016}
2026-03-25 15:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202303315831269%27 HTTP/1.1" 200 None
2026-03-25 15:41:57 [auto_selling_autotrader.co.uk] INFO: Saving data for 202303315831269: {'created_time': 1774453317.194735, 'last_price_update_time': 1774453317.194752}
2026-03-25 15:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202303315831269') HTTP/1.1" 204 0
2026-03-25 15:41:57 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-25 15:41:57 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close cursor: 'SaveToCdlqDbAutoSelling' object has no attribute 'cursor'
2026-03-25 15:41:57 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close connection: 'SaveToCdlqDbAutoSelling' object has no attribute 'conn'
2026-03-25 15:41:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 15:41:57 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process scrape complete CloudEvent for item 1a09905c286111f18f76c264925fbcfa
2026-03-25 15:41:57 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-25 15:41:57 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-25 15:41:57 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-25 15:41:57 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-25 15:41:57 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-25 15:41:57 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.MAPPED: 3> -> <SessionState.END_SENT: 4>
2026-03-25 15:41:57 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPENED: 9> -> <ConnectionState.CLOSE_SENT: 11>
2026-03-25 15:41:57 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.CLOSE_SENT: 11> -> <ConnectionState.END: 13>
2026-03-25 15:41:57 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.END_SENT: 4> -> <SessionState.DISCARDING: 6>
2026-03-25 15:41:57 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-25 15:41:57 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-25 15:41:57 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-25 15:41:57 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-25 15:41:57 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-25 15:41:57 [azure.servicebus._pyamqp._transport] DEBUG: Transport endpoint is already disconnected: OSError(107, 'Transport endpoint is not connected')
2026-03-25 15:41:57 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: [AzureBusPipeline] connection closed
2026-03-25 15:41:57 [auto_selling_autotrader.co.uk] INFO: auto_selling_autotrader.co.uk Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 2, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2026-03-25 15:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 15:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20last_price_update_time%20lt%201773157317 HTTP/1.1" 200 None
2026-03-25 15:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602180022565') HTTP/1.1" 204 0
2026-03-25 15:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602190060161') HTTP/1.1" 204 0
2026-03-25 15:41:58 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (42 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto_selling_autotrader.co.uk/1a09905c286111f18f76c264925fbcfa.jl
2026-03-25 15:41:58 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 344368,
'downloader/request_count': 50,
'downloader/request_method_count/GET': 42,
'downloader/request_method_count/POST': 8,
'downloader/response_bytes': 10721511,
'downloader/response_count': 50,
'downloader/response_status_count/200': 50,
'elapsed_time_seconds': 18.452948,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 25, 15, 41, 58, 442437, tzinfo=datetime.timezone.utc),
'item_scraped_count': 42,
'log_count/DEBUG': 761,
'log_count/INFO': 661,
'memusage/max': 147238912,
'memusage/startup': 147238912,
'photo_download_count': 42,
'request_depth_max': 4,
'response_received_count': 8,
'scheduler/dequeued': 50,
'scheduler/dequeued/memory': 50,
'scheduler/enqueued': 50,
'scheduler/enqueued/memory': 50,
'scrape_type/new': 42,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 8,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 1.746661559387576,
'scrapy-zyte-api/mean_response_seconds': 2.20590411243029,
'scrapy-zyte-api/processed': 8,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 8,
'scrapy-zyte-api/request_args/experimental.requestCookies': 7,
'scrapy-zyte-api/request_args/experimental.responseCookies': 8,
'scrapy-zyte-api/request_args/httpRequestBody': 8,
'scrapy-zyte-api/request_args/httpRequestMethod': 8,
'scrapy-zyte-api/request_args/httpResponseBody': 8,
'scrapy-zyte-api/request_args/httpResponseHeaders': 8,
'scrapy-zyte-api/request_args/url': 8,
'scrapy-zyte-api/status_codes/200': 8,
'scrapy-zyte-api/success': 8,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'start_time': datetime.datetime(2026, 3, 25, 15, 41, 39, 989489, tzinfo=datetime.timezone.utc)}
2026-03-25 15:41:58 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-25 15:41:58 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f22a118f7d0>
2026-03-25 15:41:58 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f22a119c050>